Kamera ya Ego - Chida Chowonera Stereo Chokwezedwa Mutu Chosonkhanitsira Deta Yophunzirira Robot
Kamera yozungulira yokhala ndi mutu womangidwa kuti igwire deta yowonetsera anthu. Imapereka deta ya sensor yoyambirira yolumikizidwa ndi hardware, yokonzedwa kale ndi fakitale kuti ipange mphamvu yophunzirira zoyerekeza komanso mapaipi a AI opangidwa mkati.
Botolo la Deta Lomwe Likuvutitsa AI Yathupi
Pofika chaka cha 2026, mgwirizano wapadziko lonse wapangidwa m'makampani opanga ma robotiki: deta ndiye choletsa chachikulu chomwe chimaletsa kufalikira kwa AI yakuthupi. Mitundu yayikulu ya zilankhulo imagwiritsa ntchito ma trillions a ma token a zolemba, komabe makina a AI opangidwa ali ndi mwayi wopeza zosakwana gawo limodzi mwa magawo khumi a bukuli muzithunzi zenizeni zolumikizirana.
Kusiyana kumeneku kumabweretsa vuto lalikulu pakupita patsogolo. Ma labotale otsogola a robotics akuti kuphunzitsa mfundo zapamwamba zowongolera kumafuna maola 100 miliyoni mpaka 1 biliyoni a kujambula zithunzi za munthu woyamba mkati mwa zaka 2-3 zikubwerazi. Ngakhale pa ntchito imodzi yowongolera, deta yophunzitsira imafuna maola pakati pa 100,000 ndi 1 miliyoni a zochita za anthu zojambulidwa.
Akatswiri amakampani amavomereza kuti kujambulidwa kwa deta yodzikonda kumapereka mwayi waukulu kwambiri wokulirapo. M'malo modalira zida zogulitsira ma teleo zomwe zimawononga ndalama zambirimbiri za madola aku US pa unit iliyonse, magulu ofufuza ndi ogulitsa deta tsopano amagwiritsa ntchito makamera opepuka okhala ndi mitu kuti ajambule zithunzi zowonetsera pamene anthu akuchita ntchito zachilengedwe za tsiku ndi tsiku.
Kusintha kumeneku kukuwonekera kale m'malo enieni omwe amagwiritsidwa ntchito. Mu Epulo 2026, zithunzi zomwe zawonetsedwa pa intaneti zinawonetsa antchito ambiri a nsalu ku Delhi NCR m'chigawo cha India atavala makamera opangidwa ndi Egolab.AI. Ogwira ntchitowa tsopano amapanga makanema akuluakulu odzikuza kuti aphunzitse maloboti amtundu wa anthu a m'badwo wotsatira.
Chifukwa Chake Deta ya Munthu Woyamba Yodzikuza Ndi Yofunika Kwambiri
Maloboti ayenera kuzindikira momwe anthu amaonera kuti atsanzire luso lawo loyendetsa thupi molondola. Kafukufuku wofalitsidwa pakati pa 2025 ndi 2026 amatsimikizira kufunika kosintha kwa deta ya egocentric:
1.
HumanEgo Kanema wongoganizira za anthu pa ntchito iliyonse kwa mphindi 30 zokha umakwaniritsa chiwongola dzanja chapakati cha 92.5% pa ntchito zenizeni, zomwe zimathandiza kusamutsa luso kuchokera kwa anthu kupita ku maloboti popanda kuwombera mfuti.
2.
EgoMimic Kuphatikiza deta yowonetsera anthu kumawonjezera magwiridwe antchito ndi 34% mpaka 228% poyerekeza ndi deta yophunzitsira ya loboti yokha. Ola limodzi lojambula zithunzi zowonjezera za anthu m'manja limapereka kusintha kwakukulu kwa chitsanzo kuposa ola limodzi la deta yowonjezera ya loboti yodzisonkhanitsa yokha. Ma data a hybrid a anthu ndi maloboti amaperekanso maphunziro abwino kwambiri komanso magwiridwe antchito, kuphatikiza zithunzi zochokera ku ntchito za teleoperation zazitali.
3.
Chiwongola dzanja Yopangidwa ndi ofufuza a NVIDIA, dongosololi limagwiritsa ntchito deta yosiyanasiyana ya maola 20,854 a zithunzi za anthu odzikonda kuti azitha kugwiritsa ntchito luso lawo pa ntchito zonse.
4.
Open-AoE Imatulutsa deta ya kanema ya maola 2,000 yokhala ndi egocentric yokhala ndi ma synchronized hand kinematics ndi ma atomic action annotations.
5.
Mafelemu apamwamba kwambiri Mafelemu apamwamba kwambiri kuphatikizapo EgoGuide ndi EgoLive amapangitsa kuti zithunzi ziwonekere popanda kugwiritsa ntchito maloboti komanso kupanga deta yokhudza anthu ambiri.
Ngakhale kuti makampaniwa akupitilizabe kuchita bwino ntchito yawo, njira zothetsera mavuto a hardware kuti azitha kujambula zithunzi za anthu odzikonda kwambiri zikupitirirabe kugawikana. Ofufuza ndi magulu ofufuza deta akukakamizidwa kuphatikiza makamera ochitira zinthu ndi makasitomala, magalasi a AR, ndi zida zopangidwa mwapadera—kuchepetsa kulondola kwa ma synchronization, kusinthasintha kwa ma calibration, komanso chitonthozo chomwe chimagwiritsidwa ntchito nthawi yayitali.
Chidule cha Kamera ya Ego
Kamera ya Ego ndi kamera ya stereo yokhala ndi mutu wokwera kuchokera pansi kuti igwire deta ya egocentric mu kuphunzira kwa robot, embodimentary AI, ndi ntchito zotsanzira kuphunzira.
Mosiyana ndi makamera ogwiritsidwa ntchito ndi ogula omwe amagwiritsidwanso ntchito pofufuza, Kamera ya Ego idapangidwira mapaipi a robotic ophunzirira komanso amafakitale. Imatulutsa deta ya raw sensor yoyera, yolumikizidwa ndi hardware, yokonzedwa kale ndi fakitale popanda kukhazikitsa kofunikira pambuyo pokonza.
Mafotokozedwe Aukadaulo Apakati
| Kufotokozera | Tsatanetsatane |
|---|---|
| Zosensa za Zithunzi | Masensa a CMOS a 2MP Global Shutter Awiri |
| Malo Owonera Molunjika (HFOV) | 60–65°, mawonekedwe achilengedwe a munthu |
| Ukadaulo wa Shutter | Chotsekera Padziko Lonse; chimachotsa kupotoza kwa chotsekera chozungulira panthawi yoyenda mwachangu kwambiri |
| Gawo la IMU | 6-axis ICM-26888-P (3-axis accelerometer + 3-axis gyroscope), 200–500 Hz frequency sampling |
| Njira Yogwirizanitsa | Choyambitsa GPIO cha Hardware; cholakwika cha synchronization ya chimango-IMU < 10 microseconds |
| Kuyika chizindikiro cha nthawi | Ma nanosecond timestamp ogwirizana a hardware pa chimango chilichonse cha chithunzi ndi kuwerenga kwa IMU |
| Chiyankhulo Cholumikizidwa ndi Waya | USB 2.0 Type-C, yogwirizana ndi UVC; chithandizo cha SDK cha nsanja zosiyanasiyana cha Windows, Linux, ndi ROS |
| Kutumiza Opanda Zingwe | Kusungirako makadi a WiFi + MicroSD mkati; zithunzi zimayikidwa patsogolo pa malo osungiramo zinthu, kukweza kwa mtambo wokha pa netiweki yolumikizidwanso |
| Muyezo Woyika | Mabowo okwerera a 1/4″-20, ogwirizana ndi zingwe zamutu za aftermarket ndi zida zapadera |
| Kulinganiza | Magawo a stereo omwe adakonzedwa kale m'fakitale komanso kusintha kwa kamera-IMU, amasungidwa kosatha mu kukumbukira kwa flash komwe kuli mkati. |
Chifukwa Chake Global Shutter Sichingakambirane pa Kuphunzira kwa Robot
Makamera ogwiritsa ntchito amagwiritsa ntchito masensa otsekera omwe amawonetsa mizere ya ma pixel motsatizana. Kusuntha mwachangu kwa manja a anthu—chinthu chomwe chimapezeka nthawi zonse mu kanema wowonetsera—kumapanga zinthu zotsekera zotsekera zomwe zimatchedwa "jelly effect": m'mphepete mwa chinthu chokhotakhota, kupindika kwa geometric, ndi kutsatira mawonekedwe osadalirika.
Kusokoneza kumeneku kumalepheretsa mapaipi a robotic. Ma VIO frontends, ma algorithms a SLAM owoneka bwino, ndi mfundo zoyeserera zophunzirira sizingathe kulekerera kusintha kosayembekezereka kwa mawonekedwe apakati pa chimango, komwe kumawononga kwambiri kufalikira kwa ma model ndi magwiridwe antchito enieni.
Chojambulira cha Ego Camera padziko lonse lapansi chimawonetsa ma pixel onse nthawi imodzi pawindo limodzi lojambula. Chimango chilichonse chikugwirizana ndi mawonekedwe olimba osasinthasintha konse - muyezo wofunikira pakufufuza mwamphamvu za roboti ndi maphunziro amalonda.
Pamene makampaniwa akupitilizabe kufufuza zambiri zokhudza kudzikuza (monga zolemba za EgoLive zomwe zimasungidwa maola masauzande ambiri za zithunzi za stereo zomwe zimaphimba ntchito zenizeni zapakhomo ndi zamafakitale), kufunikira kwa zida zojambulira zithunzi zopanda kupotoza komanso zolondola kukupitirirabe kukula.
Kugwirizanitsa Zida Zamagetsi: Kusiyana Pakati pa Deta Yophunzitsira Yotsika Mtengo ndi Yopanga
Anthu akamayendetsa zinthu motsatira njira zosiyanasiyana—kufika, kugwira, kuyika zinthu—ndondomeko za loboti zimafuna kulinganiza bwino nthawi pakati pa kuyenda kwa manja ndi kuyenda kwa thupi kopanda mphamvu. Ngakhale ma millisecond ochepa a desync pakati pa mafelemu a kamera ndi ma IMU readings amadetsa deta yonse yophunzitsira. Kulinganiza nthawi kochokera ku mapulogalamu (soft synchronization) kumasonkhanitsa mayendedwe pa nthawi yojambulira ndipo sikukwaniritsa miyezo yolondola ya VIO yapamwamba komanso njira zophunzirira zotsanzira.
Kamera ya Ego imagwiritsa ntchito GPIO pulse yapadera kuti iyambe masensa a binocular ndi IMU nthawi imodzi, kupereka kulondola kwa synchronization kuposa ma microsecond 10. Chifaniziro chilichonse cha chithunzi ndi chitsanzo cha inertial chimakhala ndi nthawi yogawana ya hardware—yomwe ikukwaniritsa zofunikira za nthawi ya VIO frameworks zazikulu kuphatikiza VINS-Fusion ndi OpenVINS.
Ma data a Flagship omwe ali ndi zolemba za egocentric monga Open-AoE amadalira gulu ili la hardware synchronization kuti lipereke zilembo zolembedwa zogwirizana, MANOS-based hand pose estimation, camera trajectory logs, ndi temporally located atomic action tag—zonse zomwe Ego Camera idapangidwira kuti izithandizira.
Kukonza Zinthu Pasadakhale Pa fakitale: Kuchotsa Kukonza Zinthu Pamalo Omwe Amawononga Nthawi
Kukonza ma calibration ndi manja ndi chimodzi mwa zinthu zomwe zimafuna kwambiri kuti munthu azitha kujambula deta pogwiritsa ntchito makamera ambiri. Kusintha ma lens amkati, ma stereo extrinsic offsets, ndi ma camera-IMU transform matrices kumafuna zida zapadera zowunikira, ukatswiri waukadaulo, ndi maola ogwira ntchito pa chipangizo chilichonse.
Kamera ya Ego imachotsa ntchito yonseyi. Chida chilichonse chimayesedwa bwino chisanachoke ku fakitale. Ma parameter onse ofunikira—focal length, principal point coordinates, distortion coefficients, stereo extrinsics, ndi camera-IMU transforms—amalembedwa kosatha ku flash memory yomwe ili mkati.
Magulu ofufuza ndi ogulitsa deta akhoza kuyamba kujambula zithunzi zenizeni mkati mwa mphindi zisanu kuchokera pamene anatsegula bokosi, popanda zolinga zoyang'ana, zida zoyezera, kapena magawo oyezera a theka la tsiku. Ma dataseti amakono apamwamba kwambiri a ego amalola zida zamakamera zoyesedwa kale ndi fakitale—njira yopangidwira mwachindunji mu chipangizo chilichonse cha Ego Camera.
Njira ziwiri zotumizira, Pulatifomu imodzi yogwirizana ya Hardware
1. Njira Yolumikizidwa ndi Waya ya USB
Lumikizani ku ma laputopu kapena malo ogwirira ntchito kuti muwoneretu nthawi yeniyeni komanso kujambula zinthu mochedwa. Yakonzedwa bwino kuti igwiritsidwe ntchito m'malo owunikira omwe ofufuza amatsimikiza mtundu wa deta nthawi iliyonse akafuna. Imathandizidwa mokwanira ndi ma SDK omwe ali papulatifomu zosiyanasiyana omwe amagwirizana ndi Windows, Linux, ndi ROS robotics.
2. WiFi + MicroSD Card Mode Yopanda Intaneti
Kujambula kosalumikizidwa kwa deta yogawidwa kwambiri. Kanema wonse wojambulidwa amalemba kaye ku malo osungira a MicroSD am'deralo kuti apewe kutayika kwa deta panthawi ya netiweki; kulumikizana kukabwezeretsedwa, mafayilo amalumikizana okha ku ma seva akutali amtambo kapena m'malo osungira deta omwe ali pamalopo. Ndikoyenera kujambula zithunzi zambiri m'makhitchini, m'maofesi opanga zinthu, m'maofesi, ndi m'malo ena enieni kuti apange maola masauzande ambiri a kanema wowonetsera.
Kutulutsa Deta Yosaphika Yokonzedwa (Palibe Kukonza AI Yomwe Ili Pakompyuta)
Chipangizochi chimatulutsa deta yosasinthika, yeniyeni ya sensa yopanda chithunzi chokonzedwa mkati, zolemba zokha, kapena malingaliro a AI pa chipangizo—kusunga kukhulupirika kwathunthu kwapadera kuti kuphatikizidwe mu mapaipi ophunzitsira apadera:
kanema_wamanzere.mp4/kanema_wamanja.mp4: Mavidiyo owonera a stereo binocular ogwirizanaimu_6axis.csv: Zolemba zoyezera za inertial za 6-axis (accelerometer + gyroscope) zolembedwa ndi ma timestamp a hardwarenthawi_zidule_n.txt: Ma timestamp a zida za nanosecond zogwirizana za mafelemu onse azithunzi ndi zitsanzo za IMUcalibration_params.yaml: Kusintha kwa kapangidwe ka mkati, kunja, ndi kamera-IMU kophikidwa m'fakitale
Magawo a Ogwiritsa Ntchito Omwe Akufuna
Ma laboratories ofufuza zamaphunziro ophunzirira a AI ndi ena
Opanga ma robot a humanoid ndi ma robot odziwa bwino ntchito yawo
Opereka chithandizo cha data apadera omwe amapanga ma data ophunzitsira makasitomala enieni a AI
Magulu a R&D akumanga ma algorithms a VIO ndi SLAM owoneka bwino
Magulu a Robotics akukulitsa ntchito zazikulu zosonkhanitsira deta yowonetsa kudzikonda
Nthawi yotumizira: Ogasiti-11-2026
