Kusiyana kwa Zipangizo mu Kuphunzira kwa Ma Robot
Makampani opanga ma robotic ali ndi vuto la deta. Ma laboratories otsogola akuti akufunika maola 100 miliyoni mpaka 1 biliyoni a deta ya egocentric (munthu woyamba) pazaka 2-3 zikubwerazi kuti aphunzitse mfundo zapamwamba zoyendetsera zinthu. Gulu lofufuza layankha — Open-AoE yatulutsa maola 2,000 a kanema wa egocentric, EgoDex yapereka maola 829 ndi 3D hand tracking, ndipo EgoVerse tsopano ikuphatikizapo maola 1,362 a ziwonetsero za anthu zomwe zikuphatikizapo ntchito zambirimbiri zenizeni.
Koma pali vuto: zipangizo zomwe zimagwiritsidwa ntchito kusonkhanitsa deta iyi sizikugwirizana ndi kufunikira kwa deta. Ma data ambiri odzikuza masiku ano amasonkhanitsidwa pogwiritsa ntchito zipangizo zomwe anthu amagwiritsa ntchito — mafoni a m'manja, makamera ochitapo kanthu, ndi mahedifoni a VR. Zipangizozi sizinapangidwepo kuti zisonkhanitse deta yophunzirira ya robot. Zilibe masensa otsekera padziko lonse lapansi, kulumikizana kwa hardware, ndi kukonza mafakitale — zinthu zomwe sizingakambirane popanga deta yophunzitsira yogwiritsidwa ntchito.
Kamera ya Ego - Yopangidwira Kusonkhanitsa Deta Yodzikuza
Kamera ya Ego imasintha izi. Ndi kamera ya stereo yoyikidwa pamutu yophunzitsira deta ya loboti - yopangidwa mwaluso, osati yogwiritsidwanso ntchito. Yopangidwira makamaka chipangizo chojambulira deta chomwe chingagwiritsidwe ntchito pophunzira motsanzira komanso kusonkhanitsa deta ya AI, imathetsa kusiyana kwa zida zomwe zachepetsa kupita patsogolo kwa kuphunzira kwa loboti.
Zinthu Zazikulu
Chotsekera Padziko Lonse Chojambulira Moyenda
Mosiyana ndi masensa ozungulira omwe amawonetsa mzere ndi mzere, masensa awiri a Ego Camera amawonetsa ma pixel onse nthawi imodzi. Chimango chilichonse chili bwino - palibe kupotoka, palibe jello effect panthawi yoyenda mwachangu ndi manja ndi thupi. Izi zimapangitsa Ego Camera kukhala kamera yabwino kwambiri yojambulira ma lens awiri padziko lonse lapansi yojambulira mayendedwe, yopereka mafelemu omwe angagwiritsidwe ntchito pophunzitsa mfundo za VLA ndi kufalitsa.
Masomphenya a Stereo Ogwirizana ndi Zida
Makamera onse awiriwa amayambitsidwa ndi chizindikiro chofanana cha hardware, zomwe zimatsimikizira kuti mafelemu akumanzere ndi akumanja amajambulidwa nthawi yomweyo. Kamera iyi ya stereo yolumikizidwa ndi hardware kuti izindikire kuya imachotsa kusagwirizana kwa nthawi pakati pa awiriawiri a stereo - yofunika kwambiri pakufananiza molondola kwa stereo, kuwerengera kuya, ndi kukonzanso kwa 3D. Kwa ofufuza omwe amapanga machitidwe ozindikira, iyi ndi kamera ya stereo yolumikizidwa yokonzanso 3D yomwe imapereka zotsatira zodalirika kuchokera m'bokosi.
IMU yomangidwa mkati mwa 6-Axis yokhala ndi Hardware Sync
Accelerometer yolumikizidwa ndi gyroscope imapereka deta yolipirira mayendedwe ofunikira pa mapaipi a VIO ndi SLAM. Kamera iyi ya stereo yovala mutu yokhala ndi IMU ya SLAM imapereka kuchuluka kwa zitsanzo kuyambira 100Hz mpaka 500Hz — yosinthika ku kayendedwe kosiyanasiyana kuyambira pakusintha pang'onopang'ono mpaka kusinthasintha kwachangu. IMU ili ndi nthawi yolumikizidwa ndi zida ndipo imagwirizanitsidwa ndi mafelemu a kamera pamlingo wa nanosecond — osati yolumikizidwa ndi mapulogalamu. Izi zimapereka kusakanikirana kowoneka bwino komanso kopanda kugwedezeka, kogwirizana kwathunthu ndi VINS-Fusion, OpenVINS, ndi ORB-SLAM3. Ndi, mwanjira iliyonse, kamera yotsekera padziko lonse lapansi yoyikidwa pamutu kuti ipange VIO.
Kukonza Mafakitale - Pulagi ndi Kusewera
Chida chilichonse chimabwera ndi fayilo yapadera yoyezera momwe zinthu zilili, ma coefficients opotoka, ndi stereo extrinsics. Palibe ma checkerboard. Palibe kuyezera komwe kuli. Kamera iyi yoyezera mutu yomwe imayikidwa mufakitale ya AI ndi yokonzeka kujambula mumphindi 5 - ilumikizidwa kudzera pa USB ndikuyamba kujambula.
Zizindikiro za Nthawi za Nanosecond Zogwirizana
Chimango chilichonse cha kamera ndi chitsanzo chilichonse cha IMU chimakhala ndi wotchi yofanana ya hardware, zomwe zimapangitsa kuti pakhale kulumikizana kwa nanosecond-level temporal. Kamera iyi ya stereo yokhala ndi nthawi yosungiramo hardware kuti ikwaniritse miyezo yolondola yofunikira pa ma benchmarks aukadaulo odzikuza komanso mapaipi a VIO.
Zimene Mumapeza M'bokosi
- Kanema wa stereo wolumikizidwa kumanzere/kumanja (MP4)
- Deta ya IMU ya 6-axis yokhala ndi ma timestamp a hardware (CSV)
- Fayilo yapadera yowerengera fakitale (YAML)
- SDK/API yonse ya Windows, Linux, ndi ROS
- Kulumikizana kwa USB plug-and-play
Kodi Ndi Ya Ndani?
Kaya ndinu labu yofufuza ku yunivesite, kampani yodziwika bwino ya AI, kapena wopereka chithandizo chosonkhanitsa deta, Ego Camera ndiye kamera yabwino kwambiri yovalidwa yosonkhanitsira deta ya robotics yomwe ikugwirizana ndi zosowa zanu. Imagwira ntchito ngati mutu wa stereo vision wosonkhanitsira deta ya AI komanso kamera yotsika mtengo yokhazikika pamutu yofufuza za AI - yopereka deta yapamwamba popanda mutu wowongolera.
Nthawi yotumizira: Ogasiti-19-2026
