Qhov Sib Txawv ntawm Cov Khoom Siv Kho Vajtse hauv Kev Kawm Neeg Hlau
Kev lag luam robotics muaj teeb meem txog cov ntaub ntawv. Cov chaw kuaj mob loj kwv yees tias lawv xav tau 100 lab txog 1 billion teev ntawm cov ntaub ntawv egocentric (thawj tus neeg) hauv 2-3 xyoos tom ntej no los cob qhia cov cai tswj hwm siab heev. Cov zej zog tshawb fawb tau teb - Open-AoE tau tso tawm 2,000 teev ntawm cov yeeb yaj kiab egocentric, EgoDex tau xa 829 teev nrog 3D tes taug qab, thiab EgoVerse tam sim no suav nrog 1,362 teev ntawm tib neeg ua qauv qhia uas suav nrog ntau txhiab txoj haujlwm hauv ntiaj teb tiag.
Tiam sis muaj teeb meem: cov khoom siv kho vajtse siv los sau cov ntaub ntawv no tsis ua raws li qhov xav tau. Feem ntau cov ntaub ntawv egocentric niaj hnub no yog sau los ntawm kev siv cov khoom siv rov ua dua tshiab - smartphones, action cameras, thiab VR headsets. Cov khoom siv no yeej tsis tau tsim los rau kev sau cov ntaub ntawv kawm ntawm neeg hlau. Lawv tsis muaj cov sensors thoob ntiaj teb, kev sib dhos kho vajtse, thiab kev kho kom raug - cov yam ntxwv uas tsis sib tham tau rau kev tsim cov ntaub ntawv kev cob qhia siv tau.
Lub Koob Yees Duab Ego - Lub Hom Phiaj Tsim Los Rau Kev Sau Cov Ntaub Ntawv Egocentric
Lub Koob Yees Duab Ego hloov qhov no. Nws yog lub koob yees duab stereo uas tau teeb tsa rau ntawm lub taub hau rau cov ntaub ntawv kev cob qhia neeg hlau - tsim los rau lub hom phiaj, tsis yog siv dua tshiab. Tsim tshwj xeeb rau cov cuab yeej ntes cov ntaub ntawv hnav tau rau kev kawm ua raws li thiab kev sau cov ntaub ntawv AI, nws daws qhov teeb meem ntawm cov khoom siv kho vajtse uas tau ua rau qeeb qeeb hauv kev kawm neeg hlau.
Cov yam ntxwv tseem ceeb
Lub Shutter Thoob Ntiaj Teb rau Kev Ntxig Duab
Tsis zoo li cov sensors dov uas qhia kab los ntawm kab, Ego Camera lub dual global shutter sensors qhia tag nrho cov pixels tib lub sijhawm. Txhua lub thav duab yog geometrically intact - tsis muaj distortion, tsis muaj jello effect thaum lub sij hawm ceev tes thiab lub cev txav. Qhov no ua rau Ego Camera yog lub koob yees duab dual lens global shutter zoo tagnrho rau kev ntes kev txav mus los, xa cov thav duab uas siv tau rau VLA thiab kev cob qhia txoj cai diffusion.
Kev Pom Kev Stereo Sib Xws Nrog Kho Vajtse
Ob lub koob yees duab no raug teeb tsa los ntawm ib lub teeb liab kho vajtse, lav tias cov duab sab laug thiab sab xis yuav raug ntes tib lub sijhawm. Lub koob yees duab stereo no uas sib txuas ua ke rau kev pom qhov tob tshem tawm qhov tsis sib xws ntawm cov khub stereo - qhov tseem ceeb rau kev sib phim stereo, kev kwv yees qhov tob, thiab kev tsim kho dua tshiab 3D. Rau cov kws tshawb fawb uas tsim cov kab ke pom, qhov no yog lub koob yees duab stereo sib txuas ua ke rau kev tsim kho dua tshiab 3D uas muab cov txiaj ntsig txhim khu kev qha tawm ntawm lub thawv.
Ua-hauv 6-Axis IMU nrog Kho Vajtse Sync
Lub accelerometer thiab gyroscope sib xyaw ua ke muab cov ntaub ntawv kho qhov txav uas tseem ceeb rau VIO thiab SLAM pipelines. Lub koob yees duab stereo hnav lub taub hau no nrog IMU rau SLAM muab cov nqi kuaj uas tuaj yeem teeb tsa tau los ntawm 100Hz txog 500Hz - hloov kho rau cov kev txav sib txawv los ntawm kev tswj qeeb mus rau kev taw qhia ceev ceev. Lub IMU yog hardware-timestamped thiab synchronized nrog cov thav duab lub koob yees duab ntawm qib nanosecond - tsis yog software-interpolated. Qhov no xa cov drift-free visual-inertial fusion, sib xws nrog VINS-Fusion, OpenVINS, thiab ORB-SLAM3. Nws yog, hauv txhua qhov kev nkag siab, lub koob yees duab shutter thoob ntiaj teb mounted rau VIO kev tsim kho.
Hoobkas Calibration - Plug thiab Ua Si
Txhua chav tsev muaj cov ntaub ntawv calibration tshwj xeeb uas muaj cov intrinsics, distortion coefficients, thiab stereo extrinsics. Tsis muaj checkerboards. Tsis muaj onsite calibration. Lub koob yees duab no tau calibrated los ntawm lub Hoobkas rau AI npaj txhij rau kev kaw hauv 5 feeb - ntsaws rau ntawm USB thiab pib thaij duab.
Cov Nanosecond Timestamps Unified
Txhua lub thav duab ntawm lub koob yees duab thiab txhua tus qauv IMU sib koom tib lub moos kho vajtse, ua tiav qhov sib phim ntawm lub sijhawm nanosecond. Lub koob yees duab stereo no nrog lub sijhawm kho vajtse rau cov ntaub ntawv sau ua ke ua tau raws li cov qauv kev ua haujlwm tseeb uas xav tau rau cov qauv kev tshaj lij egocentric thiab VIO pipelines.
Koj tau txais dab tsi los ntawm lub thawv
- Cov yeeb yaj kiab stereo sab laug / sab xis sib dhos ua ke (MP4)
- Cov ntaub ntawv IMU 6-axis nrog cov sijhawm kho vajtse (CSV)
- Cov ntaub ntawv calibration Hoobkas tshwj xeeb (YAML)
- Ua tiav SDK/API rau Windows, Linux, thiab ROS
- Kev sib txuas USB plug-and-play
Yog Rau Leej Twg?
Txawm koj yog ib lub chaw tshawb fawb hauv tsev kawm qib siab, ib lub tuam txhab AI uas muaj lub cev, lossis ib lub chaw muab kev pabcuam sau cov ntaub ntawv, Ego Camera yog lub koob yees duab zoo tshaj plaws rau kev sau cov ntaub ntawv robotics rau koj cov kev xav tau. Nws ua haujlwm ua lub mloog pob ntseg stereo rau kev sau cov ntaub ntawv AI thiab lub koob yees duab uas muaj nqis rau kev tshawb fawb AI - xa cov ntaub ntawv zoo tshaj plaws yam tsis muaj teeb meem calibration.
Lub sijhawm tshaj tawm: Lub Yim Hli-19-2026
