ROVIO is a monocular VIO that feeds photometric errors of multilevel image patches directly into a robocentric EKF, with landmarks parameterised by bearing vector and inverse distance, enabling undelayed feature use, power-up-and-go operation and online extrinsic calibration in real time on one CPU core.

技術屬性

欄位內容為文獻擷取紀錄的原文用語(英文),以原文為據;「未查證」表示本研究尚未讀到該資訊,不代表該方法不具備此能力。

ROVIO 的技術屬性
感測輸入monocular camera、IMU
原文測試平台handheld (VI-Sensor; slow and fast motion with motion-capture ground truth)、UAV (multirotor with forward-looking visual-inertial sensor; filter output used for flight control)
狀態估計EKF with a fully robocentric state (position, velocity, attitude, IMU biases, camera-IMU extrinsics, and per feature a bearing vector plus inverse-distance parameter) using minimal boxplus differences on SO(3) and S2; linearisation point of uncertain features improved by a patch search; an iterated EKF is named as an alternative (Secs. II-A, II-C)
資料關聯direct: multilevel 8 x 8 pixel patches on a 4-level image pyramid tracked inside the filter; mean-subtracted intensity errors reduced by QR decomposition to a 2D innovation per feature; affine patch warping from two extra bearing vectors; FAST candidates ranked by a multi-level Shi-Tomasi score with bucketing; Mahalanobis outlier rejection (Secs. II-C, III)
時間表示discrete; continuous IMU-driven dynamics discretised with Euler forward integration; one update per image (IMU 200 Hz, images 20 Hz in the experiments) (Secs. II-B, IV-A)
去畸變不適用
迴圈閉合none
全域最佳化none
地圖表示up to 50 robocentric landmarks (bearing vector plus inverse distance) with multilevel patches held in the filter state (Sec. IV-A)
先驗資訊none; camera intrinsics assumed known (factory calibration); IMU-camera extrinsics roughly guessed with translation set to zero and estimated online (Sec. IV-A)
可輸出幾何IMU pose, robocentric velocity, IMU biases and camera-IMU extrinsics with covariance; sparse landmark estimates; no dense map
計算需求single core of an Intel i7-2760QM: 6.65 ms per image with 10 features up to 29.72 ms with 50 features (Table I); run on board a UAV with 50 features at 20 Hz (Sec. V)

使用設備

原文使用的感測器、運算硬體與載具(equipment)。型號保留原文寫法,連結到設備頁中同一型號的歸併名稱;角色依原文用途分為方法輸入、資料集感測器、執行運算平台、參考或真值量測(reference or ground truth)與比較對象設備。

原文使用的設備
類別型號(原文寫法)角色資料集原文規格出處
慣性量測單元(IMU)ADIS 16448歸入:ADIS16448方法輸入未標示industrial grade, angular random walk 0.66 deg/sqrt(Hz), velocity random walk 0.11 m/s/sqrt(Hz), 200 Hz(Bloesch et al., 2015, Sec. IV-A)
雙目相機VI-Sensor (two global-shutter wide-VGA 1/3 inch imagers)方法輸入未標示fronto-parallel stereo, lenses with 120 deg diagonal field of view, factory calibrated pinhole plus radial-tangential model, hardware time-synchronised to the IMU with mid-exposure triggering, 20 Hz; only one camera used(Bloesch et al., 2015, Sec. IV-A)
載具平台multirotor UAV (model not reported)方法輸入未標示forward-oriented visual-inertial sensor; filter output used for feedback control(Bloesch et al., 2015, Sec. IV-D)
運算硬體Intel i7-2760QM執行運算平台未標示single core(Bloesch et al., 2015, Sec. IV-B; Table I)
其他external motion capture system (model not reported)參考或真值量測未標示pose ground truth; some bad tracking filtered out in the fast-motion run(Bloesch et al., 2015, Secs. IV-A, IV-C)

作者報告的優勢與限制

優勢

限制

營建工程相關證據

論文未報告營建工地測試;手持實驗與 UAV 飛行都在動作捕捉系統範圍內進行並以其為參考。直接法影像塊與強度誤差回饋在低紋理或快速運動下的穩健性,對施工現場手持或無人機巡檢的位姿估計有參考價值,但系統只輸出稀疏地標,無法直接產生工程點雲(推論)。

原文驗證環境:受控實驗、獨立參考量測

報告的性能數據

性能數據仍在分批查證,目前尚未收錄此方法的報告值。

來源

  • Bloesch et al., 2015

    Michael Bloesch, Sammy Omari, Marco Hutter, Roland Siegwart(2015)Robust visual inertial odometry using a direct EKF-based approach2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp. 298-304

    同儕審查已出版已讀全文經典查證後修正

回到方法圖鑑

選擇開啟Esc關閉