VINS-Mono
VINS-Mono 以單眼相機加低成本 IMU 估計具公制尺度的六自由度狀態,先以僅視覺 SfM 與視覺慣性對齊完成初始化(陀螺儀偏差、速度、重力方向與尺度),再以滑動視窗緊耦合融合 IMU 預積分(pre-integration)與特徵觀測。迴圈偵測後進行緊耦合重定位,並因 roll、pitch 可由 VIO 觀測,只對 x、y、z 與偏航角做 4-DOF 位姿圖最佳化。作者將稠密建圖列為未來工作。
本頁內容
VINS-Mono provides robust initialisation and tightly-coupled sliding-window monocular VIO with IMU pre-integration, relocalization and 4-DOF pose-graph optimisation, yielding metric trajectories but only sparse maps.
技術屬性
欄位內容為文獻擷取紀錄的原文用語(英文),以原文為據;「未查證」表示本研究尚未讀到該資訊,不代表該方法不具備此能力。
| 感測輸入 | monocular camera、IMU |
|---|---|
| 原文測試平台 | UAV (EuRoC MAV、self-developed quadrotor)、handheld (camera plus DJI A3 IMU suite、VI-Sensor)、mobile phone (iPhone, VINS-Mobile) (Sec. IX) |
| 狀態估計 | tightly-coupled sliding-window nonlinear optimisation with IMU pre-integration and marginalisation; 4-DOF pose-graph optimisation for global consistency (Sec. III, VI, VIII) |
| 資料關聯 | KLT tracking keeping 100 to 300 uniformly spaced corners, RANSAC fundamental-matrix rejection; loop detection with DBoW2 on 500 extra BRIEF corners, then BRIEF matching with 2D-2D fundamental and 3D-2D PnP RANSAC checks before relocalization (Sec. IV-A, VII-A, VII-B) |
| 時間表示 | discrete keyframe states with IMU pre-integration between frames; IMU-rate forward propagation (Sec. IV-B, VI-F) |
| 去畸變 | 不適用 |
| 迴圈閉合 | DBoW2 loop detection with temporal and geometric checks, tightly-coupled relocalization, and loop edges in the pose graph with Huber norm (Sec. VII, VIII-B) |
| 全域最佳化 | 4-DOF (x, y, z, yaw) pose-graph optimisation with Huber-weighted loop edges, run in a separate thread; merging of multiple sessions; five merged EuRoC MH sequences gave 0.21 m ATE RMSE over about 500 m (Sec. VIII-A to D, IX-A-2) |
| 地圖表示 | sparse features in sliding window; keyframe pose graph |
| 先驗資訊 | no prior map required; a previously saved pose graph (keyframe poses, loop links and BRIEF features) can be loaded and merged with the current map by 4-DOF pose graph optimization (Sec. VIII-D to F); camera-IMU extrinsics calibrated online (Sec. VI-A, X) |
| 可輸出幾何 | metric 6-DOF trajectory and sparse features; dense mapping named as future work (Sec. X) |
| 計算需求 | Intel i7-4790 3.60 GHz on the campus dataset: feature detection 15 ms and KLT 5 ms at 25 Hz, window optimization 50 ms at 10 Hz, loop detection 100 ms, pose graph optimization 130 ms (Table II); onboard Intel i7-5500U 3.00 GHz on the aerial robot with 100 Hz IMU-propagated output (Sec. IX-C-1); motion-only optimization about 5 ms versus more than 50 ms for full VIO on embedded computers (Sec. VI-E) |
使用設備
原文使用的感測器、運算硬體與載具(equipment)。型號保留原文寫法,連結到設備頁中同一型號的歸併名稱;角色依原文用途分為方法輸入、資料集感測器、執行運算平台、參考或真值量測(reference or ground truth)與比較對象設備。
| 類別 | 型號(原文寫法) | 角色 | 資料集 | 原文規格 | 出處 |
|---|---|---|---|---|---|
| 行動掃描設備 | iPhone (VINS-Mobile) | 方法輸入 | 未標示 | 30 Hz images at 640x480; arXiv v1 names an iPhone7 Plus | (Qin et al., 2018, Sec. IX-C-2) |
| 慣性量測單元(IMU) | ADIS16448 | 資料集感測器 | EuRoC | 200 Hz, synchronized | (Qin et al., 2018, Sec. IX-A-1) |
| 慣性量測單元(IMU) | DJI A3 flight controller built-in IMU (ADXL278 and ADXRS290) | 方法輸入 | 未標示 | 100 Hz | (Qin et al., 2018, Sec. IX-B-1, Fig. 18) |
| 慣性量測單元(IMU) | DJI A3 flight controller (ADXL278 and ADXRS290) | 方法輸入 | 未標示 | 100 Hz; also used for attitude stabilization control | (Qin et al., 2018, Sec. IX-C-1, Fig. 21) |
| 慣性量測單元(IMU) | InvenSense MP67B | 方法輸入 | 未標示 | built-in six-axis gyroscope and accelerometer of the iPhone, 100 Hz | (Qin et al., 2018, Sec. IX-C-2) |
| 相機 | MatrixVision mvBlueFOX-MLC200w | 方法輸入 | 未標示 | forward-looking global shutter, 752x480, 20 Hz; hand-held indoor suite | (Qin et al., 2018, Sec. IX-B-1, Fig. 18) |
| 相機 | MatrixVision mvBlueFOX-MLC200w with 190-degree fisheye lens | 方法輸入 | 未標示 | forward-looking global shutter, 752x480; MEI camera model | (Qin et al., 2018, Sec. IX-C-1, Fig. 21) |
| 雙目相機 | Aptina MT9V034 | 資料集感測器 | EuRoC | global shutter, WVGA monochrome, 20 FPS; only the left camera used | (Qin et al., 2018, Sec. IX-A-1) |
| 雙目相機 | VI-Sensor | 方法輸入 | HKUST campus dataset | hand-held; 25 Hz images and 200 Hz IMU; 5.62 km HKUST campus loop, 1 h 34 min | (Qin et al., 2018, Sec. IX-B-2) |
| 全測站 | Leica MS50 | 參考或真值量測 | EuRoC | ground-truth states | (Qin et al., 2018, Sec. IX-A-1) |
| 載具平台 | self-developed aerial robot (quadrotor) | 方法輸入 | 未標示 | tracks a figure-eight pattern of 1.0 m radius circles | (Qin et al., 2018, Sec. IX-C-1, Fig. 21) |
| 運算硬體 | Intel i7-4790 | 執行運算平台 | 未標示 | 3.60 GHz; campus dataset timing (Table II) | (Qin et al., 2018, Sec. IX-B-2) |
| 運算硬體 | Intel i7-5500U | 執行運算平台 | 未標示 | 3.00 GHz onboard the aerial robot | (Qin et al., 2018, Sec. IX-C-1) |
| 其他 | VICON歸入:Vicon | 參考或真值量測 | EuRoC | ground-truth states | (Qin et al., 2018, Sec. IX-A-1) |
| 其他 | OptiTrack | 參考或真值量測 | 未標示 | motion capture ground truth for the flight | (Qin et al., 2018, Sec. IX-C-1) |
作者報告的優勢與限制
優勢
- keep
- add: VINS_loop had the lowest or tied-lowest EuRoC ATE RMSE of the three compared configurations (OKVIS monocular, VINS, VINS_loop) in 9 of 11 sequences (Table I)
- loop-closure-disabled flight drifted 0.29 % over 61.97 m (Sec. IX-C-1)
限制
- Monocular VINS may reach weakly observable or degenerate conditions depending on motion and environment (Sec. X)
- Dense map production needs further research (Sec. X)
營建工程相關證據
論文未報告營建工地測試;評估包含 EuRoC、室內與校園大範圍實驗。退化運動(例如等速直線)下的可觀測性問題與工地手持或載具掃描相關(推論)。
原文驗證環境:公開基準、受控實驗
報告的性能數據
以下是原文作者報告的性能數值(author-reported results),不是本研究重新量測的結果。每張圖只並列同一個比較組(comparison group,同一張表、同一組實驗設定)內的方法;不同比較組之間的數值不可直接比較,也不構成排名。
本方法共出現在 27 個比較組,合計 231 筆紀錄。以下列出本方法紀錄最多的 4 組,其餘 23 組列在最後,並連到性能比較頁。
von Stumberg & Cremers, 2022 · Table II 本方法 29 筆
表格設定(擷取紀錄原文):TUM-VI (handheld); RMSE ATE in m; other methods from the TUM-VI paper, DM-VIO median of 5 runs with SE(3) alignment; X = failure; sequence length in brackets (von Stumberg & Cremers, 2022, Table II)
RMSE ATE,TUM-VI · corridor1 (305 m)
只並列這張表在相同設定下報告的方法;以「本方法:」開頭者為本頁方法。失敗、未執行與未報告以標記呈現,不是 0。
按 Tab 進入圖表後,用上下方向鍵逐一瀏覽各類別,Esc 關閉提示框;也可開啟表格檢視閱讀全部數值。
這些是 von Stumberg & Cremers, 2022 在此表設定下報告的數值(author-reported results),只能在同一個比較組內對照,不代表方法在其他資料或設定下的表現。
資料來源作者報告值(von Stumberg & Cremers, 2022, Table II)
| 方法(原文寫法) | 報告值 | 出處 |
|---|---|---|
| ROVIO (stereo) | 0.47 m | (von Stumberg & Cremers, 2022, Table II) |
| VINS (VINS-Mono, mono)本方法 | 0.63 m | (von Stumberg & Cremers, 2022, Table II) |
| OKVIS (stereo) | 0.33 m | (von Stumberg & Cremers, 2022, Table II) |
| BASALT (stereo) | 0.34 m | (von Stumberg & Cremers, 2022, Table II) |
Lin et al., 2021 · Table I 本方法 24 筆
表格設定(擷取紀錄原文):Version of record Table I: relative rotation error (RRE, deg) and relative translation error (RTE, %) over all sub-sequences of each length, two fast-rotating handheld sequences (130 and 200 deg/s, mapping to (a) and (b) not stated) with D-GPS RTK ground truth; rows R2LIVE-LIO, R2LIVE-VIO and R2LIVE-LC (the latter undefined in the text) omitted here. Supersedes the median values in the arXiv v1 Fig. 11 caption. (Lin et al., 2021, Table I)
RRE (deg) over 50 m sub-sequences,R2LIVE Experiment-4 (authors' data, D-GPS RTK) · Experiment-4 (a), 50 m sub-sequences
只並列這張表在相同設定下報告的方法;以「本方法:」開頭者為本頁方法。失敗、未執行與未報告以標記呈現,不是 0。
按 Tab 進入圖表後,用上下方向鍵逐一瀏覽各類別,Esc 關閉提示框;也可開啟表格檢視閱讀全部數值。
這些是 Lin et al., 2021 在此表設定下報告的數值(author-reported results),只能在同一個比較組內對照,不代表方法在其他資料或設定下的表現。
資料來源作者報告值(Lin et al., 2021, Table I)
| 方法(原文寫法) | 報告值 | 出處 |
|---|---|---|
| VINS-Mono本方法 | 0.24 deg | (Lin et al., 2021, VoR Table I) |
| Fast-Lio | 0.34 deg | (Lin et al., 2021, VoR Table I) |
| Camvox | 0.67 deg | (Lin et al., 2021, VoR Table I) |
| R2LIVE原文提出 | 0.25 deg | (Lin et al., 2021, VoR Table I) |
Lin & Zhang, 2022 · Table III 本方法 24 筆
表格設定(擷取紀錄原文):Relative rotation error (RRE, deg) and relative translation error (RTE, %) over all sub-sequences of 50 to 300 m in two seaport sequences (Belcher Bay Promenade) with D-GPS RTK ground truth; R3LIVE-HiRes uses 1280x1024 images and 0.01 m map point spacing, R3LIVE-RT 320x256 images and 0.10 m; LVI-SAM run with a modified LiDAR front-end for the Livox Avia; identical values in arXiv v1 and the version of record (Lin & Zhang, 2022, Table III)
RRE (deg) over 50 m sub-sequences,R3LIVE Experiment-3 (authors' data, D-GPS RTK) · Experiment-3 (a), 50 m sub-sequences
只並列這張表在相同設定下報告的方法;以「本方法:」開頭者為本頁方法。失敗、未執行與未報告以標記呈現,不是 0。
按 Tab 進入圖表後,用上下方向鍵逐一瀏覽各類別,Esc 關閉提示框;也可開啟表格檢視閱讀全部數值。
這些是 Lin & Zhang, 2022 在此表設定下報告的數值(author-reported results),只能在同一個比較組內對照,不代表方法在其他資料或設定下的表現。
資料來源作者報告值(Lin & Zhang, 2022, Table III)
| 方法(原文寫法) | 報告值 | 出處 |
|---|---|---|
| R3LIVE-HiRes原文提出 | 0.99 deg | (Lin & Zhang, 2022, VoR Table III) |
| R3LIVE-RT原文提出 | 1.48 deg | (Lin & Zhang, 2022, VoR Table III) |
| LVI SAM | 2.11 deg | (Lin & Zhang, 2022, VoR Table III) |
| R2LIVE | 1.21 deg | (Lin & Zhang, 2022, VoR Table III) |
| FAST-LIO2 | 1.36 deg | (Lin & Zhang, 2022, VoR Table III) |
| VINS-Mono本方法 | 3.03 deg | (Lin & Zhang, 2022, VoR Table III) |
Rosinol et al., 2020 · Table II 本方法 22 筆
指標RMSE ATE [m]
表格設定(擷取紀錄原文):EuRoC ATE RMSE grouped as fixed-lag smoothing, full smoothing and PGO with loop closure; comparator values taken from Delmerico and Scaramuzza [77] (Sim(3) alignment per text) and VINS-Mono [24]; comparators use a monocular camera while Kimera uses stereo; Kimera aligned with SE(3); loop threshold alpha = 0.001 (Rosinol et al., 2020, Table II)
RMSE ATE [m],EuRoC MAV · MH_01
只並列這張表在相同設定下報告的方法;以「本方法:」開頭者為本頁方法。失敗、未執行與未報告以標記呈現,不是 0。
按 Tab 進入圖表後,用上下方向鍵逐一瀏覽各類別,Esc 關閉提示框;也可開啟表格檢視閱讀全部數值。
這些是 Rosinol et al., 2020 在此表設定下報告的數值(author-reported results),只能在同一個比較組內對照,不代表方法在其他資料或設定下的表現。
資料來源作者報告值(Rosinol et al., 2020, Table II)
| 方法(原文寫法) | 報告值 | 出處 |
|---|---|---|
| OKVIS | 0.16 m | (Rosinol et al., 2020, Table II) |
| MSCKF | 0.42 m | (Rosinol et al., 2020, Table II) |
| ROVIO | 0.21 m | (Rosinol et al., 2020, Table II) |
| VINS-Mono本方法 | 0.15 m | (Rosinol et al., 2020, Table II) |
| SVO-GTSAM (full smoothing) | 0.05 m | (Rosinol et al., 2020, Table II) |
| VINS-LC (loop closure)本方法 | 0.12 m | (Rosinol et al., 2020, Table II) |
其他比較組
列出其餘 23 個比較組
- Qin et al., 2018 · Table I
- Shan et al., 2021 · Table II
- Campos et al., 2021 · Table II
- Lang et al., 2023 · Table III
- Zhang & Scaramuzza, 2018 · Table III
- Zhao et al., 2021 · Table II
- Qin et al., 2018 · Table II
- Reijgwart et al., 2020 · Table I
- Zhu et al., 2021 · Table I
- Yan et al., 2026a · Table 1
- Asadi et al., 2020 · Table 5
- Chen et al., 2025a · Table 7
- Cao et al., 2022 · Table III
- Lang et al., 2023 · Table IV
- Ghadimzadeh Alamdari et al., 2025 · Text Sec.7.1.2
- Yan et al., 2026a · Table 2
- von Stumberg & Cremers, 2022 · Table I
- Ghadimzadeh Alamdari et al., 2025 · Table 2
- Cao et al., 2022 · Text Sec.VIII-B5
- Campos et al., 2021 · Table V
- Qin et al., 2018 · Text Sec. IX-A-2
- Qin et al., 2018 · Text Sec. IX-C-1
- Qin et al., 2018 · Text Sec. VI-E
來源
Qin et al., 2018
(2018)VINS-Mono: A Robust and Versatile Monocular Visual-Inertial State EstimatorIEEE Transactions on Robotics, 34(4):1004-1020
DOI 10.1109/tro.2018.2853729arXiv 1708.03852程式碼
同儕審查已出版已讀全文近十年
相關版本
- 預印本:VINS-Mono (arXiv) https://arxiv.org/abs/1708.03852
- 程式碼釋出:VINS-Mono https://github.com/HKUST-Aerial-Robotics/VINS-Mono
程式碼:https://github.com/HKUST-Aerial-Robotics/VINS-Mono(授權:GPLv3 (README licence section))。有公開程式碼不等於已被重現,也不代表目前版本與論文版本相同。