SR-LIVO
SR-LIVO 以掃描重組(sweep reconstruction)把光達點流重新切段,使每段掃描的結束時間對齊影像擷取時間,讓較可靠的 LIO 直接估計每張影像當下的位姿。視覺模組因此不再負責狀態估計,只最佳化相機內參、外參與時間偏移,並沿用 R3LIVE 的方式為地圖點上色。
本頁內容
Re-segments LiDAR sweeps to end at image timestamps so that LIO alone estimates camera poses, reducing the vision module to camera-parameter refinement and point coloring.
技術屬性
欄位內容為文獻擷取紀錄的原文用語(英文),以原文為據;「未查證」表示本研究尚未讀到該資訊,不代表該方法不具備此能力。
| 感測輸入 | 3D LiDAR (16-channel OS1 gen1 on NTU-VIRAL; LiDAR written 'LiVOX AVAI' on the R3Live data)、IMU (internal IMU of each LiDAR; LiDAR-IMU extrinsics treated as exact, camera-IMU extrinsics optimized online)、camera (left grayscale camera on NTU-VIRAL; camera of the R3Live handheld rig) |
|---|---|
| 原文測試平台 | UAV、handheld |
| 狀態估計 | ESIKF in the LIO module for all state estimation; separate ESIKF in the vision module optimizing camera intrinsics, extrinsics and time offset only |
| 資料關聯 | LIO registration is identical to the authors' SR-LIO and is not re-described (Sec. IV); the vision module tracks map points with Lucas-Kanade optical flow and updates only camera parameters, first by PnP reprojection error and then by photometric error, and renders map-point colors with the R3LIVE rendering function (Sec. V-B) |
| 時間表示 | discrete poses; LiDAR sweeps re-segmented so that sweep end times align with image timestamps |
| 去畸變 | LiDAR points motion-compensated with the IMU-integrated pose; camera images undistorted with offline-calibrated distortion parameters (Sec. III-B) |
| 迴圈閉合 | none; listed as future work (Sec. VII) |
| 全域最佳化 | none |
| 地圖表示 | hash voxel map (as in CT-ICP) with RGB-colored points |
| 先驗資訊 | none |
| 可輸出幾何 | dense RGB-colored point cloud map (grayscale on NTU-VIRAL) (Sec. VI-E) |
| 計算需求 | Intel Core i7-11700 with 32 GB RAM; 30 to 34 ms per sweep on R3Live sequences and 14 to 17 ms on NTU-VIRAL, versus 49 to 58 ms for R3Live on R3Live sequences, about 1.6 times faster (Sec. VI-D, Table VI); stable real-time on r3live_01 where R3Live was not (Sec. VI-E, Fig. 4) |
使用設備
原文使用的感測器、運算硬體與載具(equipment)。型號保留原文寫法,連結到設備頁中同一型號的歸併名稱;角色依原文用途分為方法輸入、資料集感測器、執行運算平台、參考或真值量測(reference or ground truth)與比較對象設備。
| 類別 | 型號(原文寫法) | 角色 | 資料集 | 原文規格 | 出處 |
|---|---|---|---|---|---|
| LiDAR | 16-channel OS1 gen1 | 資料集感測器 | NTU-VIRAL | horizontal 16-channel spinning LiDAR with internal IMU | (Yuan et al., 2024, Sec. VI) |
| LiDAR | LiVOX AVAI歸入:Livox Avia | 資料集感測器 | R3Live dataset | with internal IMU; model name as printed, the paper gives no other model designation | (Yuan et al., 2024, Sec. VI) |
| 慣性量測單元(IMU) | internal IMU of the OS1 LiDAR | 資料集感測器 | NTU-VIRAL | LiDAR-IMU extrinsics treated as exact | (Yuan et al., 2024, Sec. III-A, Sec. VI) |
| 慣性量測單元(IMU) | internal IMU of the Livox LiDAR | 資料集感測器 | R3Live dataset | 原文未報告 | (Yuan et al., 2024, Sec. VI) |
| 相機 | left camera | 資料集感測器 | NTU-VIRAL | grayscale images | (Yuan et al., 2024, Sec. VI, Sec. VI-F) |
| 相機 | camera | 資料集感測器 | R3Live dataset | RGB images used for colorization | (Yuan et al., 2024, Sec. VI) |
| 載具平台 | drone | 資料集感測器 | NTU-VIRAL | drone-collected dataset | (Yuan et al., 2024, Sec. VI) |
| 載具平台 | handheld device | 資料集感測器 | R3Live dataset | handheld device-collected dataset; no position ground truth | (Yuan et al., 2024, Sec. VI) |
| 運算硬體 | Intel Core i7-11700 | 執行運算平台 | 未標示 | consumer-level computer, 32 GB RAM | (Yuan et al., 2024, Sec. VI) |
| 其他 | high-accuracy laser tracking (instrument not named) | 參考或真值量測 | NTU-VIRAL | provides position ground truth | (Yuan et al., 2024, Sec. VI) |
作者報告的優勢與限制
優勢
- Lowest or tied-lowest RMSE ATE on 8 of 9 NTU-VIRAL sequences against R3Live and Fast-LIVO; Fast-LIVO is better on eee_02 (0.18 vs 0.23 m) (Table I)
- Higher PSNR and SSIM of the colorized map than R3Live on all 15 test sequences, e.g., eee_01 PSNR 18.92 vs 12.11 and SSIM 0.82 vs 0.37 (Table II)
- About 1.6 times faster than R3Live with comparable colored reconstruction on r3live_01 and a better grayscale map on eee_01 (Sec. VI-D to VI-F, Table VI, Figs. 4 to 6)
- Rendering with LIO poses at image times gives higher PSNR and SSIM than rendering with the authors' LiDAR-assisted VIO module on all sequences (Table IV)
限制
- Image rate must be down-sampled to at most twice the LiDAR rate, otherwise reconstructed sweeps become too sparse for LIO (Sec. V-A)
- No loop closure (Sec. VII)
- Premise holds only without LiDAR degeneration: R3Live sequences with LiDAR failure modes were deliberately excluded, and long sequences whose colored map exceeded 32 GB RAM were also excluded (Sec. VI)
- Trajectory accuracy is evaluated only on NTU-VIRAL because the R3Live sequences have no position ground truth (Sec. VI-A)
- The LIO-over-VIO claim is not uniform: Fast-LIVO's VIO output is more accurate than its LIO output on sbs_01 (0.42 vs 0.73 m) (Table III)
營建工程相關證據
原文未報告
原文驗證環境:公開基準
報告的性能數據
以下是原文作者報告的性能數值(author-reported results),不是本研究重新量測的結果。每張圖只並列同一個比較組(comparison group,同一張表、同一組實驗設定)內的方法;不同比較組之間的數值不可直接比較,也不構成排名。
本方法共出現在 4 個比較組,合計 72 筆紀錄。
Yuan et al., 2024 · Table II 本方法 30 筆
表格設定(擷取紀錄原文):Rendering quality of the colorized map projected onto each image, following NeRF-style evaluation; higher is better; 'x' = drifted halfway (Yuan et al., 2024, Table II)
PSNR of map colors versus projected image pixels (higher is better),R3Live dataset · r3live_01
只並列這張表在相同設定下報告的方法;以「本方法:」開頭者為本頁方法。失敗、未執行與未報告以標記呈現,不是 0。
按 Tab 進入圖表後,用上下方向鍵逐一瀏覽各類別,Esc 關閉提示框;也可開啟表格檢視閱讀全部數值。
這些是 Yuan et al., 2024 在此表設定下報告的數值(author-reported results),只能在同一個比較組內對照,不代表方法在其他資料或設定下的表現。
資料來源作者報告值(Yuan et al., 2024, Table II)
| 方法(原文寫法) | 報告值 | 出處 |
|---|---|---|
| R3Live | 16.76 | (Yuan et al., 2024, Table II) |
| Ours (SR-LIVO)本方法原文提出 | 18.02 | (Yuan et al., 2024, Table II) |
Yuan et al., 2024 · Table III 本方法 18 筆
指標RMSE of ATE
表格設定(擷取紀錄原文):RMSE of ATE of LIO output versus LiDAR-assisted VIO output within each framework on NTU-VIRAL; 'x' = drifted halfway (Yuan et al., 2024, Table III)
RMSE of ATE,NTU-VIRAL · eee_01
只並列這張表在相同設定下報告的方法;以「本方法:」開頭者為本頁方法。失敗、未執行與未報告以標記呈現,不是 0。
按 Tab 進入圖表後,用上下方向鍵逐一瀏覽各類別,Esc 關閉提示框;也可開啟表格檢視閱讀全部數值。
這些是 Yuan et al., 2024 在此表設定下報告的數值(author-reported results),只能在同一個比較組內對照,不代表方法在其他資料或設定下的表現。
資料來源作者報告值(Yuan et al., 2024, Table III)
| 方法(原文寫法) | 報告值 | 出處 |
|---|---|---|
| R3Live (LIO module) | 1.69 m | (Yuan et al., 2024, Table III) |
| R3Live(V) (LiDAR-assisted VIO module) | 1.71 m | (Yuan et al., 2024, Table III) |
| Fast-LIVO (LIO) | 0.28 m | (Yuan et al., 2024, Table III) |
| Fast-LIVO(V) (LiDAR-assisted VIO) | 0.3 m | (Yuan et al., 2024, Table III) |
| Ours (SR-LIVO LIO)本方法原文提出 | 0.21 m | (Yuan et al., 2024, Table III) |
| Ours(V) (authors' R3Live-like LiDAR-assisted VIO module, ablation)本方法 | 0.24 m | (Yuan et al., 2024, Table III) |
Yuan et al., 2024 · Table VI 本方法 15 筆
指標Time consumption per sweep, Total
表格設定(擷取紀錄原文):Total time for handling a sweep as printed in Table VI (per-module Vision and LiDAR columns not extracted); the R3Live totals do not equal the sum of its two module columns, while SR-LIVO totals do (Yuan et al., 2024, Table VI)
Time consumption per sweep, Total,R3Live dataset · r3live_01
只並列這張表在相同設定下報告的方法;以「本方法:」開頭者為本頁方法。失敗、未執行與未報告以標記呈現,不是 0。
按 Tab 進入圖表後,用上下方向鍵逐一瀏覽各類別,Esc 關閉提示框;也可開啟表格檢視閱讀全部數值。
這些是 Yuan et al., 2024 在此表設定下報告的數值(author-reported results),只能在同一個比較組內對照,不代表方法在其他資料或設定下的表現。
資料來源作者報告值(Yuan et al., 2024, Table VI)
| 方法(原文寫法) | 報告值 | 出處 |
|---|---|---|
| R3Live硬體:Intel Core i7-11700, 32 GB RAM | 50.57 ms | (Yuan et al., 2024, Table VI) |
| Ours (SR-LIVO)本方法原文提出硬體:Intel Core i7-11700, 32 GB RAM | 30.53 ms | (Yuan et al., 2024, Table VI) |
Yuan et al., 2024 · Table I 本方法 9 筆
指標RMSE of ATE
表格設定(擷取紀錄原文):RMSE of ATE on NTU-VIRAL; baselines rerun from the authors' source code; 'x' = system drifted halfway through the run (Yuan et al., 2024, Table I)
RMSE of ATE,NTU-VIRAL · eee_01
只並列這張表在相同設定下報告的方法;以「本方法:」開頭者為本頁方法。失敗、未執行與未報告以標記呈現,不是 0。
按 Tab 進入圖表後,用上下方向鍵逐一瀏覽各類別,Esc 關閉提示框;也可開啟表格檢視閱讀全部數值。
這些是 Yuan et al., 2024 在此表設定下報告的數值(author-reported results),只能在同一個比較組內對照,不代表方法在其他資料或設定下的表現。
資料來源作者報告值(Yuan et al., 2024, Table I)
| 方法(原文寫法) | 報告值 | 出處 |
|---|---|---|
| R3Live | 1.69 m | (Yuan et al., 2024, Table I) |
| Fast-LIVO | 0.28 m | (Yuan et al., 2024, Table I) |
| Ours (SR-LIVO)本方法原文提出 | 0.21 m | (Yuan et al., 2024, Table I) |
來源
Yuan et al., 2024
(2024)SR-LIVO: LiDAR-Inertial-Visual Odometry and Mapping With Sweep ReconstructionIEEE Robotics and Automation Letters, 9(6): 5110-5117
DOI 10.1109/lra.2024.3389415arXiv 2312.16800程式碼
同儕審查已出版已讀全文近十年
相關版本
- 預印本:SR-LIVO arXiv (2023-12-28) https://arxiv.org/abs/2312.16800
- 程式碼釋出:ZikangYuan/sr_livo https://github.com/ZikangYuan/sr_livo
程式碼:https://github.com/ZikangYuan/sr_livo(授權:GPL-2.0 (LICENSE file checked))。有公開程式碼不等於已被重現,也不代表目前版本與論文版本相同。