Visual odometry provides high-rate, low-fidelity motion for registering scanning-LiDAR points, which LiDAR scan-matching odometry then refines.

技術屬性

欄位內容為文獻擷取紀錄的原文用語(英文),以原文為據;「未查證」表示本研究尚未讀到該資訊,不代表該方法不具備此能力。

V-LOAM 的技術屬性
感測輸入monocular camera (uEye monochrome at 60 Hz; wide-angle lens 76 deg or fisheye lens 185 deg horizontal FoV)、3D lidar built from a Hokuyo UTM-30LX 2D laser scanner rotated back-and-forth by a motor with encoder (1 s sweep)、KITTI configuration: single camera and Velodyne lidar、no IMU in the method or hardware
原文測試平台vehicle (KITTI odometry benchmark)、handheld (custom camera-lidar sensor carried by a person; about 0.7 m/s in Tests 1 and 2)
狀態估計two sequential stages: frame-to-frame visual odometry solved by Levenberg-Marquardt in a robust-fitting framework, using features with depth from the lidar depthmap, depth from triangulation, or no depth; lidar odometry once per sweep with sweep-to-sweep refinement (linear drift model) and then sweep-to-map registration; transforms from both stages integrated into poses at image rate (Secs. IV to VI)
資料關聯up to 300 Harris corners tracked by KLT over 5x6 image subregions; feature depth interpolated from the three nearest depthmap points found in a 2D KD-tree on angular coordinates; lidar edge and planar points selected by local curvature and matched to edge lines and planar patches with 3D KD-trees (sweep-to-sweep) or by eigenvalue analysis of local map clusters (sweep-to-map, ICP-style) (Secs. V to VII)
時間表示discrete frame-to-frame motion at the 60 Hz image rate; visual odometry drift modeled as linear (constant-velocity) motion within each 1 s sweep; lidar odometry at 1 Hz (Secs. I, IV, VI)
去畸變points registered with the visual odometry motion; residual distortion from visual drift removed by the linear-motion model in the sweep-to-sweep refinement (Sec. VI, Fig. 4)
迴圈閉合none; the authors intentionally omit loop closure to focus on odometry (Sec. I)
全域最佳化none
地圖表示incrementally built map point cloud: each distortion-free sweep is matched to the existing map cloud, with correspondences found by eigenvalue analysis of local point clusters, and then merged into it; edge and planar points of the previous sweep are kept in two 3D KD-trees for sweep-to-sweep matching (Sec. VI, Fig. 6)
先驗資訊none in the reported experiments; the authors state the method can be configured for localization only if a prior map is available (Sec. I)
可輸出幾何registered 3D point cloud maps (Figs. 9 to 14) and 6-DoF poses at the image frame rate; export format 原文未報告
計算需求real-time on a laptop with 2.5 GHz quad cores under Linux; about 2.5 cores in total, 2 for visual odometry and 0.5 for lidar odometry (Sec. VII)

使用設備

原文使用的感測器、運算硬體與載具(equipment)。型號保留原文寫法,連結到設備頁中同一型號的歸併名稱;角色依原文用途分為方法輸入、資料集感測器、執行運算平台、參考或真值量測(reference or ground truth)與比較對象設備。

原文使用的設備
類別型號(原文寫法)角色資料集原文規格出處
LiDARHokuyo UTM-30LX方法輸入未標示2D laser scanner, 180 deg FoV, 0.25 deg resolution, 40 lines/s; motor-actuated to form a 3D lidar(Zhang & Singh, 2015, Sec. VII, Fig. 8)
LiDARVelodyne lidar of the KITTI setup資料集感測器KITTI odometry benchmark原文未報告(Zhang & Singh, 2015, Sec. VII)
相機uEye monochrome camera方法輸入未標示60 Hz, 752 x 480 px, wide-angle lens with 76 deg horizontal FoV(Zhang & Singh, 2015, Sec. VII, Sec. VII-A, Fig. 8)
相機second camera mounted underneath the original uEye camera, with fisheye lens方法輸入未標示same configuration as the original camera except resolution 640 x 480 px; fisheye lens with 185 deg horizontal FoV; model not named separately(Zhang & Singh, 2015, Sec. VII-A)
相機single camera of the KITTI setup資料集感測器KITTI odometry benchmark原文未報告(Zhang & Singh, 2015, Sec. VII)
載具平台handheld custom camera-lidar sensor方法輸入未標示carried by a person walking at about 0.7 m/s in the accuracy tests(Zhang & Singh, 2015, Sec. VII-A)
運算硬體laptop with 2.5 GHz quad cores執行運算平台未標示Linux; method uses about 2.5 cores(Zhang & Singh, 2015, Sec. VII)
其他motor and encoder actuating the scanner方法輸入未標示rotates back-and-forth at 180 deg/s between -90 and 90 deg; encoder resolution 0.25 deg; one sweep lasts 1 s(Zhang & Singh, 2015, Sec. IV, Sec. VII, Fig. 8)

作者報告的優勢與限制

優勢

限制

營建工程相關證據

未在施工工地測試。自建資料為手持感測器在建物室內、穿越建物的室內外路徑(538 m)、含七個 180 度轉彎的樓梯間與走廊的測試,另有關燈造成光照劇變的室內測試(Sec. VII);並以 KITTI 車載資料驗證。精度以迴圈缺口、人工對應點或起終點差估算,沒有獨立參考量測。與營建的關聯僅在於樓梯間與走廊等既有建物情境。

原文驗證環境:公開基準、已完工建築

報告的性能數據

以下是原文作者報告的性能數值(author-reported results),不是本研究重新量測的結果。每張圖只並列同一個比較組(comparison group,同一張表、同一組實驗設定)內的方法;不同比較組之間的數值不可直接比較,也不構成排名。

本方法共出現在 6 個比較組,合計 28 筆紀錄。以下列出本方法紀錄最多的 4 組,其餘 2 組列在最後,並連到性能比較頁。

Zhang & Singh, 2015 · Table I 本方法 16 筆

指標Relative position error

表格設定(擷取紀錄原文):Relative position error as a fraction of distance travelled, based on 3D coordinates; no independent reference instrument (Zhang & Singh, 2015, Table I)

Relative position error,authors' custom camera-lidar sensor data · Test 1 (Loop 1), 49 m

只並列這張表在相同設定下報告的方法;以「本方法:」開頭者為本頁方法。失敗、未執行與未報告以標記呈現,不是 0。

按 Tab 進入圖表後,用上下方向鍵逐一瀏覽各類別,Esc 關閉提示框;也可開啟表格檢視閱讀全部數值。

這些是 Zhang & Singh, 2015 在此表設定下報告的數值(author-reported results),只能在同一個比較組內對照,不代表方法在其他資料或設定下的表現。

統計量:原文未報告;對齊方式:未對齊;單位:% of distance travelled;場景:indoor, handheld at 0.7 m/s; error from gap at loop closure

資料來源作者報告值(Zhang & Singh, 2015, Table I)

數值與出處
方法(原文寫法)報告值出處
W-V (wide-angle camera, visual odometry only)本方法1.1(Zhang & Singh, 2015, Table I, Sec. VII-A)
F-V (fisheye camera, visual odometry only)本方法1.8(Zhang & Singh, 2015, Table I, Sec. VII-A)
W-VL (wide-angle camera, V-LOAM visual plus lidar odometry)本方法原文提出0.31(Zhang & Singh, 2015, Table I, Sec. VII-A)
F-VL (fisheye camera, V-LOAM visual plus lidar odometry)本方法原文提出0.31(Zhang & Singh, 2015, Table I, Sec. VII-A)

Zhang & Singh, 2015 · Table II 本方法 8 筆

指標Relative position error

表格設定(擷取紀錄原文):Relative position errors in fast motion tests; 'Failed' = visual features lost tracking during fast turns (Zhang & Singh, 2015, Table II)

Relative position error,authors' custom camera-lidar sensor data · Test 4, 66 m

只並列這張表在相同設定下報告的方法;以「本方法:」開頭者為本頁方法。失敗、未執行與未報告以標記呈現,不是 0。

  • 失敗

按 Tab 進入圖表後,用上下方向鍵逐一瀏覽各類別,Esc 關閉提示框;也可開啟表格檢視閱讀全部數值。

這些是 Zhang & Singh, 2015 在此表設定下報告的數值(author-reported results),只能在同一個比較組內對照,不代表方法在其他資料或設定下的表現。

統計量:原文未報告;對齊方式:未對齊;單位:% of distance travelled;場景:staircase with seven 180 deg turns; slow and fast trials; error from wall bending assuming flat aligned walls

資料來源作者報告值(Zhang & Singh, 2015, Table II)

數值與出處
方法(原文寫法)報告值出處
V-LOAM W-S (wide-angle camera, slow motion)本方法原文提出0.67(Zhang & Singh, 2015, Table II, Sec. VII-B)
V-LOAM Fi-S (fisheye camera, slow motion)本方法原文提出0.68(Zhang & Singh, 2015, Table II, Sec. VII-B)
V-LOAM W-Fa (wide-angle camera, fast motion)本方法原文提出無數值失敗註記(擷取紀錄):failed(Zhang & Singh, 2015, Table II, Sec. VII-B)
V-LOAM Fi-Fa (fisheye camera, fast motion)本方法原文提出1.3(Zhang & Singh, 2015, Table II, Sec. VII-B)

Yuan et al., 2023a · Table VI (KITTI part) 本方法 1 筆

指標Relative translational error (RTE)

資料集與序列KITTI odometry · 11-21 mean (KITTI test set)

表格設定(擷取紀錄原文):KITTI odometry; relative translational error (%) of visual-LiDAR odometry; '+' = open-source LiDAR odometry modified by the authors to use the SDV-LOAM visual module as motion prior; V-LOAM only has test-set results; '-' cells not stored (Yuan et al., 2023a, Table VI (KITTI part))

Relative translational error (RTE),KITTI odometry · 11-21 mean (KITTI test set)

只並列這張表在相同設定下報告的方法;以「本方法:」開頭者為本頁方法。失敗、未執行與未報告以標記呈現,不是 0。

按 Tab 進入圖表後,用上下方向鍵逐一瀏覽各類別,Esc 關閉提示框;也可開啟表格檢視閱讀全部數值。

這些是 Yuan et al., 2023a 在此表設定下報告的數值(author-reported results),只能在同一個比較組內對照,不代表方法在其他資料或設定下的表現。

統計量:平均值(mean);對齊方式:不適用;單位:%;場景:urban, highway and country driving

資料來源作者報告值(Yuan et al., 2023a, Table VI (KITTI part))

數值與出處
方法(原文寫法)報告值出處
V-LOAM本方法0.54%(Yuan et al., 2023a, Table VI; Sec. VII)
Ours (SDV-LOAM)原文提出0.6%(Yuan et al., 2023a, Table VI; Sec. VII)

Zhang & Singh, 2015 · Text Sec. VIII 本方法 1 筆

指標relative position drift (benchmark ranking by average translation and rotation errors)

資料集與序列KITTI odometry benchmark · benchmark average

表格設定(擷取紀錄原文):KITTI odometry benchmark result as stated by the authors (ranked first at the time); no per-sequence table in the paper (Zhang & Singh, 2015, Text Sec. VIII)

relative position drift (benchmark ranking by average translation and rotation errors),KITTI odometry benchmark · benchmark average

這張表在此指標與資料序列只列出本方法一筆,沒有可並列的其他方法,因此不畫圖,數值與出處見下表。這是 Zhang & Singh, 2015 在此表設定下報告的數值(author-reported results),不代表方法在其他資料或設定下的表現。

統計量:平均值(mean);對齊方式:原文未報告;單位:%;場景:vehicle-mounted single camera and Velodyne lidar

數值與出處
方法(原文寫法)報告值出處
V-LOAM本方法原文提出0.75%(Zhang & Singh, 2015, Abstract, Sec. VIII)

其他比較組

列出其餘 2 個比較組

來源

  • Zhang & Singh, 2015

    Ji Zhang, Sanjiv Singh(2015)Visual-lidar odometry and mapping: low-drift, robust, and fast2015 IEEE International Conference on Robotics and Automation (ICRA), pp. 2174-2181

    同儕審查已出版已讀全文經典查證後修正

回到方法圖鑑

選擇開啟Esc關閉