CSIRO underground mine CT-SLAM (Northparkes)
本文把 CSIRO 的連續時間非剛性配準(原始版本出自 Bosse & Zlot, 2009)擴展成完整的地下礦坑建圖流程:旋轉 SICK LMS 291 與 MEMS IMU 裝在皮卡車斗上,於澳洲 Northparkes 銅金礦以一般行車速度行駛 17.1 公里(含停車共 1 小時 53 分)。處理分三段:先以滑動視窗的非剛性配準(面元匹配加 IMU 約束,修正量以 B-spline 表示)產生開迴路軌跡;再以關鍵點投票的場所辨識找出回溯路段的迴圈,經穩健位姿圖最佳化粗對齊後,對整條軌跡做非剛性配準;最後把點雲配準到礦方既有的測量剖面,以定位到地理座標並修正殘餘漂移。作者報告總處理時間 53.9 分鐘,少於擷取時間一半;開迴路軌跡相對於「已配準到測量圖」的軌跡,前進方向偏差約 0.2%;配準後 95% 面元距測量面元 50 cm 內(RMS 25 cm)。須注意這些與測量圖的比較是在把點雲配準到同一份測量圖之後計算,不是獨立驗證。
本頁內容
Extends CSIRO continuous-time non-rigid registration into a full mine-mapping pipeline (sliding-window lidar-inertial registration, keypoint-voting place recognition, robust pose-graph optimization, whole-trajectory refinement and registration to a mine survey); 17.1 km mapped in 113 min at Northparkes and processed in 53.9 min, with about 0.2% forward drift bias and a 25 cm RMS survey residual that are computed against the survey-registered solution rather than an independent reference.
技術屬性
欄位內容為文獻擷取紀錄的原文用語(英文),以原文為據;「未查證」表示本研究尚未讀到該資訊,不代表該方法不具備此能力。
| 感測輸入 | rotating SICK LMS 291 2D laser, one revolution every 2 s, spin axis pitched 65 deg from horizontal (Sec. 3.1)、MicroStrain 3DM-GX2 industrial-grade MEMS IMU on the non-spinning part of the mount (Sec. 3.1)、two fixed vertical SICK LMS 291 lasers in a pushbroom configuration, used only for surface reconstruction, not for trajectory estimation (Sec. 3.1, 4.5) |
|---|---|
| 原文測試平台 | vehicle: steel-frame sensor cart strapped to the bed of a site utility vehicle (pickup), driven by a mine employee at 20-30 km/h under a 30 km/h limit (Sec. 3.1) |
| 狀態估計 | continuous-time non-rigid registration: baseline trajectory plus low-bandwidth corrections parameterized as uniform B-splines (first-order, 0.1 s knots, 4 s window with 2 s shift for the open-loop stage; cubic, 5 s knots for whole-trajectory registration); stacked linearized constraints (surfel match, fixed-surfel, IMU accelerometer and gyro deviation, reference-velocity deviation, smoothness, initial conditions) solved by iteratively reweighted least squares with Cauchy weights and sparse Cholesky factorization (Sec. 2.1, 4.1, 4.2) |
| 資料關聯 | surfels from first and second moments in a multi-resolution voxel grid (0.4, 0.8, 1.6, 3.2 m; max 0.5 s time span; at least 15 points and two scans); approximate k-nearest-neighbour search (four neighbours at least 0.5 s apart, modified libnabo) in a weighted position-normal space, with removal of distant and non-reciprocal matches (Sec. 2.1.3, 4.1) |
| 時間表示 | continuous-time: trajectory stored at about 100 Hz samples with spline interpolation; corrections as B-splines (piecewise linear at 0.1 s knots in the sliding window; cubic at 5 s knots globally) (Sec. 2.1.2, 4.1, 4.2) |
| 去畸變 | implicit in continuous-time non-rigid registration; surfel time spans capped (0.5 s in the open-loop stage) to limit uncorrected distortion (Sec. 4.1) |
| 迴圈閉合 | place recognition by keypoint voting: 40 cm downsampled cloud, 20% random keypoints (planar ones discarded), 3D gestalt descriptors over 4 m reduced from 66 to 10 dimensions, places of 3,500 keypoints, RANSAC geometric verification; no false positives on this data set; the mine has no topological loops, so closures come only from backtracking (Sec. 2.2, 4.2) |
| 全域最佳化 | robust pose-graph optimization (annealed Cauchy M-estimator; rotations solved before translations) for coarse alignment, then whole-trajectory non-rigid registration (cubic B-spline corrections at 5 s knots; surfels with up to 10 s span; five neighbours at least 10 s apart; IMU, smoothness and velocity-deviation constraints); finally registration to the mine survey: 2D gestalt place recognition with 200 m keypoints and 50 m places, pose graph with star-configured survey edges and annealed place-recognition weights, then non-rigid registration against 35,612 fixed surfels built from 17,942 survey points (Sec. 2.2.1, 4.2, 4.3) |
| 地圖表示 | surfels for registration; output 3D point cloud (87 million georeferenced points) and a triangulated surface mesh from the vertical lasers, decimated to one-eighth resolution for the user (Sec. 4.5, 6) |
| 先驗資訊 | no external positioning during acquisition; the final stage uses a pre-existing mine survey (sparse floor-level profile at about 1 m spacing, apparatus and date unknown to the authors) as fixed surfels for georeferencing and drift correction (Sec. 4.3) |
| 可輸出幾何 | 6-DoF trajectory (open-loop, closed-loop and survey-registered), georeferenced 3D point cloud and triangulated surface model (Sec. 4, 6) |
| 計算需求 | 53.9 min from raw data to the survey-registered model on a 2012 MacBook Pro (2.6 GHz Intel i7), MATLAB/MEX, against 113 min acquisition: open loop 34.8, loop-closure place recognition 4.0, global registration 9.0 (3.9 min surfels plus 5.1 min optimisation), survey place recognition 2.0, survey registration 4.1 min (Table I, Sec. 4.2); about 47.7 min (42% of acquisition) to the closed-loop solution; stationary periods (40% of the data) slow the open-loop stage; 5 Hz open-loop updates reported achievable in real time, with a C++ version under development (Sec. 4.1) |
使用設備
原文使用的感測器、運算硬體與載具(equipment)。型號保留原文寫法,連結到設備頁中同一型號的歸併名稱;角色依原文用途分為方法輸入、資料集感測器、執行運算平台、參考或真值量測(reference or ground truth)與比較對象設備。
| 類別 | 型號(原文寫法) | 角色 | 資料集 | 原文規格 | 出處 |
|---|---|---|---|---|---|
| LiDAR | SICK LMS 291 (rotating) | 方法輸入 | 未標示 | 2D laser on a spinning mount, one revolution every 2 s giving a hemispherical 3D view each second; spin axis pitched 65 deg from horizontal; custom driver; internal mirror and encoder wobble calibrated | (Zlot & Bosse, 2014, Sec. 3.1, 3.2, Fig. 1) |
| LiDAR | SICK LMS 291 (two fixed, vertical) | 方法輸入 | 未標示 | mounted back to back with vertical scan planes covering 360 deg (pushbroom); 160 mm blind spot; used only for surface reconstruction, not for trajectory estimation | (Zlot & Bosse, 2014, Sec. 3.1, 4.5, Fig. 2) |
| 慣性量測單元(IMU) | MicroStrain 3DM-GX2 | 方法輸入 | 未標示 | industrial-grade MEMS IMU fixed to the non-spinning part of the mount; raw rates used with own bias estimates; accelerometer biases not corrected | (Zlot & Bosse, 2014, Sec. 3.1, 4.1, 4.4) |
| 載具平台 | site utility vehicle (pickup truck) carrying a steel-frame sensor cart | 方法輸入 | 未標示 | cart strapped to the vehicle bed with batteries, electronics and a ROS logging laptop; driven by a mine employee at 20-30 km/h (limit 30 km/h) | (Zlot & Bosse, 2014, Sec. 3.1, Fig. 1, Fig. 3) |
| 運算硬體 | MacBook Pro (2012), 2.6 GHz Intel i7 | 執行運算平台 | 未標示 | MATLAB/MEX processing, not fully optimised | (Zlot & Bosse, 2014, Sec. 4.1, Table I) |
| 其他 | mine survey profile (apparatus not reported) | 參考或真值量測 | 未標示 | 17,942 points near floor level at about 1 m spacing, date and method unknown; converted to 35,612 surfels and used as fixed registration targets | (Zlot & Bosse, 2014, Sec. 4.3) |
作者報告的優勢與限制
優勢
- 17.1 km of decline and drive mapped in 1 h 53 min (including 45 min of stops) at 20-30 km/h without disrupting mine operations (Sec. 3.1, 6)
- Whole pipeline 53.9 min against 113 min acquisition; open-loop stage about 31% of acquisition time, about 20% while moving (Table I, Sec. 4.1)
- Place recognition found loop closures with no false positives on this data set; robust pose-graph optimization tolerated 46.2% artificially injected false positives and about 93% false positives in survey matching (Sec. 4.2-4.3, 5)
- Open-loop drift against the survey-registered trajectory: near-zero rotational bias with interquartile widths of a few hundredths of a degree; translational bias about 0.2% forward and 0.1% vertical (Sec. 4.4, Fig. 10)
- After registration to the mine survey, 95% of map surfels lie within 50 cm of the corresponding survey surfels, RMS 25 cm (Sec. 4.3, Fig. 11)
- Tight IMU constraints reduced the variance of rotational differences by an order of magnitude compared with the earlier FSR processing (Sec. 5)
- Surface model reported to be used by mine operators for planning a major equipment transport through the decline (Sec. 1, 6)
限制
- Survey residuals (95% within 50 cm, RMS 25 cm) and drift statistics are computed against the survey-registered solution, i.e., after the survey was used as fixed registration targets; the authors call this an evaluation 'to a limited degree' (Sec. 4.3-4.4)
- Survey quality uncertain: apparatus, method and date unknown; the mine changed after the survey; survey height above floor unknown and walls assumed planar and vertical (Sec. 4.3)
- No topological loops in the mine: drift along long branches cannot be reliably corrected, and small yaw errors produce large offsets at branch ends (Sec. 4.2, 4.4, 6)
- Residual accelerometer biases, which were not corrected, are named as the most likely source of the about 0.2% forward and 0.1% vertical open-loop drift biases; laser range bias or scale errors (range bias is not modelled in the calibration), mount calibration imperfections and survey errors are listed only as possible contributors that the authors believe to be small (Sec. 3.2, 4.4)
- The tilted spin axis produced asymmetric scan density that can bias trajectory estimates at speed (Sec. 5)
- Feature-poor tunnels (road tunnels, coal mines) may lose along-tunnel observability; authors suggest independent velocity sensing (Sec. 5)
- Two data gaps of about 25 s from a loose ethernet cable produced jumps in the open-loop trajectory that were repaired only in later stages (Sec. 4.1, Fig. 6)
- Vertical-laser timestamps suffered dropped frames from the SICK Toolbox driver (CPU load, USB buffering), leaving residual timing irregularities in the surface reconstruction (Sec. 5)
- Surface model has a 160 mm blind-spot gap between the two vertical lasers and long-triangle artefacts at occlusion boundaries; mist returns had to be filtered (Sec. 3.1, 4.5)
- Single mine site; MATLAB/MEX implementation not fully optimized (Table I caption)
營建工程相關證據
驗證場域為澳洲 Northparkes 銅金礦營運中的斜坡道與平巷(Sec. 3.1),屬地下工程與隧道類情境,不是營建工地。作業目的具工程任務性:礦方需以三維表面模型評估大型設備運入的淨空(Sec. 1、4.5),作者稱模型已被用於規劃,但未量測任務成果。與測量圖的比較是在點雲已配準到同一份測量圖之後計算,測量圖的量測方式與日期不明,且礦坑已有變動(Sec. 4.3),所以 RMS 25 cm 等數值只能視為配準殘差,不能當作獨立幾何精度。作者也指出壁面平滑的道路隧道或煤礦可能缺乏沿隧道方向的約束(Sec. 5),這是隧道施工應用的重要限制。
原文驗證環境:地下或隧道
報告的性能數據
以下是原文作者報告的性能數值(author-reported results),不是本研究重新量測的結果。每張圖只並列同一個比較組(comparison group,同一張表、同一組實驗設定)內的方法;不同比較組之間的數值不可直接比較,也不構成排名。
本方法共出現在 3 個比較組,合計 10 筆紀錄。
Zlot & Bosse, 2014 · Table I 本方法 6 筆
指標computation time (min)
資料集與序列Northparkes Mine deployment, April 2011 (self-collected) · single run, 17.1 km in 113 min
表格設定(擷取紀錄原文):Computation time per processing stage from raw data to the survey-registered model; acquisition time 113 min (Zlot & Bosse, 2014, Table I)
computation time (min),Northparkes Mine deployment, April 2011 (self-collected) · single run, 17.1 km in 113 min
只並列這張表在相同設定下報告的方法;以「本方法:」開頭者為本頁方法。失敗、未執行與未報告以標記呈現,不是 0。
按 Tab 進入圖表後,用上下方向鍵逐一瀏覽各類別,Esc 關閉提示框;也可開啟表格檢視閱讀全部數值。
這些是 Zlot & Bosse, 2014 在此表設定下報告的數值(author-reported results),只能在同一個比較組內對照,不代表方法在其他資料或設定下的表現。
資料來源作者報告值(Zlot & Bosse, 2014, Table I)
| 方法(原文寫法) | 報告值 | 出處 |
|---|---|---|
| Open-loop trajectory generation (non-rigid registration)本方法原文提出硬體:2012 MacBook Pro, 2.6 GHz Intel i7; MATLAB/MEX, not fully optimised | 34.8 min | (Zlot & Bosse, 2014, Table I) |
| Loop closure and coarse global alignment (place recognition)本方法原文提出硬體:2012 MacBook Pro, 2.6 GHz Intel i7; MATLAB/MEX, not fully optimised | 4 min | (Zlot & Bosse, 2014, Table I) |
| Global trajectory registration (non-rigid registration)本方法原文提出硬體:2012 MacBook Pro, 2.6 GHz Intel i7; MATLAB/MEX, not fully optimised | 9 min | (Zlot & Bosse, 2014, Table I) |
| Coarse alignment to mine survey data (place recognition)本方法原文提出硬體:2012 MacBook Pro, 2.6 GHz Intel i7; MATLAB/MEX, not fully optimised | 2 min | (Zlot & Bosse, 2014, Table I) |
| Global registration to mine survey data (non-rigid registration)本方法原文提出硬體:2012 MacBook Pro, 2.6 GHz Intel i7; MATLAB/MEX, not fully optimised | 4.1 min | (Zlot & Bosse, 2014, Table I) |
| Total pipeline本方法原文提出硬體:2012 MacBook Pro, 2.6 GHz Intel i7; MATLAB/MEX, not fully optimised | 53.9 min | (Zlot & Bosse, 2014, Table I) |
Zlot & Bosse, 2014 · Text Sec.4.3 本方法 2 筆
資料集與序列Northparkes Mine deployment, April 2011 (self-collected) · single run, 17.1 km in 113 min
表格設定(擷取紀錄原文):Map surfels against 35,612 surfels built from the mine survey after the point cloud was registered to that same survey (fixed surfels); a post-registration residual, not an independent accuracy check (Zlot & Bosse, 2014, Text Sec.4.3)
RMS of match error between map surfels and mine-survey surfels along the normal,Northparkes Mine deployment, April 2011 (self-collected) · single run, 17.1 km in 113 min
這張表在此指標與資料序列只列出本方法一筆,沒有可並列的其他方法,因此不畫圖,數值與出處見下表。這是 Zlot & Bosse, 2014 在此表設定下報告的數值(author-reported results),不代表方法在其他資料或設定下的表現。
| 方法(原文寫法) | 報告值 | 出處 |
|---|---|---|
| Survey-registered solution本方法原文提出 | 25 cm | (Zlot & Bosse, 2014, Sec. 4.3, Fig. 11) |
Zlot & Bosse, 2014 · Text Sec.4.4 本方法 2 筆
資料集與序列Northparkes Mine deployment, April 2011 (self-collected) · single run, 17.1 km in 113 min
表格設定(擷取紀錄原文):Open-loop drift from segment-wise comparison with the survey-registered trajectory (segments of 10-150 m aligned at the same start time); bias values stated in the text, not read from Fig. 10 (Zlot & Bosse, 2014, Text Sec.4.4)
open-loop translational drift bias, forward direction (share of distance travelled),Northparkes Mine deployment, April 2011 (self-collected) · single run, 17.1 km in 113 min
這張表在此指標與資料序列只列出本方法一筆,沒有可並列的其他方法,因此不畫圖,數值與出處見下表。這是 Zlot & Bosse, 2014 在此表設定下報告的數值(author-reported results),不代表方法在其他資料或設定下的表現。
| 方法(原文寫法) | 報告值 | 出處 |
|---|---|---|
| Open-loop trajectory (non-rigid registration with IMU)本方法原文提出 | 0.2% | (Zlot & Bosse, 2014, Sec. 4.4, Fig. 10) |
來源
Zlot & Bosse, 2014
(2014)Efficient Large‐scale Three‐dimensional Mobile Mapping for Underground MinesJournal of Field Robotics, 31(5): 758-779
同儕審查已出版已讀全文經典查證後修正
相關版本
- 會議版:Efficient Large-Scale 3D Mobile Mapping and Surface Reconstruction of an Underground Mine (Field and Service Robotics 2012, Matsushima; Springer Tracts in Advanced Robotics, pp. 479-493, online 2013-12-31). The journal paper states that it extends this publication on the same April 2011 Northparkes deployment, replacing manually extracted survey anchor points with automatic place recognition and adding robust pose-graph optimization, a laser calibration model and tight IMU constraints (JFR Sec. 1, 4.2, 5). LOAM ref. [3] cites this conference version. Conference text itself not read. 10.1007/978-3-642-40686-7_32