RGBDSLAMv2 builds 3-D maps from an RGB-D camera alone using keypoint matching with RANSAC, geodesic-neighbourhood and keyframe loop-closure candidates, a beam-based environment measurement model to reject wrong transforms, and g2o pose-graph optimisation with edge pruning, exporting point clouds or OctoMaps.

技術屬性

欄位內容為文獻擷取紀錄的原文用語(英文),以原文為據;「未查證」表示本研究尚未讀到該資訊,不代表該方法不具備此能力。

RGBDSLAMv2 的技術屬性
感測輸入RGB-D camera (structured light: Microsoft Kinect, Asus Xtion Pro Live)
原文測試平台TUM RGB-D fr1 and fr2 sequences (the paper does not state how the camera was carried in these sequences)
狀態估計pose-graph SLAM: pairwise 6-DOF transforms from 3-D feature correspondences via RANSAC with least-squares motion estimation, optional two-frame g2o refinement; global g2o optimisation (CSparse offline, PCG suggested online) with pruning of edges whose error remains high after convergence (Secs. III-B, III-E, IV-C)
資料關聯sparse visual keypoints (SIFT on GPU, SURF, ORB or Shi-Tomasi plus SURF) matched by nearest to second-nearest ratio (Euclidean, Hellinger or Hamming distance), RANSAC with Mahalanobis inlier test; transforms validated by a beam-based environment measurement model (EMM) on subsampled depth images (Secs. III-B, III-C, IV-D)
時間表示discrete frames; frame-to-frame transforms between RGB-D images
去畸變不適用
迴圈閉合candidate frames from n immediate predecessors, k frames sampled from the geodesic neighbourhood in the pose graph and l frames sampled from keyframes; validated by RANSAC and the EMM (Sec. III-D)
全域最佳化g2o pose-graph optimisation with Mahalanobis-based edge pruning (Secs. III-E, IV-C)
地圖表示globally registered point cloud (optionally surfels) or OctoMap 3-D occupancy grid; paper recommends OctoMap for memory and free-space representation (Sec. III-F)
先驗資訊none (no odometry or other sensors used, even where wheel odometry was available)
可輸出幾何optimised camera trajectory plus point cloud created by projecting the original depth measurements, or a textured OctoMap voxel occupancy map (2 cm maps of 4.2 to 25 MB versus 2 to 5 GB for unfiltered point clouds) (Sec. III-F)
計算需求Intel Core i7 3.40 GHz with nVidia GeForce GTX 570 (SIFT on GPU); offline processing of every frame at 5.04 to 15.2 Hz in Table I; median 13.0 Hz (9.1 to 16.4 Hz) on fr1 with SIFT (Fig. 8 caption); EMM 0.82 ms per bidirectional check (Sec. IV-D)

使用設備

原文使用的感測器、運算硬體與載具(equipment)。型號保留原文寫法,連結到設備頁中同一型號的歸併名稱;角色依原文用途分為方法輸入、資料集感測器、執行運算平台、參考或真值量測(reference or ground truth)與比較對象設備。

原文使用的設備
類別型號(原文寫法)角色資料集原文規格出處
RGB-D 相機Microsoft Kinect資料集感測器TUM RGB-D benchmarkstructured light; two Kinect units used in the benchmark(Endres et al., 2014, Sec. IV-A)
RGB-D 相機Asus Xtion Pro Live資料集感測器TUM RGB-D benchmarkstructured light(Endres et al., 2014, Sec. IV-A)
載具平台Pioneer 3資料集感測器TUM RGB-D Robot SLAM sequencesKinect mounted on the robot; wheel odometry available but not used(Endres et al., 2014, Sec. IV-A)
運算硬體Intel Core i7執行運算平台未標示3.40 GHz; used for all experiments(Endres et al., 2014, Secs. IV, IV-B)
運算硬體nVidia GeForce GTX 570執行運算平台未標示graphics card used for all experiments; SIFT computed on the GPU (SiftGPU)(Endres et al., 2014, Secs. IV, IV-B)
其他high-precision motion capturing system (model not reported)參考或真值量測TUM RGB-D benchmarksynchronised ground-truth sensor trajectory(Endres et al., 2014, Secs. II, IV-A)

作者報告的優勢與限制

優勢

限制

營建工程相關證據

論文未在營建工地測試;評估使用 TUM RGB-D 資料集(辦公室尺度場景與工業廠房內的 Pioneer 機器人序列)以及 MIT Stata Center 序列。系統可直接輸出配準後點雲或 OctoMap,且作者指出結構光感測器在日光下無法使用、重複結構易造成錯誤配對,這些限制對室內裝修或機電階段的 RGB-D 掃描有參考價值(推論)。

原文驗證環境:公開基準、獨立參考量測

報告的性能數據

性能數據仍在分批查證,目前尚未收錄此方法的報告值。

來源

  • Endres et al., 2014

    Felix Endres, Jürgen Hess, Jürgen Sturm, Daniel Cremers, Wolfram Burgard(2014)3-D Mapping With an RGB-D CameraIEEE Transactions on Robotics, 30(1):177-187

    同儕審查已出版已讀全文經典查證後修正

回到方法圖鑑

選擇開啟Esc關閉