Progress, Challenges and Perspectives of 3D LiDAR Point Cloud Processing

doi:10.11947/j.AGCS.2017.20170351

Abstract

Abstract: 3D LiDAR can perform an intensive sampling of the earth surface in a direct way, and yield the 3D point cloud that contains numerous and scattered points with the coordinates (X, Y, Z) and attributes (e.g., intensity). As the vital 3D geospatial data for description of the world in the digital era, 3D point cloud plays an important role not only in earth science researches but also in national requirements (e.g., global change analysis, global mapping, and smart city). Inspired by sensor technologies and national requirements, 3D LiDAR has got great progresses in hardware, data processing and applications, and is facing new challenges. Following the history of 3D LiDAR, this paper first reviews the status of 3D LiDAR system, and introduces the development of key technologies in data processing. Then the typical applications of 3D LiDAR in surveying and other related fields are listed, and current challenges in point cloud processing are concluded. Finally, some future perspectives are presented.

Key words: 3D LiDAR, point cloud, point cloud fusion, object extraction, 3D representation, ubiquitous point cloud

CLC Number:

P237

YANG Bisheng, LIANG Fuxun, HUANG Ronggang. Progress, Challenges and Perspectives of 3D LiDAR Point Cloud Processing[J]. Acta Geodaetica et Cartographica Sinica, 2017, 46(10): 1509-1516.

References

[1] 隋立春, 张宝印. Lidar遥感基本原理及其发展[J]. 测绘科学技术学报, 2006, 23(2):127-129. SUI Lichun, ZHANG Baoyin. Principle and Trend of Airborne Laser Scanning Remote Sensing[J]. Journal of Zhengzhou Institute of Surveying and Mapping, 2006, 23(2):127-129.
[2] VOSSELMAN G, MAAS H G. Airborne and Terrestrial Laser Scanning[M]. Boca Raton, FL:CRC Press, 2010.
[3] HU Han, DING Yulin, ZHU Qing, et al. An Adaptive Surface Filter for Airborne Laser Scanning Point Clouds by Means of Regularization and Bending Energy[J]. ISPRS Journal of Photogrammetry and Remote Sensing, 2014(92):98-111.
[4] YANG Bisheng, HUANG Ronggang, DONG Zhen, et al. Two-Step Adaptive Extraction Method for Ground Points and Breaklines from Lidar Point Clouds[J]. ISPRS Journal of Photogrammetry and Remote Sensing, 2016(119):373-389.
[5] PERERA G S N, MAAS H G. Cycle Graph Analysis for 3D Roof Structure Modelling:Concepts and Performance[J]. ISPRS Journal of Photogrammetry and Remote Sensing, 2014(93):213-226.
[6] XIONG B, JANCOSEK M, ELBERINK S O, et al. Flexible Building Primitives for 3D Building Modeling[J]. ISPRS Journal of Photogrammetry and Remote Sensing, 2015(101):275-290.
[7] YANG Bisheng, DAI Wenxia, DONG Zhen, et al. Automatic Forest Mapping at Individual Tree Levels from Terrestrial Laser Scanning Point Clouds with A Hierarchical Minimum Cut Method[J]. Remote Sensing, 2016, 8(5):372.
[8] 李德仁, 王密, 沈欣, 等. 从对地观测卫星到对地观测脑[J]. 武汉大学学报(信息科学版), 2017, 42(2):143-149. LI Deren, WANG Mi, SHEN Xin, et al. From Earth Observation Satellite to Earth Observation Brain[J]. Geomatics and Information Science of Wuhan University, 2017, 42(2):143-149.
[9] 唐新明, 李国元, 高小明, 等. 卫星激光测高严密几何模型构建及精度初步验证[J]. 测绘学报, 2016, 45(10):1182-1191. DOI:10.11947/j.AGCS.2016.20150357. TANG Xinming, LI Guoyuan, GAO Xiaoming, et al. The Rigorous Geometric Model of Satellite Laser Altimeter and Preliminarily Accuracy Validation[J]. Acta Geodaetica et Cartographica Sinica, 2016, 45(10):1182-1191. DOI:10.11947/j.AGCS.2016.20150357.
[10] YAN W Y, SHAKER A, EL-ASHMAWY N. Urban Land Cover Classification Using Airborne LiDAR Data:A Review[J]. Remote Sensing of Environment, 2015(158):295-310.
[11] BALTSAVIAS E P. Airborne Laser Scanning:Basic Relations and Formulas[J]. ISPRS Journal of Photogrammetry and Remote Sensing, 1999, 54(2-3):199-214.
[12] CHAUVE A, VEGA C, DURRIEU S, et al. Advanced Full-Waveform Lidar Data Echo Detection:Assessing Quality of Derived Terrain and Tree Height Models in An Alpine Coniferous Forest[J]. International Journal of Remote Sensing, 2009, 30(19):5211-5228.
[13] WANG Chisheng, LI Qingquan, LIU Yanxiong, et al. A Comparison of Waveform Processing Algorithms for Single-Wavelength LiDAR Bathymetry[J]. ISPRS Journal of Photogrammetry and Remote Sensing, 2015(101):22-35.
[14] YANG Bisheng, WANG Jinling. Mobile Mapping with Ubiquitous Point Clouds[J]. Geo-Spatial Information Science, 2016, 19(3):169-170.
[15] 谭凯, 程效军, 张吉星. TLS强度数据的入射角及距离效应改正方法[J]. 武汉大学学报(信息科学版), 2017, 42(2):223-228. TAN Kai, CHENG Xiaojun, ZHANG Jixing. Correction for Incidence Angle and Distance Effects on TLS Intensity Data[J]. Geomatics and Information Science of Wuhan University, 2017, 42(2):223-228.
[16] YANG Bisheng, ZANG Yufu, DONG Zhen, et al. An Automated Method to Register Airborne and Terrestrial Laser Scanning Point Clouds[J]. ISPRS Journal of Photogrammetry and Remote Sensing, 2015(109):62-76.
[17] YANG Bisheng, DONG Zhen, DAI Wenxia, et al. Automatic Registration of Multi-View Terrestrial Laser Scanning Point Clouds in Complex Urban Environments[C]//Proceedings of the 2nd IEEE International Conference on Spatial Data Mining and Geographical Knowledge Services. Fuzhou, China:IEEE, 2015:141-146.
[18] 陈良良, 隋立春, 蒋涛, 等. 地面三维激光扫描数据配准方法[J]. 测绘通报, 2014(5):80-82. DOI:10.13474/j.cnki.11-2246.2014.0163. CHEN Liangliang, SUI Lichun, JIANG Tao, et al. The Methods of Data Registration in Terrestrial 3D Laser Scanning[J]. Bulletin of Surveying and Mapping, 2014(5):80-82. DOI:10.13474/j.cnki.11-2246.2014.0163.
[19] 陈驰, 杨必胜, 彭向阳. 低空UAV激光点云和序列影像的自动配准方法[J]. 测绘学报, 2015, 44(5):518-525. DOI:10.11947/j.AGCS.2015.20130558. CHEN Chi, YANG Bisheng, PENG Xiangyang. Automatic Registration of Low Altitude UAV Sequent Images and Laser Point Clouds[J]. Acta Geodaetica et Cartographica Sinica, 2015, 44(5):518-525. DOI:10.11947/j.AGCS.2015.20130558.
[20] 张良, 马洪超, 高广, 等. 点、线相似不变性的城区航空影像与机载激光雷达点云自动配准[J]. 测绘学报, 2014, 43(4):372-379. DOI:10.13485/j.cnki.11-2089.2014.0056. ZHANG Liang, MA Hongchao, GAO Guang, et al. Automatic Registration of Urban Aerial Images with Airborne LiDAR Points Based on Line-point Similarity Invariants[J]. Acta Geodaetica et Cartographica Sinica, 2014, 43(4):372-379. DOI:10.13485/j.cnki.11-2089.2014.0056.
[21] YANG Bisheng, DONG Zhen, LIANG Fuxun, et al. Automatic Registration of Large-scale Urban Scene Point Clouds Based on Semantic Feature Points[J]. ISPRS Journal of Photogrammetry and Remote Sensing, 2016(113):43-58.
[22] YANG Bisheng, ZANG Yufu. Automated Registration of Dense Terrestrial Laser-scanning Point Clouds Using Curves[J]. ISPRS Journal of Photogrammetry and Remote Sensing, 2014(95):109-121.
[23] YANG Bisheng, HUANG Ronggang, LI Jianping, et al. Automated Reconstruction of Building LoDs from Airborne LiDAR Point Clouds Using an Improved Morphological Scale Space[J]. Remote Sensing, 2017, 9(1):14.
[24] FANG Lina, YANG Bisheng, CHEN Chongcheng, et al. Extraction 3D Road Boundaries from Mobile Laser Scanning Point Clouds[C]//Proceedings of the 2nd IEEE International Conference on Spatial Data Mining and Geographical Knowledge Services. Fuzhou, China:IEEE, 2015:162-165.
[25] YANG Bisheng, DONG Zhen, LIU Yuan, et al. Computing Multiple Aggregation Levels and Contextual Features for Road Facilities Recognition Using Mobile Laser Scanning Data[J]. ISPRS Journal of Photogrammetry and Remote Sensing, 2017(126):180-194.
[26] YANG Bisheng, XU Wenxue, YAO Wei. Extracting Buildings from Airborne Laser Scanning Point Clouds Using A Marked Point Process[J]. GIScience & Remote Sensing, 2014, 51(5):555-574.
[27] ZHANG Zhenxin, ZHANG Liqiang, TONG Xiaohua, et al. A Multilevel Point-cluster-based Discriminative Feature for ALS Point Cloud Classification[J]. IEEE Transactions on Geoscience and Remote Sensing, 2016, 54(6):3309-3321.
[28] LIU Chun, SHI Beiqi, YANG Xuan, et al. Automatic Buildings Extraction From LiDAR Data in Urban Area by Neural Oscillator Network of Visual Cortex[J]. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 2013, 6(4):2008-2019.
[29] 隋立春, 张熠斌, 张硕, 等. 基于渐进三角网的机载LiDAR点云数据滤波[J]. 武汉大学学报(信息科学版), 2011, 36(10):1159-1163. SUI Lichun, ZHANG Yibin, ZHANG Shuo, et al. Filtering of Airborne LiDAR Point Cloud Data Based on Progressive TIN[J]. Geomatics and Information Science of Wuhan University, 2011, 36(10):1159-1163.
[30] YANG Bisheng, DONG Zhen, ZHAO Gang, et al. Hierarchical Extraction of Urban Objects from Mobile Laser Scanning Data[J]. ISPRS Journal of Photogrammetry and Remote Sensing, 2015(99):45-57.
[31] YANG Bisheng, DONG Zhen. A Shape-based Segmentation Method for Mobile Laser Scanning Point Clouds[J]. ISPRS Journal of Photogrammetry and Remote Sensing, 2013(81):19-30.
[32] YU Yongtao, LI J, GUAN Haiyan, et al. Automated Extraction of Urban Road Facilities Using Mobile Laser Scanning Data[J]. IEEE Transactions on Intelligent Transportation Systems, 2015, 16(4):2167-2181.
[33] LI Zhuqiang, ZHANG Liqiang, TONG Xiaohua, et al. A Three-Step Approach for TLS Point Cloud Classification[J]. IEEE Transactions on Geoscience and Remote Sensing, 2016, 54(9):5412-5424.
[34] GU Yanfeng, WANG Qingwang, XIE Bingqian. Multiple Kernel Sparse Representation for Airborne LiDAR Data Classification[J]. IEEE Transactions on Geoscience and Remote Sensing, 2017, 52(2):1085-1105.
[35] GUO Bo, HUANG Xianfeng, ZHANG Fan, et al. Classification of Airborne Laser Scanning Data Using Jointboost[J]. ISPRS Journal of Photogrammetry and Remote Sensing, 2015(100):71-83.
[36] LECUN Y, BENGIO Y, HINTON G. Deep Learning[J]. Nature, 2015, 521(7553):436-444.
[37] ELBERINK S O, VOSSELMAN G. Building Reconstruction by Target Based Graph Matching on Incomplete Laser Data:Analysis and Limitations[J]. Sensors, 2009, 9(8):6101-6118.
[38] BILJECKI F, LEDOUX H, STOTER J, et al. Formalisation of the Level of Detail in 3D City Modelling[J]. Computers, Environment and Urban Systems, 2014(48):1-15.
[39] BILJECKI F, LEDOUX H, STOTER J. An Improved LOD Specification for 3D Building Models[J]. Computers, Environment and Urban Systems, 2016(59):25-37.
[40] VERDIE Y, LAFARGE F, ALLIEZ P. LOD Generation for Urban Scenes[J]. ACM Transactions on Graphics, 2015, 34(3):30.
[41] SJOGREN W L, WOLLENHAUPT W R. Lunar Shape Via the Apollo Laser Altimeter[J]. Science, 1973, 179(4070):275-278.
[42] BOLCH T, SRENSEN L S, SIMONSEN S B, et al. Mass Loss of Greenland's Glaciers and Ice Caps 2003-2008 Revealed from ICESat Laser Altimetry Data[J]. Geophysical Research Letters, 2013, 40(5):875-881.
[43] RADIC' V, HOCK R. Glaciers in the Earth's Hydrological Cycle:Assessments of Glacier Mass and Runoff Changes on Global and Regional Scales[J]. Surveys in Geophysics, 2014, 35(3):813-837.
[44] JEBUR M N, PRADHAN B, TEHRANY M S. Optimization of Landslide Conditioning Factors Using Very High-Resolution Airborne Laser Scanning (LiDAR) Data at Catchment Scale[J]. Remote Sensing of Environment, 2014(152):150-165.
[45] TOMÁS R, LI Zhenhong. Earth Observations for Geohazards:Present and Future Challenges[J]. Remote Sensing, 2017, 9(3):194.
[46] JOHNSTONE E, RAYMOND J, OLSEN M J, et al. Morphological Expressions of Coastal Cliff Erosion Processes in San Diego County[J]. Journal of Coastal Research, 2016(76):174-184.
[47] PAINE J G, CAUDLE T L, ANDREWS J R. Shoreline and Sand Storage Dynamics from Annual Airborne LIDAR Surveys, Texas Gulf Coast[J]. Journal of Coastal Research, 2017, 33(3):487-506.
[48] BROCK J C, PURKIS S J. The Emerging Role of Lidar Remote Sensing in Coastal Research and Resource Management[J]. Journal of Coastal Research, 2009(SI53):1-5.
[49] FERRAZ A, BRETAR F, JACQUEMOUD S, et al. 3-D Mapping of a Multi-layered Mediterranean Forest Using ALS Data[J]. Remote Sensing of Environment, 2012(121):210-223.
[50] FERRAZ A, MALLET C, CHEHATA N. Large-Scale Road Detection in Forested Mountainous Areas Using Airborne Topographic Lidar Data[J]. ISPRS Journal of Photogrammetry and Remote Sensing, 2016(112):23-36.
[51] NIE Sheng, WANG Cheng, DONG Pinliang, et al. Estimating Leaf Area Index of Maize Using Airborne Discrete-return LiDAR Data[J]. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 2016, 9(7):3259-3266.
[52] TANG Hao, DUBAYAH R, BROLLY M, et al. Large-scale Retrieval of Leaf Area Index and Vertical Foliage Profile from the Spaceborne Waveform Lidar (GLAS/ICESat)[J]. Remote Sensing of Environment, 2014(154):8-18.
[53] WANG Yuanyuan, LI Guicai, DING Jianhua, et al. A Combined GLAS and MODIS Estimation of the Global Distribution of Mean Forest Canopy Height[J]. Remote Sensing of Environment, 2016, 174:24-43.
[54] BILJECKI F, STOTER J, LEDOUX H, et al. Applications of 3D City Models:State of the Art Review[J]. ISPRS International Journal of Geo-Information, 2015, 4(4):2842-2889.
[55] YU Bailang, LIU Hongxing, WU Jianping, et al. Automated Derivation of Urban Building Density Information Using Airborne LiDAR Data and Object-Based Method[J]. Landscape and Urban Planning, 2010, 98(3-4):210-219.
[56] YANG Bisheng, LIU Yuan, LIANG Fuxun, et al. Using Mobile Laser Scanning Data for Features Extraction of High Accuracy Driving Maps[C]//The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences. Prague, Czech Republic:ISPRS, 2016:433-439.
[57] MATIKAINEN L, LEHTOMÄKI M, AHOKAS E, et al. Remote Sensing Methods for Power Line Corridor Surveys[J]. ISPRS Journal of Photogrammetry and Remote Sensing, 2016(119):10-31.
[58] 陈驰, 麦晓明, 宋爽, 等. 机载激光点云数据中电力线自动提取方法[J]. 武汉大学学报(信息科学版), 2015, 40(12):1600-1605. CHEN Chi, MAI Xiaoming, SONG Shuang, et al. Automatic Power Lines Extraction Method from Airborne LiDAR Point Cloud[J]. Geomatics and Information Science of Wuhan University, 2015, 40(12):1600-1605.
[59] RODRÍGUEZ-GONZÁLVEZ P, FERNÁNDEZ-PALACIOS B J, MUÑ OZ-NIETO Á L, et al. Mobile LiDAR System:New Possibilities for the Documentation and Dissemination of Large Cultural Heritage Sites[J]. Remote Sensing, 2017, 9(3):189.
[60] CHENG Liang, WANG Yajun, CHEN Yanming, et al. Using LiDAR for Digital Documentation of Ancient City Walls[J]. Journal of Cultural Heritage, 2016(17):188-193.