Technical framework and preliminary practices of photogrammetric remote sensing intelligent processing of multi-source satellite images

doi:10.11947/j.AGCS.2021.20210079

Abstract

Abstract: The history and recent development of photogrammetry and remote sensing are reviewed and analyzed firstly. Then the novel concept of "photogrammetric remote sensing" is put forward to meet the needs of accurate and fast processing of multi-source remote sensing images in the new era of big data and intelligent surveying and mapping. The new photogrammetric remote sensing discipline is the deep integration of the frontier theories and technologies of photogrammetry and remote sensing, and concentrates on solving the theories and technologies about simultaneously determine the geometric positions, physical attributes, semantic information and temporal changes of interested scenes and objects. Its theoretical and fundamental basis are photogrammetry, remote sensing, artificial intelligence, big data processing, and high-performance computation, etc. It will break through the current isolated status and serial technical route that photogrammetry mainly focuses on geometric processing, while remote sensing mainly focuses on semantic information extraction and inversion. It forms an innovation of the closed-loop fusion of semantic extraction and geometric processing. A novel geometric-semantic integrated processing framework is formed through the deep fusion of geometric model and spectral radiative and reflective information. Based on the proposed concept of photogrammetric remote sensing, this paper discusses the main scientific problems and related research and application fields, and then attempts to build a new theoretical and technical framework of integrated intelligent photogrammetric remote sensing processing of multi-source satellite images. Closed-loop fusion of semantic information extraction and accurate geometric processing has significantly improved the level of accuracy, automation and intelligence. The correctness and effectiveness of the proposed theory and methods are preliminarily verified by several practical applications.

Key words: photogrammetric remote sensing, multi-source satellite images, integrated intelligent geometric-semantic processing, photogrammetry, remote sensing, artificial intelligence

CLC Number:

ZHANG Yongjun, WAN Yi, SHI Wenzhong, ZHANG Zuxun, LI Yansheng, JI Shunping, GUO Haoyu, LI Li. Technical framework and preliminary practices of photogrammetric remote sensing intelligent processing of multi-source satellite images[J]. Acta Geodaetica et Cartographica Sinica, 2021, 50(8): 1068-1083.

References

[1] 张永军, 张祖勋, 龚健雅. 天空地多源遥感数据的广义摄影测量学[J]. 测绘学报, 2021, 50(1):1-11. DOI:10.11947/j.AGCS.2021.20200245. ZHANG Yongjun, ZHANG Zuxun, GONG Jianya. Generalized photogrammetry of spaceborne, airborne and terrestrial multi-source remote sensing datasets[J]. Acta Geodaetica et Cartographica Sinica, 2021, 50(1):1-11.DOI:10.11947/j.AGCS.2021.20200245.
[2] 王之卓. 摄影测量原理[M]. 武汉:武汉大学出版社, 2007 WANG Zhizhuo. Principles of photogrammetry[M]. Wuhan:Wuhan University Press, 2007.
[3] LOWE D G. Distinctive image features from scale-invariant keypoints[J]. International Journal of Computer Vision, 2004, 60(2):91-110.
[4] KERSCHNER M. Seamline detection in colour orthoimage mosaicking by use of twin snakes[J]. ISPRS Journal of Photogrammetry and Remote Sensing, 2001, 56(1):53-64.
[5] 李德仁. 从测绘学到地球空间信息智能服务科学[J]. 测绘学报, 2017, 46(10):1207-1212. DOI:10.11947/j.AGCS.2021.20200245. LI Deren. From geomatics to geospatial intelligent service science[J]. Acta Geodaetica et Cartographica Sinica, 2017, 46(10):1207-1212. DOI:10.11947/j.AGCS.2021.20200245.
[6] 李德仁. 展望5G/6G时代的地球空间信息技术[J]. 测绘学报, 2019, 48(12):1475-1481. DOI:10.11947/j.AGCS.2019.20190437. LI Deren. Towards geospatial information technology in 5G/6G era[J]. Acta Geodaetica et Cartographica Sinica, 2019, 48(12):1475-1481. DOI:10.11947/j.AGCS.2019.20190437.
[7] 陈锐志, 王磊, 李德仁, 等. 导航与遥感技术融合综述[J]. 测绘学报, 2019, 48(12):1507-1522. DOI:10.11947/j.AGCS.2019.20190446. CHEN Ruizhi, WANG Lei, LI Deren, et al. A survey on the fusion of the navigation and the remote sensing techniques[J]. Acta Geodaetica et Cartographica Sinica, 2019, 48(12):1507-1522. DOI:10.11947/j.AGCS.2019.20190446.
[8] WANG Zhizhuo. A discussion about the terminology "Photogrammetry and Remote Sensing"[J]. ISPRS Journal of Photogrammetry and Remote Sensing, 1989, 44(3):169-174.
[9] 王之卓. 从测绘学到Geomatics[J]. 武汉测绘科技大学学报, 1998, 23(4):294-296. WANG Zhizhuo. From "surveying and mapping" to "geomatics"[J]. Journal of Wuhan Technical University of Surveying and Mapping (Wtusm), 1998, 23(4):294-296.
[10] WEISS M, JACOB F, DUVEILLER G. Remote sensing for agricultural applications:a meta-review[J]. Remote Sensing of Environment, 2020, 236:111402.
[11] WHITE J C, COOPS N C, WULDER M A, et al. Remote sensing technologies for enhancing forest inventories:a review[J]. Canadian Journal of Remote Sensing, 2016, 42(5):619-641.
[12] SHEFFIELD J, WOOD E F, PAN M, et al. Satellite remote sensing for water resources management:potential for supporting sustainable development in data-poor regions[J]. Water Resources Research, 2018, 54(12):9724-9758.
[13] 杨凯. 遥感——摄影测量的现代化发展[J]. 武汉测绘学院学报, 1985, 10(3):19-24. YANG Kai. Remote sensing-the modernized development of photogrammetry[J]. Journal of Wuhan Institute of Surveying and mapping, 1985, 10(3):19-24.
[14] 张祖勋, 陶鹏杰. 谈大数据时代的"云控制"摄影测量[J]. 测绘学报, 2017, 46(10):1238-1248. DOI:10.11947/j.AGCS.2017.20170337. ZHANG Zuxun, TAO Pengjie. An overview on "cloud control" photogrammetry in big data era[J]. Acta Geodaetica et Cartographica Sinica, 2017, 46(10):1238-1248. DOI:10.11947/j.AGCS.2017.20170337.
[15] WHITFIELD Diffie. Impact of big data and AI on security[C]//The international big data industry expo.Guiyang, Guizhou:[s.n.] 2019.
[16] ZHANG Yongjun, XIONG Xiaodong, WANG Mengqiu, et al. A fast aerial image matching method using airborne LiDAR point cloud and POS data[J]. Journal of Geodesy and Geoinformation Science, 2019, 2(1):26-36.
[17] 左宗成, 张文, 张东映. 融合可变形卷积与条件随机场的遥感影像语义分割方法[J]. 测绘学报, 2019, 48(6):718-726. DOI:10.11947/j.AGCS.2019.20170740. ZUO Zongcheng, ZHANG Wen, ZHANG Dongying. A remote sensing image semantic segmentation method by combining deformable convolution with conditional random fields[J]. Acta Geodaetica et Cartographica Sinica, 2019, 48(6):718-726. DOI:10.11947/j.AGCS.2019.20170740.
[18] ZHANG Yun. Smart photogrammetric and remote sensing image processing for very high resolution optical images-examples from the CRC-AGIP lab at UNB[J]. Journal of Geodesy and Geoinformation Science, 2019, 2(2):17-26.
[19] CHEN Liang-Chieh, ZHU Yukun, PAPANDREOU George, et al. DeepLabv3+:Encoder-decoder with atrous separable convolution[C]//Proceedings of the European Conference on Computer Vision (ECCV) 2018.Munich,Ge rmany:ECCV,2018:801-818.
[20] 张永军, 丁亚洲. 基于有理多项式系数的线阵卫星近似核线影像生成[J]. 武汉大学学报(信息科学版), 2009, 34(9):1068-1071. ZHANG Yongjun, DING Yazhou. Approximate epipolar image generation of linear array satellite stereos with rational polynomial coefficients[J]. Geomatics and Information Science of Wuhan University, 2009, 34(9):1068-1071.
[21] ZHANG Yanfeng, ZHANG Yongjun, MO Delin, et al. Direct digital surface model generation by semi-global vertical line locus matching[J]. Remote Sensing, 2017, 9(3):214.
[22] ZHANG Yongjun, WEN Fei, GAO Zhi, et al. A coarse-to-fine framework for cloud removal in remote sensing image sequence[J]. IEEE Transactions on Geoscience and Remote Sensing, 2019, 57(8):5963-5974.
[23] YU Lei, ZHANG Yongjun, SUN Mingwei, et al. An auto-adapting global-to-local color balancing method for optical imagery mosaic[J]. ISPRS Journal of Photogrammetry and Remote Sensing, 2017, 132:1-19.
[24] ZHANG Yongjun, LIU Xinyi, ZHANG Yi, et al. Automatic and unsupervised water body extraction based on spectral-spatial features using GF-1 satellite imagery[J]. IEEE Geoscience and Remote Sensing Letters, 2019, 16(6):927-931.
[25] JI Shunping, WEI Shiqing, LU Meng. A scale robust convolutional neural network for automatic building extraction from aerial and satellite imagery[J]. International Journal of Remote Sensing, 2019, 40(9):3308-3322.
[26] WEI Yao, ZHANG Kai, JI Shunping. Simultaneous road surface and centerline extraction from large-scale remote sensing images using CNN-based segmentation and tracing[J]. IEEE Transactions on Geoscience and Remote Sensing, 2020, 58(12):8919-8931.