影像信息驱动的三角网格模型优化方法

doi:10.11947/j.AGCS.2018.20170733

测绘学报 ›› 2018, Vol. 47 ›› Issue (7): 959-967.doi: 10.11947/j.AGCS.2018.20170733

影像信息驱动的三角网格模型优化方法

张春森¹, 张萌萌¹, 郭丙轩²

1. 西安科技大学测绘科学与技术学院, 陕西西安 710054;
2. 武汉大学测绘遥感信息工程国家重点实验室, 湖北武汉 430079

收稿日期:2017-12-21 修回日期:2018-03-22 出版日期:2018-07-20 发布日期:2018-07-25
通讯作者: 郭丙轩 E-mail:mobilemap@163.com
作者简介:张春森(1963-),男,博士,教授,研究方向为数字摄影测量与遥感应用。E-mail:zhchunsen@aliyun.com
基金资助:
国家自然科学基金重大研究计划重点支持项目（91638203）

Refinement of the 3D Mesh Model Driven by the Image Information

ZHANG Chunsen¹, ZHANG Mengmeng¹, GUO Bingxuan²

1. College of Geomatics, Xi'an University of Science and Technology, Xi'an 710054, China;
2. State Key Laboratory of Information Engineering in Surveying Mapping and Remote Sensing, Wuhan University, Wuhan 430079, China

Received:2017-12-21 Revised:2018-03-22 Online:2018-07-20 Published:2018-07-25
Supported by:
The Major Program of National Natural Science Foundation of China (No. 91638203)

摘要/Abstract

摘要： 提出一种基于影像信息驱动的三角网格优化方法，以解决现有利用三角网格实现三维重建出现的问题。根据影像信息，将影像利用物方三角面片重投影至其他可视影像上，利用梯度下降法，通过影像归一化互相关系数对物方顶点坐标进行求导，得到其梯度变化值。根据该变化值在法向量方向上调整物方三角网的顶点，使得区域的匹配代价最小，实现三角网格模型的优化，进而达到改善三维重建的目的。试验结果表明，本文方法可有效地提高物方三角网的结果精度，从而有效地改善重建三维模型的效果。

Abstract: A method of 3D mesh refinement driven by the image information is proposed to solve the existing problem of 3D re-construction constructed by the 3D mesh model.According to the image information, one image is reprojected to other visible images induced by the object triangular facet, adopt gradient descent method, take the derivative of object vertex coordinates with the images' NCC coefficient, and adjust the vertices coordinates of object 3D mesh in order to minimize regional matching cost, to obtain the optimal 3D mesh model, and to achieve the purposes of the 3D mesh model refinement.Results indicate that this method can greatly improve the accuracy of 3D mesh to reconstructing 3D model.

Key words: image information, normalized cross correlation, gradient descent method, gradient change value, 3D mesh refinement

中图分类号:

P232

张春森, 张萌萌, 郭丙轩. 影像信息驱动的三角网格模型优化方法[J]. 测绘学报, 2018, 47(7): 959-967.

ZHANG Chunsen, ZHANG Mengmeng, GUO Bingxuan. Refinement of the 3D Mesh Model Driven by the Image Information[J]. Acta Geodaetica et Cartographica Sinica, 2018, 47(7): 959-967.

参考文献

[1] 周忠谟. 三角网优化的数字研究[J]. 测绘学报, 1987, 16(3):161-167. ZHOU Zhongmo. Digital Research on 3D Mesh Optimization[J]. Acta Geodaetica et Cartographica Sinica, 1987, 16(3):161-167.
[2] 周忠谟. 三角网优化的数字研究[J]. 测绘通报, 1983(1):3-18. ZHOU Zhongmo. Digital Research on 3D Mesh Optimization[J]. Bulletin of Surveying and Mapping, 1983(1):3-18.
[3] 朱红, 宋东伟, 谭海, 等. Delaunay三角网优化下的小面元遥感影像配准算法[J]. 信号处理, 2016, 32(9):1032-1038. ZHU Hong, SONG Dongwei, TAN Hai, et al. A Tiny Facet Primitive Remote Sensing Image Registration Algorithm Based on Optimized Delaunay Triangulation[J]. Journal of Signal Processing, 2016, 32(9):1032-1038.
[4] 王群, 李爱平, 马淑梅. 狭长三角网格优化方法的研究及实现[J]. 组合机床与自动化加工技术, 2004(4):40-41. WANG Qun, LI Aiping, MA Shumei. Research and Implementing of Method for Optimization Algorithm for Long-narrow Triangular Mesh[J]. Modular Machine tool & Automatic Manufacturing Technique, 2004(4):40-41.
[5] 李伟, 金文标, 肖仙谦. 基于局部-全局方法的三角网格优化算法[J]. 计算机应用, 2011, 31(4):1013-1015, 1098. LI Wei, JIN Wenbiao, XIAO Xianqian. Local-global Algorithm for Triangular Mesh Optimization[J]. Journal of Computer Applications, 2011, 31(4):1013-1015, 1098.
[6] TURK G. Re-tiling Polygonal Surfaces[J]. ACM Siggraph Computer Graphics, 1992, 26(2):55-64.
[7] PARK J, SINHA S, MATSUSHITA Y, et al. Robust Multiview Photometric Stereo Using Planar Mesh Parameterization[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2017, 39(8):1591-1604.
[8] HAYAKAWA H. Photometric Stereo Under a Light Source with Arbitrary Motion[J]. Journal of the Optical Society of America, 1994, 11(11):3079-3089.
[9] YAN Lamei, YUAN Youwei, ZENG Xiaohong, et al. Refined Adaptive Meshes from Scattered Point Clouds[C]//Proceedings of the 12th International Symposium on Distributed Computing and Applications To Business, Engineering and Science. Kingston upon Thames, Surrey, UK:IEEE, 2013:247-249.
[10] ESTEBAN C H. Stereo and Silhouette Fusion for 3D Object Modeling from Uncalibrated Images Under Circular Motion[EB/OL].(2004-05-21)[2017-03-14]. https://pastel.archives-ouvertes.fr/pastel-00000862/file/hernandez_thesis_150dpi.pdf.
[11] NADHIRA V, QIYAMAN D, AFIFAH N, et al. Adaptive Refine Mesh Method in 2-Dimensional Image Reconstruction of Continuous Wave-diffuse Optical Tomography using Model Based Iterative Reconstruction for Quality Control on Carrot[J]. International Journal of Tomography and Simulation, 2016, 29(1):63-71.
[12] CAREY G F, HUMPHREY D L. Finite Element Mesh Refinement Algorithm Using Element Residuals[C]//Proceedings of a Working Conference on Codes for Boundary-Value Problems in Ordinary Differential Equations. London, UK:Springer-Verlag, 1978:243-249.
[13] GOESELE M, SNAVELY N, CURLESS B, et al. Multi-view Stereo for Community Photo Collections[C]//Proceedings of IEEE 11th International Conference on Computer Vision. Rio de Janeiro, Brazil:IEEE, 2007:1-8.
[14] MOLNAR J, HUANG Rui, KATO Z. 3D Reconstruction of Planar Surface Patches:A Direct Solution[C]//Proceedings of Asian Conference on Computer Vision-ACCV 2014 Workshops. Singapore:Springer, 2014:286-300.
[15] PONS J P, BOISSONNAT J D. Delaunay Deformable Models:Topology-adaptive Meshes Based on the Restricted Delaunay Triangulation[C]//Proceedings of 2007 IEEE Conference on Computer Vision and Pattern Recognition. Minneapolis, USA:IEEE, 2007:1-8.
[16] AGANJ E, PONS J P, SEGONNE F. Spatio-temporal Shape from Silhouette Using Four-dimensional Delaunay Meshing[C]//Proceedings of IEEE 11th International Conference on Computer Vision. Rio de Janeiro, Brazil:IEEE:1-8.
[17] 罗键. 基于VCGLib库的曲面重构算法研究[D]. 上海:同济大学, 2014. LUO Jian. The Research of Surface Reconstruction Based on VCGLib[D]. Shanghai:Tongji University, 2014.
[18] GONG Wenyong, LIU Yongjin, TANG Kai, et al. 2-Manifold Surface Sampling and Quality Estimation of Reconstructed Meshes[C]//Proceedings of the 2011 Eighth International Symposium on Voronoi Diagrams in Science and Engineering. Washington, DC:IEEE, 2011:15-22.
[19] HIEP V H, KERIVEN R, LABATUT P, et al. Towards High-resolution Large-scale Multi-view Stereo[C]//Proceedings of IEEE Conference on Computer Vision and Pattern Recognition. Miami:IEEE, 2009:1430-1437.
[20] KURIYAMA S, KANEKO T. Discrete Parameterization for Deforming Arbitrary Meshes[C]//Proceedings of the 1999 Conference on Graphics Interface. Kingston, Ontario, Canada:Morgan Kaufmann Publishers Inc, 1999:132-139.
[21] WU Haijun, CHEN Zhiming. Uniform Convergence of Multigrid V-cycle on Adaptively Refined Finite Element Meshes for Second Order Elliptic Problems[J]. Science in China Series A:Mathematics, 2006, 49(10):1405-1429.
[22] SORKINE O. Laplacian Mesh Processing[EB/OL]. (2005-12-06)[2017-05-24]. https://www.cse.iitb.ac.in/~cs749/spr2016/lecs/18_laplace.pdf.
[23] DELAUNOY A, PRADOS E, GARGALLO P, et al. Minimizing the Multi-view Stereo Reprojection Error for Triangular Surface Meshes[C]//Proceedings of the 2008 British Machine Vision Conference. Leeds, United Kingdom:SEP, 2008:1-10.
[24] STRECHA C, FRANSENS R, VAN GOOL L. Wide-baseline Stereo from Multiple Views:A Probabilistic Account[C]//Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. Washington, DC:IEEE, 2004.
[25] FUHRMANN S, LANGGUTH F,GOESELE M. MVE:A Multi-view Reconstruction Environment[C]//Proceedings of the Eurographics Workshop on Graphics and Cultural Heritage. Switzerland:Eurographics Association, 2014:11-18.
[26] FURUKAWA, PONCE J. Accurate, Dense, and Robust Multi-view Stereopsis[C]//Proceedings of IEEE Conference on Computer Vision and Pattern Recognition. Minneapolis:IEEE, 2007.

影像信息驱动的三角网格模型优化方法

Refinement of the 3D Mesh Model Driven by the Image Information

PDF

可视化

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 3

编辑推荐

Metrics

本文评价

[1]	王亚超, 张继贤, 黄国满, 卢丽君, 丁昊. SAR立体影像匹配的视差图融合方法[J]. 测绘学报, 2016, 45(7): 818-824.
[2]	丁昊, 张继贤, 黄国满, 朱建军. 多基线机载合成孔径雷达影像匹配的SANCC法[J]. 测绘学报, 2015, 44(3): 274-281.
[3]	杨化超,张书毕,张秋昭. 基于SIFT的宽基线立体影像最小二乘匹配方法[J]. 测绘学报, 2010, 39(2): 0-145.