Refinement of the 3D Mesh Model Driven by the Image Information

doi:10.11947/j.AGCS.2018.20170733

Abstract

Abstract: A method of 3D mesh refinement driven by the image information is proposed to solve the existing problem of 3D re-construction constructed by the 3D mesh model.According to the image information, one image is reprojected to other visible images induced by the object triangular facet, adopt gradient descent method, take the derivative of object vertex coordinates with the images' NCC coefficient, and adjust the vertices coordinates of object 3D mesh in order to minimize regional matching cost, to obtain the optimal 3D mesh model, and to achieve the purposes of the 3D mesh model refinement.Results indicate that this method can greatly improve the accuracy of 3D mesh to reconstructing 3D model.

Key words: image information, normalized cross correlation, gradient descent method, gradient change value, 3D mesh refinement

CLC Number:

P232

ZHANG Chunsen, ZHANG Mengmeng, GUO Bingxuan. Refinement of the 3D Mesh Model Driven by the Image Information[J]. Acta Geodaetica et Cartographica Sinica, 2018, 47(7): 959-967.

References

[1] 周忠谟. 三角网优化的数字研究[J]. 测绘学报, 1987, 16(3):161-167. ZHOU Zhongmo. Digital Research on 3D Mesh Optimization[J]. Acta Geodaetica et Cartographica Sinica, 1987, 16(3):161-167.
[2] 周忠谟. 三角网优化的数字研究[J]. 测绘通报, 1983(1):3-18. ZHOU Zhongmo. Digital Research on 3D Mesh Optimization[J]. Bulletin of Surveying and Mapping, 1983(1):3-18.
[3] 朱红, 宋东伟, 谭海, 等. Delaunay三角网优化下的小面元遥感影像配准算法[J]. 信号处理, 2016, 32(9):1032-1038. ZHU Hong, SONG Dongwei, TAN Hai, et al. A Tiny Facet Primitive Remote Sensing Image Registration Algorithm Based on Optimized Delaunay Triangulation[J]. Journal of Signal Processing, 2016, 32(9):1032-1038.
[4] 王群, 李爱平, 马淑梅. 狭长三角网格优化方法的研究及实现[J]. 组合机床与自动化加工技术, 2004(4):40-41. WANG Qun, LI Aiping, MA Shumei. Research and Implementing of Method for Optimization Algorithm for Long-narrow Triangular Mesh[J]. Modular Machine tool & Automatic Manufacturing Technique, 2004(4):40-41.
[5] 李伟, 金文标, 肖仙谦. 基于局部-全局方法的三角网格优化算法[J]. 计算机应用, 2011, 31(4):1013-1015, 1098. LI Wei, JIN Wenbiao, XIAO Xianqian. Local-global Algorithm for Triangular Mesh Optimization[J]. Journal of Computer Applications, 2011, 31(4):1013-1015, 1098.
[6] TURK G. Re-tiling Polygonal Surfaces[J]. ACM Siggraph Computer Graphics, 1992, 26(2):55-64.
[7] PARK J, SINHA S, MATSUSHITA Y, et al. Robust Multiview Photometric Stereo Using Planar Mesh Parameterization[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2017, 39(8):1591-1604.
[8] HAYAKAWA H. Photometric Stereo Under a Light Source with Arbitrary Motion[J]. Journal of the Optical Society of America, 1994, 11(11):3079-3089.
[9] YAN Lamei, YUAN Youwei, ZENG Xiaohong, et al. Refined Adaptive Meshes from Scattered Point Clouds[C]//Proceedings of the 12th International Symposium on Distributed Computing and Applications To Business, Engineering and Science. Kingston upon Thames, Surrey, UK:IEEE, 2013:247-249.
[10] ESTEBAN C H. Stereo and Silhouette Fusion for 3D Object Modeling from Uncalibrated Images Under Circular Motion[EB/OL].(2004-05-21)[2017-03-14]. https://pastel.archives-ouvertes.fr/pastel-00000862/file/hernandez_thesis_150dpi.pdf.
[11] NADHIRA V, QIYAMAN D, AFIFAH N, et al. Adaptive Refine Mesh Method in 2-Dimensional Image Reconstruction of Continuous Wave-diffuse Optical Tomography using Model Based Iterative Reconstruction for Quality Control on Carrot[J]. International Journal of Tomography and Simulation, 2016, 29(1):63-71.
[12] CAREY G F, HUMPHREY D L. Finite Element Mesh Refinement Algorithm Using Element Residuals[C]//Proceedings of a Working Conference on Codes for Boundary-Value Problems in Ordinary Differential Equations. London, UK:Springer-Verlag, 1978:243-249.
[13] GOESELE M, SNAVELY N, CURLESS B, et al. Multi-view Stereo for Community Photo Collections[C]//Proceedings of IEEE 11th International Conference on Computer Vision. Rio de Janeiro, Brazil:IEEE, 2007:1-8.
[14] MOLNAR J, HUANG Rui, KATO Z. 3D Reconstruction of Planar Surface Patches:A Direct Solution[C]//Proceedings of Asian Conference on Computer Vision-ACCV 2014 Workshops. Singapore:Springer, 2014:286-300.
[15] PONS J P, BOISSONNAT J D. Delaunay Deformable Models:Topology-adaptive Meshes Based on the Restricted Delaunay Triangulation[C]//Proceedings of 2007 IEEE Conference on Computer Vision and Pattern Recognition. Minneapolis, USA:IEEE, 2007:1-8.
[16] AGANJ E, PONS J P, SEGONNE F. Spatio-temporal Shape from Silhouette Using Four-dimensional Delaunay Meshing[C]//Proceedings of IEEE 11th International Conference on Computer Vision. Rio de Janeiro, Brazil:IEEE:1-8.
[17] 罗键. 基于VCGLib库的曲面重构算法研究[D]. 上海:同济大学, 2014. LUO Jian. The Research of Surface Reconstruction Based on VCGLib[D]. Shanghai:Tongji University, 2014.
[18] GONG Wenyong, LIU Yongjin, TANG Kai, et al. 2-Manifold Surface Sampling and Quality Estimation of Reconstructed Meshes[C]//Proceedings of the 2011 Eighth International Symposium on Voronoi Diagrams in Science and Engineering. Washington, DC:IEEE, 2011:15-22.
[19] HIEP V H, KERIVEN R, LABATUT P, et al. Towards High-resolution Large-scale Multi-view Stereo[C]//Proceedings of IEEE Conference on Computer Vision and Pattern Recognition. Miami:IEEE, 2009:1430-1437.
[20] KURIYAMA S, KANEKO T. Discrete Parameterization for Deforming Arbitrary Meshes[C]//Proceedings of the 1999 Conference on Graphics Interface. Kingston, Ontario, Canada:Morgan Kaufmann Publishers Inc, 1999:132-139.
[21] WU Haijun, CHEN Zhiming. Uniform Convergence of Multigrid V-cycle on Adaptively Refined Finite Element Meshes for Second Order Elliptic Problems[J]. Science in China Series A:Mathematics, 2006, 49(10):1405-1429.
[22] SORKINE O. Laplacian Mesh Processing[EB/OL]. (2005-12-06)[2017-05-24]. https://www.cse.iitb.ac.in/~cs749/spr2016/lecs/18_laplace.pdf.
[23] DELAUNOY A, PRADOS E, GARGALLO P, et al. Minimizing the Multi-view Stereo Reprojection Error for Triangular Surface Meshes[C]//Proceedings of the 2008 British Machine Vision Conference. Leeds, United Kingdom:SEP, 2008:1-10.
[24] STRECHA C, FRANSENS R, VAN GOOL L. Wide-baseline Stereo from Multiple Views:A Probabilistic Account[C]//Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. Washington, DC:IEEE, 2004.
[25] FUHRMANN S, LANGGUTH F,GOESELE M. MVE:A Multi-view Reconstruction Environment[C]//Proceedings of the Eurographics Workshop on Graphics and Cultural Heritage. Switzerland:Eurographics Association, 2014:11-18.
[26] FURUKAWA, PONCE J. Accurate, Dense, and Robust Multi-view Stereopsis[C]//Proceedings of IEEE Conference on Computer Vision and Pattern Recognition. Minneapolis:IEEE, 2007.