Automatizácia segmentácie základných geometrických primitív z mračien bodov
Ing. Richard Honti, PhD.
richard.honti@stuba.sk
doc. Ing. Ján Erdélyi, PhD.
jan.erdelyi@stuba.sk
prof. Ing. Alojz Kopáčik, PhD.
alojz.kopacik@stuba.sk
Stavebná fakulta
Slovenská technická univerzita v Bratislave
Abstract:
This book primarily explores the segmentation of fundamental geometric shapes from point clouds. It delves into the development of algorithms for filtering point clouds, utilizing local density and the variation of normal vectors within a specified neighborhood. These filtering algorithms are integrated into the segmentation processes but can also function independently. Additionally, the book proposes algorithms for segmenting planes, cylinders, and spheres, which are the most common geometric features in civil engineering.
DOI: 10.61544/CXNH4447
Literatúra:
[1] Kopáčik, A., Erdélyi, J., Kyrinovič, P., Lipták, I. a Lukáč, Š., Geodézia v priemysle (online), Bratislava: Vydavateľstvo STU, 2016, ISBN 978-80-227-4661-8, 207 s.
[2] Štroner, M., Pospíšil, J., Koska, B., Křemen, T., Urban, R., Smítka, V. a Třasák, P., 3D skenovací systémy, Praha: ČVUT v Praze, 2013, ISBN 978-80-01-05371-3, 396 s.
[3] Erdélyi, J., Využitie terestrického laserového skenovania v stavebníctve a v priemysle [Habilitačná práca], Bratislava: SvF STU v Bratislave, 2018, 157 s.
[4] Lichti, D. D. and Skaloud, J., "Registration and Calibration," in Vosselman, G. - Maas, H.G. Airborne and Terrestrial Laser Scanning, Dunbeath: Whittles Publishing, 2010, pp. 83-133, ISBN 978-1904445876.
[5] Han, X. F., Jin, J. S., Wang, M.-J., Jiang, W., Gao, L. and Xiao, L., "A review of algorithms for filtering the 3D point cloud," Signal Processing: Image Communication, vol. 57, pp. 103-112, 2017, ISSN 0923-5965.
[6] Schall, O., Beyaev, A. and Seidel, H.-P., "Robust Filtering of Noisy Scattered Point Data," Proceedings Eurographics/IEEE VGTC Symposium Point-Based Graphics, Stony Brook, NY, USA, pp. 71-144, June 2005, ISSN 1511-7813.
[7] Narváez, E. A. L. and Narváez, N. E. L., "Point Cloud Denoising Using Robust Principal Component Analysis," Proceedings of the First International Conference on Computer Graphics Theory and Applications, Setúbal, Portugal, pp. 51-58, February 2006.
[8] Jenke, P. M. W., Bokeloh, M., Schilling, A. and Straβer, W., "Bayesian point cloud reconstruction," Computer Graphics Forum, vol. 25, no. 3, pp. 379-388, 2006, ISSN = 1467-8659.
[9] Kalogerakis, E., Nowrouzezahrai, D., Simari, P. and Singh, K., "Extracting lines of curvature from noisy point clouds," Computer-Aided Design, vol. 41, no. 4, pp. 282-292, 2009, ISSN 0010-4485.
[10] Rosli, N. A. I. M. and Ramli, A., "Mapping Bootstrap Error for Bilateral Smoothing on Point Set," AIP Conference Proceedings, vol. 1605, no. 1, pp. 149-154, 2014.
[11] Jones, T. R., Durand, F. and Zwicker, M., "Normal Improvement for Point Rendering," IEEE Computer Graphics and Applications, vol. 24, no. 4, pp. 53-56, 2004, ISSN 1558-1756.
[12] Tomasi, C. and Manduchi, R., "Bilateral filtering for gray and color images," International Conference on Computer Vision, Bombay, pp. 839-846, January 1998, ISBN 81-7319-221-9.
[13] Ma, S., Zhou, C., Zhang, L. and Hong, W., "Depth image denoising and key points extraction for manipulation plane detection," Intelligent Control and Automation, Shenyang, pp. 3315-3320, June 2014, ISBN 978-1-4799-5825-2.
[14] Shi, B. Q., Lang, J. and Liu, Q., "Adaptive simplification of point cloud using k-means clustering," Computer-Aided Design, vol. 43, no. 8, pp. 910-922, 2011, ISSN 0010-4485.
[15] Wang, J., Xu, K. , Liu, L., Cao, J., Liu, S., Yu, Z. and Gu, X. D., "Consolidation of Low-quality Point Clouds from Outdoor Scenes," Computer Graphics Forum, vol. 32, no. 5, pp. 207-216, 2013.
[16] Li, B., Schnabel, R., Klein, R., Cheng, Z., Dang, G. and Jin, S., "Robust normal estimation for point clouds with sharp," Computers & Graphics, vol. 34, no. 2, pp. 94-106, 2010, ISSN 0097-8493.
[17] Huang, H., Wu, S., Gong, M., Cohen-Or, D., Ascher, U. and Zhang, H., "Edge-aware point set resampling," ACM Transactions on Graphics (TOG), vol. 23, no. 1, pp. 1-12, 2013, ISSN 0730-0301.
[18] Lipman, Y., Cohen-Or, D., Levin, D. and Tal-Ezer, H., "Parameterization‐free projection for geometry reconstruction," ACM Transactiions on Graphics, vol. 26, no. 3, pp. 221-225, 2007, ISSN 0730-0301.
[19] Tagliasacchi, A., Zhang, H. and Cohen-Or, D., "Curve skeleton extraction from incomplete point cloud," ACM Transactions on Graphics, vol. 28, no. 3, pp. 341-352, 2009, ISSN 0730-0301.
[20] Levin, D., "The Approximation Power of Moving Least-Squares," Mathematics of Computation, vol. 67, no. 224, pp. 1517-1531, 1998, ISSN 00255718.
[21] Alexa, M., Behr, J., Cohen-Or, D., Fleishman, S., Levin, D. and Silva, C. T., "Computing and Rendering Point Set Surfaces," IEEE Transactions on Visualization and Computer Graphics, vol. 9, no. 1, pp. 3-15, January-March 2003, ISSN 1941-0506.
[22] Hampacher, M. a Štroner, M., Zpracování a analýza měření v inženýrské geodézii, Praha: České vysoké učení technické v Praze, 2011, 312 s, ISBN 978-80-01-04900-6.
[23] Huang, H., Li, D., Zhang, H., Ascher, U. and Cohen-Or, D., "Consolidation of unorganized point clouds for surface reconstruction," ACM Transaction on Graphics, vol. 28, no. 5, pp. 89-97, 2009, ISSN 0730-0301.
[24] Ye, M., Wang, X., Yang, R., Pen, L. and Pollefey, M., "Accurate 3D pose estimation from a single depth image," International Conference on Computer Vision, Barcelona, Spain, pp. 731-738, November 2011, ISSN 2380-7504.
[25] Linsen, L., Point Cloud Representation, Technical Report, Faculty of Computer Science, University of Karlsruhe, Germany, 2001.
[26] Pauly, M., Kobbelt, L. and Gross, M., "Multiresolution Modeling of Point-Sampled Geometry," ETH Zurich Research Collection, 2002.
[27] Clarenz, U., Rumpf, M. a Telea, A., „Fairing of point based surfaces,“ Proceedings of Computer Graphics International, Crete, pp. 600-603, 16-19 June 2004, ISSN 1530-1052.
[28] Xiao, C., Miao, Y., Liu, S. a Peng, Q., „A dynamic balanced flow for filtering point-sampled geometry,“ The Visual Computer, Vol. 22, No. 1., pp. 210-219, 2006, ISSN 1432-2315.
[29] Smítka, V., Přesnost 3D skenovacích technológií v geodézii a možnosti jejího zvyšování [Dizertačná práca], Praha: ČVUT Praha, 2013, 160 s.
[30] Yun, J.-S. and Sim, J.-Y., "Reflection Removal for Large-Scale 3D Point Clouds," The IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Salt Lake City, pp. 4597-4605, 18-22 June 2018, ISSN 2575-7075.
[31] Householder, A. S., "Unitary triangularization of a nonsymmetric matrix," Journal of ACM, vol. 5, no. 4, pp. 339-342, 1958, ISSN 0004-5411.
[32] Vosselman, G., Gorte, B. G. H. , Sithole, G. and Rabbani, T., "Recognising Structure in Laser Scanner Point Clouds," International Archives of Photogrammetry, Remote Sensing and Spatial Information Sciences, vol. 46 (Part 8/W2), pp. 33-38, 2004.
[33] Vosselman, G. and Klein, R., "Visualisation and Structuring of Point Clouds," in Vosselman, G. - Maas, H.G. Airborne and Terrestrial Laser Scanning, Dunbeath, Whittles Publishing, 2010, pp. 45-79, ISBN 978-1904445876.
[34] Nguyen, A. and Le, B., "3D Point Cloud Segmentation: A survey," 6th IEEE Conference on Robotics, Automation and Mechatronics (RAM), Manila, Singapore: IEEE, pp. 225-230, 2013, ISSN 2158-2181.
[35] Grilli, E., Menna, F. and Remondino, F., "A review of point clouds segmentation and classification algorithms," International Archives of the Phottogrammetry, Remote Sensing and Spatial Information Sciences, vol. XLII, no. (2/W3), pp. 339-344, 2017.
[36] Rabbani, T. S., Automatic Reconstruction of Industrial Installations Using Point Clouds and Images, Delft: PhD Thesis. Technische Universiteit Delft, 2006, p. 194.
[37] Bhanu, B., Lee, S., Ho, C. C. and Henderson, T., "Range Data Processing: Representation of Surfaces by Edges," Proceedings of Eighth International Conference on Pattern Recognition, pp. 236-238, 27-31 October 1986.
[38] Sappa, A. D. and Devy, M., "Fast range image segmentation by an edge detection strategy," Proceedings of Third International Conference on 3‐D Digital Imaging and Modeling, Quebec: IEEE, pp. 292-299, February 2001.
[39] Jiang, X. and Bunke, H., "Edge Detection in Range Images Based on Scan Line Approximation," Computer Vision and Image Understanding, vol. 73, no. 2, pp. 183-199, 1999, ISSN 1077-3142.
[40] Gumhold, S., Wang, X. and MacLeod, R., "Feature Extraction from Point Clouds," Proceedings of 10th International Meshing Roundtable, Sandia National Laboratories, Newport Beach, California, U.S.A., pp. 293-305, 7-10 October 2001.
[41] Besl, P. J. and Jain, R. C., "Segmentation Through Variable-Order Surface Fitting," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 10, no. 2, pp. 167-192, 1988, ISSN 1939-3539.
[42] Xiao, J., Zhang, J., Adler, B., Zhang, H. and Zhang, J., "Three-dimensional point cloud plane segmentation in both structured and unstructured environments," Robotics and Autonomous Systems, vol. 61, pp. 1641-1652, 2013, ISSN 0921-8890.
[43] Vo, A.-V., Truong-Hong, L., Laefer, D. F. and Bertolotto, M., "Octree-based region growing for point cloud segmentation," ISPRS Journal of Photogrammetry and Remote Sensing, vol. 104, pp. 88-100, 2015, ISSN 0924-2716.
[44] „Region growing segmentation,“ [Online]. Available: http://pointclouds.org/documentation/tutorials/region_growing_segmentation.php. [Dostupné 02.12.2024].
[45] „Point Cloud Library,“ [Online]. Available: http://pointclouds.org/. [Dostupné 02.12.2024].
[46] Fischler, M. A. a Bolles, R. C., „Random Sample Consensus: A Paradigm for Model Fitting with Applications to Image Analysis and Automated Cartography,“ Communications of the ACM, Vol. 24, %1. vyd.6, pp. 381-395, 1981, ISSN 0001-0782.
[47] Hough, P. V. C., „Method and means for recognizing complex patterns“. USA Patent 3069654, 18 12 1962.
[48] Schnabel, R., Efficient Point-Cloud Processing with Primitive Shapes [PhD Thesis], Bonn: Univesität Bonn, 2009.
[49] Bolles, R. C. a Fischler, M. A., „A ransac-based approach to model fitting and its application to findig cylinders in range data,“ Proceedings of the 7th International Joint Conference on Artificial Intelligence, pp. 637-643, 1981.
[50] Chaperon, T. a Goulette, F., „Extracting Cylinders in Full 3D Data Using a Random Sampling Method and the Gaussian Image,“ Proceedings of the Vision Modeling and Visualization Conference, pp. 35-42, 21-23 November 2001.
[51] R. Schnabel , R. Wahl and R. Klein, "Efficient RANSAC for point-cloud shape detection," Computer Graphics Forum, vol. 26, no. 2, pp. 214-226, 2007, ISSN: 0167-7055.
[52] Li, L., Yang, F., Zhu, H., Li, D., Li, Y. and Tang, L., "An Improved RANSAC for 3D Point Cloud Plane Segmentation Based on Normal Distribution Transformation Cells," Remote Sensing, vol. 9, no. 5, 2017, ISSN 2072-4292.
[53] Honti, R., Erdélyi, J. and Kopáčik, A., "Plane segmentation from point clouds," Pollack Periodica, vol. 13, no. 2, pp. 159-171, 2018, ISSN 1788-3911.
[54] Liu, Y.-J., Zhang, J.-B., Hou, J.-Ch., Ren, J.-Ch. and Tang, W.-Q., "Cylinder Detection in Large-Scale Point Cloud of Pipeline Plant," IEEE Transactions on Visualization and Computer Graphics, vol. 19, no. 10, pp. 1700-1707, 2013, ISSN 1941-0506.
[55] Ng, R. T. and Han, J., "Efficient and Effective Clustering Methods for Spatial Data Mining," Proceedings of 20th International Conference on Very Large Databases, pp. 144-155, 12-15 September 1994, ISBN 1558601538.
[56] Lu, X., Yao, J., Tu, J., Li, K,, Li, L. and Liu, Y., "Pairwise Linkage For Point Cloud Segmentation," ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences, Volume III-3,, pp. 201-208, 12-19 July 2016,
[57] MacQueen, J., "Some methods for classification and analysis of multivariate," Proceedings of Fifth Berkeley Symposium on Mathematical Statistics and, vol. 1: Statistics, pp. 281-297, 1967.
[58] LeCun, Y., Bengio, Y. and Hinton, G., "Deep Learning," Nature, vol. 521, pp. 436-444, 2017, ISSN 1476-4687.
[59] Zhang, X., Li, Q., Xiong, Y. and He, F., "3D Mesh Segmentation Using Mean-Shifted Curvature," in Advances in Geometric Modeling and Processing, Berlin, Springer, 2008, pp. 465-474, ISBN 978-3-540-79246-8.
[60] Golovinskiy, A. and Funkhouser, T., "Min‐cut based segmentation of point clouds," Proceedings of The 2009 IEEE 12th International Conference on Computer Vision Workshops, Kyoto, Japan, pp. 39-46, 27-4 September-October 2009, ISBN 978-1-4244-4442-7.
[61] Rusu, R. B., Holzbach, A., Blodow, N. and Beetz, M., "Fast Geometric Point Labeling using Conditional Random Fields," Prooceedings of 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems. St. Louis, USA: IEEE, pp. 7-12, 11-15 October 2009, ISSN: 2153-0866.
[62] Nurunnabi, A., Belton, D. and West, G., "Robust Segmentation in Laser Scanning 3D Point Cloud Data," Proceedings of International Conference on Digital Image Computing Techniques and Applications (DICTA), 3-5 December 2012, ISBN:978-1-4673-2179-2.
[63] Diebel, J. and Thrun, S., "An application of markov random fields to range," Advances in Neural Information Processing Systems, vol. 18, p. 291, 2006.
[64] Schoenberg, J., Nathan, A. and Campbell, M., "Segmentation of dense range information in complex urban scenes," Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp. 2033-2038, 2010, ISSN 2153-0866.
[65] Lari, Z. and Habib, A., "Alternative methodologies for the estimation of local point density index: Moving towards adaptive LiDAR data processing," Int. Arch. Photogramm. Remote Sens. Spatial Inf. Sci. XXXIX-B3, p. 127–132, 2012.
[66] Erdélyi, J., Určovanie posunov a pretvorení mostných objektov využitím TLS, Monografia, Bratislava: STU, SPEKTRUM, 2014, 126 s., ISBN 978-80-227-4230-6.
[67] Honti, R., Erdélyi, J. and Kopáčik, A., "Automated Sphere Segmentation from Point Clouds," Pollack Periodica, vol. 15, no. 3, pp. 15-25, 2020, ISSN 1788-3911.
[68] Tran, T.-T., Cao, V.-T. and Laurendeau, D., "Extraction of cylinders and estimation of their parameters from point clouds," Computers & Graphics, vol. 46, pp. 345-357, 2015, ISSN 0097-8493.
[69] Honti, R., Erdélyi, J. and Kopáčik, A., "Automation of Cylinder Segmentation from Point Cloud Data," Pollack Periodica, vol. 14, no. 3, pp. 189-200, 2019, ISSN 1788-3911.
[70] V. Pratt, "Direct least-squares fitting of algebraic surfaces," Newsletter on ACM SIGGRAPH, vol. 21, no. 4, pp. 145-152, 1987.
