Review of Methods of Combined Orientation of Photogrammetric and Laser Scanning Data

• Autorzy: Rzonca A.
• Języki publikacji: EN

Abstrakty

EN

The objective of the paper is to review the state of the art of analytical methods of integration of photogrammetric and laser scanning data which is an important scientific and practical issue. Basing on the conclusions included in previous studies, it can be observed that the analytical integration of photogrammetric and laser scanning data is an interesting area of research, especially in case of absolute orientation of images and point clouds in a sequential or one-stage adjustment process. The results of the state-of-the-art analysis are shown according to four division criteria: method of registration, workflow stage, data capture technology and calculation order. After presenting all aspects of the problem, the author proposes the two-step classification of variants of data analytical integration based on order of orientation calculation and methods of registration.

Słowa kluczowe

EN

laser scanning; photogrammetry; co-registration; data integration

• Wydawca: Wydawnictwo PAK
• Czasopismo: Measurement Automation Monitoring
• Rocznik: 2018
• Tom: Vol. 64, No. 3
• Strony: 57--62
• Opis fizyczny: Bibliogr. 52 poz., rys., tab.

Twórcy

autor

Rzonca A.

• AGH University of Science and Technology 30 Mickiewicza Ave., 30-059 Kraków, Poland

Bibliografia

• [1] Leslar M.: Integrating Terrestrial LiDAR with Point Clouds Created from Unmanned Aerial Vehicle Imagery. The International Archives of Photogrammetry, Remote Sensing and Spatial Information Sciences, 40(1), 97, 2015.
• [2] Rahimi S., Arefi H., Bahmanyar R.: Automatic road extraction based on integration of high resolution lidar and aerial imagery. The International Archives of Photogrammetry, Remote Sensing and Spatial Information Sciences, 40(1), 583, 2015.
• [3] Chen L. C., Teo T. A., Shaoa Y. C., Lai Y. C., Rau J. Y.: Fusion of lidar data and optical imagery for building modeling. International Archives of Photogrammetry and Remote Sensing, 35(B4), 732-737, 2004.
• [4] Li Y., Low K. L.: Automatic registration of color images to 3D geometry. In Proceedings of the 2009 Computer Graphics International Conference (pp. 21-28). ACM, May, 2009.
• [5] Beger R., Gedrange C., Hecht R., Neubert M.: Data fusion of extremely high resolution aerial imagery and LiDAR data for automated railroad centre line reconstruction. ISPRS Journal of Photogrammetry, 66 (6), 40-51, 2011, DOI: https://doi.org/10.1016/ j.isprsjprs.2011.09.012
• [6] Pleskacz M., Rzonca A.: Opracowanie metody oceny poprawności działania algorytmu kolorowania chmury punktów [Design of a Testing Method to Assess the Correctness of a Point Cloud Colorization Algorithm], Archiwum Fotogrametrii, Kartografii i Teledetekcji, 28, 91-104, 2016.
• [7] Baltsavias E. P.: A comparison between photogrammetry and laser scanning. ISPRS Journal of Photogrammetry, Remote Sensing, 54, 83-94, 1999, DOI: https://doi.org/10.1016/S0924-2716(99)00014-3
• [8] Schenk T., Csathó B.: Fusion of LIDAR data and aerial imagery for a more complete surface description. International Archives of Photogrammetry Remote Sensing and Spatial Information Sciences, 34(3/A), 310-317, 2002.
• [9] Rzonca A.: Integration of photogrammetric and 3D laser scanning data for monumental objects documentation. Kraków: Wydawnictwo AGH; 2013.
• [10] Wendt A.: A concept for feature based data registration by simultaneous consideration of laser scanner data and photogrammetric images. ISPRS journal of photogrammetry and remote sensing, 62(2), 122-134, 2007, DOI: https://doi.org/10.1016/j.isprsjprs.2006.12.001
• [11] He F.: Co-registration between imagery and point cloud acquired by mls platform. MSc dissertation at ITC, Holland, 2012.
• [12] Yang Z. H., Zhang Y. S., Zheng T., Lai W. B., Zou Z. R., Zou B.: Co-registration airborne lidar point cloud data and synchronous digital image registration based on combined adjustment. International Archives of the Photogrammetry, Remote Sensing Spatial Information Sciences, 41, B1, 259-264, 2016.
• [13] Rönnholm P.: Registration quality-towards integration of laser scanning and photogrammetry. EuroSDR, 2011.
• [14] Gneeniss A. S.: Integration of lidar and photogram-metric data for enhanced aerial triangulation and camera calibration. Newcastle University, PhD Thesis, 2013.
• [15] Delara R., Mitishita E., Habib A.: Bundle adjustment of images from non-metric CCD camera using lidar data as control points. The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, 35(B3), 13-18, 2004.
• [16] Liu K., Zayer R.: Bundle Adjustment Constrained Smoothing for Multi-view Point Cloud Data. Advances in Visual Computing, 126-137, 2012 DOI: https://doi.org/10.1007/978-3-642-33179-4_13
• [17] Schenk T., Seo S., Csatho B.: Accuracy study of airborne laser scanning data with photogrammetry. International Archives of Photogrammetry and Remote Sensing, 34(part 3), W4, 2001.
• [18] Habib A., Ghamma M., Kim E. M.: LiDAR data for photogrammetric georeferencing. FIG Working Week 2005 and GSDI-8 Cairo, Egypt, 2005.
• [19] Sirmacek B., Lindenbergh R. C., Menenti M.: Automatic registration of iPhone images to laser point clouds of urban structures using shape features. ISPRS, October, 2013.
• [20] Al-Manasir K., Fraser C.: Registration of terrestrial laser scanner data using imagery. The Photogrammetric Record, 21(115), 255-268, 2006 DOI: https://doi.org/10.1111/j.1477-9730.2006.00379.x
• [21] Ding M., Lyngbaek K., Zakhor A.: Automatic registration of aerial imagery with untextured 3d lidar models. Proc. IEEE Computer Society Conf. pp. 1-8, 2008 DOI: https://doi.org/10.1109/ CVPR.2008.4587661
• [22] Postolov Y., Krupnik A., McIntosh K.: Registration of airborne laser data to surfaces generated by photogrammetric means. International Archives of Photogrammetry and Remote Sensing, 32(3/W14), 95-99, 1999.
• [23] Gneeniss A. S., Mills J. P., Miller P. E.: Reference lidar surfaces for enhanced aerial triangulation and camera calibration, The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, XL-1/W1, ISPRS Hannover Workshop, 2013.
• [24] Gneeniss A. S., Mills J. P., Miller P. E.: In-flight photogrammetric camera calibration and validation via complementary lidar. ISPRS Journal of Photogrammetry and Remote Sensing, 100, 3-13, 2015 DOI: https://doi.org/10.1016/j.isprsjprs.2014.04.019
• [25] Bohm J., Becker S.: Automatic marker-free registration of terrestrial laser scans using reflectance features. 8th Conf. On O3D,. Zurich, Switzerland, 2007.
• [26] Jayendra-Lakshmana M., Devarajan V.: A new feature descriptor for lidar image matching. ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences. II-2/W1, ISPRS 8th 3dgeoinfo Conference, WG II/2 Workshop, Istanbul, Turkey, 2013.
• [27] Meierhold N., Spehr M., Schilling A., Gumhold S., Maas H. G.: Automatic feature matching between digital images and 2D representations of a 3D laser scanner point cloud. In Proceedings of the ISPRS Commission (Vol. 1501, pp. 446-451), June, 2010.
• [28] Habib A., Bang K. I., Shin S. W., Mitishita E.: LiDAR system self-calibration using planar patches from photogrammetric data. The 5th International Symposium on Mobile Mapping Technology, Padua, Italy, 2007.
• [29] Nakano K., Chikatsu H.: On improvement of accuracy of airborne laser scanner data using digital images. The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences. XXXVII(B1). 373-378, 2008.
• [30] Angelats E., Colomina I.: One step mobile mapping laser and camera data orientation and calibration. The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, XL-3/W1, 15-20, 2014.
• [31] Habib A., Kersting A., Banga K.: Impact of lidar system calibration on the relative and absolute accuracy of the adjusted point cloud, 2010 http://www.isprs.org/proceedings/XXXVIII/Eurocow2010/euroCOW2010_files/papers/17.pdf (accessed 7.06.2017)
• [32] Chunjing Y., Guang G.: The direct registration of lidar point clouds and high resolution image based on linear feature by introducing an unknown parameter. The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, XXXIX-B4, 403-408, 2012.
• [33] Armenakis C., Gao Y., Sohn G.: Co-registration of lidar and photogrammetric data for updating building databases. The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, 38, 96-100, 2010.
• [34] Rönnholm P., Haggrén H.: Registration of laser scanning point clouds and aerial images using either artificial or natural tie features. ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences, 3, 63-68, 2012.
• [35] Zhang W., Zhao J., Chen M., Chen Y., Yan K., Li L., Chu Q.: Registration of optical imagery and LiDAR data using an inherent geometrical constraint. Optics express, 23(6), 7694-7702, 2015 DOI: https://doi.org/10.1364/OE.23.007694
• [36] Habib A., Schenk T.: A new approach for matching surfaces from laser scanners and optical scanners. International Archives of Photogrammetry and Remote Sensing, 32(3/W14), 55-61, 1999.
• [37] Rönnholm P., Honkavaara E., Erving A., Nuikka M., Haggren H., Kaasalainen S. ... Hyyppa J.: Registration of airborne laser scanning point clouds with aerial images through terrestrial image blocks. Int. Archives Photogrammetry, Remote. Sens. Spatial Inf. Sci, 37, 473-481, 2008.
• [38] Lv F., Ren K.: Automatic registration of airborne LiDAR point cloud data and optical imagery depth map based on line and points features. Infrared Physics Technology, 71, 457-463, 2015 DOI: https:// doi.org/10.1016/j.infrared.2015.06.006
• [39] Liu L., Stamos I.: Automatic 3D to 2D registration for the photorealistic rendering of urban scenes. In Computer Vision and Pattern Recognition, 2005. CVPR 2005. IEEE Computer Society Conference on (2, 137-143). IEEE, June, 2005 DOI: https:// doi.org/10.1109/CVPR.2005.80
• [40] Liu S., Tong X., Chen J., Liu X., Sun W., Xie H., Ye Z.: A linear feature-based approach for the registration of unmanned aerial vehicle remotely-sensed images and airborne LiDAR data. Remote Sensing, 8(2), 82, 2016 DOI: https://doi.org/10.3390/rs8020082.
• [41] Swart A., Broere J., Veltkamp R., Tan R.: Refined non-rigid registration of a panoramic image sequence to a LiDAR point cloud. In Photogrammetric Image Analysis (pp. 73-84). Springer Berlin Heidelberg, 2011.
• [42] Gao Y., Huang X., Zhang F., Fu Z., Yang C.: Automatic geo-referencing mobile laser scanning data to UAV images. The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, XL-1/W4, 41-46, 2015.
• [43] Dold C., Brenner C.: Registration of terrestrial laser scanning data using planar patches and image data. The International Archives of the Photogrammetry and Remote Sensing, XXXVI (5), 78-83, 2006.
• [44] Zhang Y., Xiong X., Hu X.: Rigorous lidar strip adjustment with triangulated aerial imagery. ISPRS Annals of Photogrammetry, Remote Sensing and Spatial Information Sciences, 1(2), 361-366, 2013.
• [45] Du Q., Xie D., Sun Y.: An automatic high precision registration method between large area aerial images and aerial light detection and ranging data. The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, XL-7/W4, 17-21, 2015.
• [46] Weinmann M., Weinmann M., Hinz S., Jutzi B.: Fast and automatic image-based registration of TLS data. ISPRS Journal of Photogrammetry and Remote Sensing, 66(6), 62-70, 2011 DOI: https://doi.org/10.1016/j.isprsjprs.2011.09.010
• [47] Kwak T. S., Kim Y. I., Yu K. Y., Lee B. K.: Registration of aerial imagery and aerial LiDAR data using centroids of plane roof surfaces as control information. KSCE journal of Civil Engineering, 10(5), 365-370, 2006 DOI: doi: https://doi.org/10.1007/BF02830090
• [48] Mitishita E., Habib A., Centeno J., Machado A., Lay J., Wong C.: Photogrammetric and lidar data integration using the centroid of a rectangular roof as a control point. The Photogrammetric Record, 23(121), 19-35, 2008 DOI: https://doi.org/10.1111/j.1477-9730.2008.00464.x
• [49] Abayowa B. O., Yilmaz A., Hardie R. C.: Automatic registration of optical aerial imagery to a LiDAR point cloud for generation of city models. ISPRS Journal of Photogrammetry and Remote Sensing, 106, 68-81, 2015 DOI: https://doi.org/10.1016/ j.isprsjprs.2015.05.006
• [50] Parmehr E. G., Fraser C. S., Zhang C., Leach J.: Automatic registration of optical imagery with 3D LiDAR data using statistical similarity. ISPRS Journal of Photogrammetry and Remote Sensing, 88, 28-40, 2014.
• [51] Gonzalez Aguilera D., Rodriguez Gonzalvez P., Gomez Lahoz J.: An automatic procedure for co-registration of terrestrial laser scanners and digital cameras. ISPRS Journal of Photogrammetry and Remote Sensing. 64 (3), 308-316, 2014 DOI: https://doi.org/10.1016/ j.isprsjprs.2008.10.002
• [52] Ju H., Toth C., Grejner-Brzezinska D. A.: A new approach to robust lidar/optical imagery registration. Photogrammetrie, Fernerkundung, Geoinformation. 2012(5), 0523-0534, 2012 DOI: https://doi.org/ 10.1127/1432-8364/2012/0136.

Uwagi

EN

1. This research work was financed under the statutory research at Department of Geoinformation, Photogrammetry and Remote Sensing of Environment, Faculty of Mining Surveying and Environmental Engineering, AGH University of Science and Technology no. 11.11.150.949.

PL

2. Opracowanie rekordu w ramach umowy 509/P-DUN/2018 ze środków MNiSW przeznaczonych na działalność upowszechniającą naukę (2019).