Detection of windows in building textures from airborne and terrestrial infrared image sequences

• Autorzy: Iwaszczuk D. , Hoegner L. , Stilla U.
• Języki publikacji: EN

Abstrakty

EN

Infrared (IR) images depict thermal radiation of physical objects. Imaging the building façades and the roofs with an IR camera, thermal inspections of the buildings can be carried out. In such inspections a spatial correspondence between IR-images and the existing 3D building models can be helpful. Texturing 3D building models with IR images this spatial correspondence can be created. Furthermore in textures heat leakages can be detected and the heat bridges can be stored together with 3D building data. However, before extracting leakages, the windows should be located. In IR images glass reflects the surrounding and shows false results for the temperature measurements. Consequently, the windows should be detected in IR images and excluded for the inspection. The most common algorithms for window detection were developed for the images in the visual band. In this paper, an algorithm for window detection in textures extracted from terrestrial IR images is proposed. In the first step, small objects have to be removed by scaling down the image (texture). Then in the scaled image, regions are detected using a local dynamic threshold. Morphological operations are used to remove false detections and unify substructures of the windows. For every extracted region, which is a candidate for a window, the center of gravity is calculated. It is assumed that windows on façades are ordered in regular rows and columns. First the points are grouped into rows using histogram of height created from extracted gravity centers. Then masked correlation is used to detect the position and size of the windows. Finally, the gaps in the grid of windows are completed. For the first experiments we use a dataset from densely build urban area captured in Munich, Germany. The IR image sequences were taken from a vehicle driving on the street around the test area. Camera was directed to the building in oblique view. According to the acquisition geometry, no façade could be completely seen in one frame. Therefore, we combine the textures from many frames. To these textures we applied our algorithm for window detection. First results are promising. Applying the method for our test dataset, 79% completeness and 80% correctness could be achieved.

Słowa kluczowe

EN

infrared; image sequences; texture mapping; structure detection

PL

sekwencje obrazów; podczerwień; mapowanie tekstur

• Wydawca: Zarząd Główny Stowarzyszenia Geodetów Polskich
• Czasopismo: Archiwum Fotogrametrii, Kartografii i Teledetekcji
• Rocznik: 2011
• Tom: Vol. 22
• Strony: 215--225
• Opis fizyczny: Bibliogr. 9 poz.

Twórcy

autor

Iwaszczuk D.

• Photogrammetry & Remote Sensing, Technische Universitaet Muenchen (TUM)

autor

Hoegner L.

• Photogrammetry & Remote Sensing, Technische Universitaet Muenchen (TUM), Munich, Germany

autor

Stilla U.

• Photogrammetry & Remote Sensing, Technische Universitaet Muenchen (TUM), Munich, Germany

Bibliografia

• 1.Avbelj J, Iwaszczuk D, Stilla U (2010) Matching of 3D wire-frame building models with image features from infrared video sequences taken by helicopters. PCV 2010 - Photogrammetric Computer Vision and Image Analysis. International Archives of Photogrammetry, Remote Sensing and Spatial Geoinformation Sciences, 38(3B): 149-154
• 2.Becker S (2009) Generation and application of rules for quality dependent façade reconstruction, ISPRS Journal of Photogrammetry and Remote Sensing, Volume 64, Issue 6, November 2009, Pages 640-653
• 3.Dick A, Torr P, Cipolla R, Ribarsky W (2004) Modelling and interpretation of architecture from several images. International Journal of Computer Vision 60(2), pp. 111–134
• 4.Eugster H., Nebiker S. (2009) Real-time georegistration of video streams from mini or micro UAS using digital 3D city models. Proceedings of 6th International Symposium on Mobile Mapping Technology, Presidente Prudente, São Paulo, Brazil, July 21-24, 2009
• 5.Frueh C, Sammon R, Zakhor A (2004) Automated Texture Mapping of 3D City Models With Oblique Aerial Imagery, Proceedings of the 2nd International Symposium on 3D Data Processing, Visualization, and Transmission (3DPVT’04).
• 6.Green P (1995) Reversible Jump Markov Chain Monte Carlo Computation and Bayesian Model Determination. Biometrika 82, pp. 711–732.
• 7.Hoegner L, Kumke H, Meng L, Stilla U (2007) Automatic extraction of textures from infrared image sequences and database integration for 3D building models. PFG Photogrammetrie Fernerkundung Geoinformation. Stuttgart: Schweizerbartsche Verlagsbuchhandlung. 2007(6): 459-468
• 8.Hoegner L, Stilla U (2009) Thermal leakage detection on building facades using infrared textures generated by mobile mapping. Joint Urban Remote Sensing Event (JURSE 2009). IEEE
• 9.Leibe B, Schiele B (2004) Combined Object Categorization and Segmentation with an Implicit Shape Model. In: ECCV’04 Workshop on Statistical Learning in Computer Vision, pp. 1–15.