The Fusion of the Visual and Thermal Images on the Basis of Determining the Image Fragments which Contain Essential Details

Faculty of Automatic Control, Electronics and Computer Science Silesian University of Technology, Akademicka 16, Gliwice, Poland

Abstract

The aim of the following study was to develop a procedure which guarantees the data fusion of thermal and visual images. The first stage of the proposed algorithm consisted of images acquisition which guaranteed that the same parts of images represented the same parts of the observed terrain. The second stage depended on previous information about the searched object features. Two different situations were considered herein. In the case when we had the searched object’s feature vector for both representations of a searched object, we could conduct the pattern recognition for each image. It was conducted separately for visual and thermal images. In this way, we obtained the important parts of the images which should be represented in a fused image. The other case examined in the paper, considered the situation in which we did not have the formalised information about the object. In this case, it was necessary to analyse whole images in order to define the potential parts of the images where the object could be found. This analysis should be helpful for an operator to indicate the parts of the images where there are some artefacts which can be the elements of the searched object. Therefore, in this case, the second stage of the algorithm consisted in calculating the local features of the images. These features constituted grey scale gradient computed for the pixels inside the aperture. This study presented the examples of the fused images obtained by means of the developed method.