The aim of this article is to investigate methods for the automatic extraction of the infrared (IR) textures for the roofs and facades of existing building models. We focus on the correction of the measured exterior orientation parameters of the IR camera mounted on a mobile platform. The developed method is based on point-to-point matching of the features extracted from IR images with a wire-frame building model. Firstly, the extraction of different feature types is studied on a sample IR image; Forstner and intersection points are chosen for a representation of the image features. Secondly, the three-dimensional (3D) building model is projected into each frame of the IR video sequence using orientation parameters; only coarse exterior orientation parameters are known. Then the automatic co-registration of a 3D building model projection into the image sequence with image features is carried out. The matching of a model and extracted features is applied iteratively, and exterior orientation parameters are adjusted with least square adjustment The method is tested on a dataset of a dense urban area. Finally, an evaluation of the developed method is presented with five quality parameters, i.e. efficiency of the method, completeness and correctness of matching and extraction.