Computational thermal homogenization is applied to the microscale and mesoscale of concrete sequentially. Microscale homogenization is based on a 3D micro-CT scan of hardened cement paste (HCP). Mesoscale homogenization is carried out through the analysis of aggregates which are randomly distributed in a homogenized matrix. The thermal conductivity of this matrix is delivered by the homogenization of HCP, thereby establishing the link between micro-mesoscale of concrete. This link is critical to capture the dependence of the overall conductivity of concrete on the internal relative humidity. Therefore, special emphasis is given to the effect of relative humidity changes in micropores on the thermal conductivity of HCP and concrete. Each step of homogenization is compared with available experimental data.