The system of fourplanets discovered around the intermediate-mass star HR8799 offers a unique opportunity to test planet formation theories at large orbital radii and to probe the physics and chemistry at play in the atmospheres of self-luminous young (~30 Myr) planets. In this paper (Paper IV), we aim to use these spectra and available photometry to determine how they compare to known objects, what the planet physical properties are, and how their atmospheres work. We compare the available spectra, photometry, and spectral energy distribution (SED) of the planets to field dwarfs and young companions. Our empirical analysis and atmospheric modelling show that an enhanced content in dust and decreased CIA of H2 is certainly responsible for the deviation of the properties of the planet with respect to field dwarfs. The analysis suggests in addition that HR8799c and b have later spectral types than the two other planets, and therefore could both have lower masses.