Plasmonic dimer nanoantennas are characterized by a strong enhancement of the optical field, leading to large nonlinear effects. The third harmonic emission spectrum thus depends strongly on the antenna shape and size as well as on its gap size. Despite the complex shape of the nanostructure, we find that for a large range of different geometries the nonlinear spectral properties are fully determined by the linear response of the antenna. We find excellent agreement between the measured spectra and predictions from a simple nonlinear oscillator model. We extract the oscillator parameters from the linear spectrum and use the amplitude of the nonlinear perturbation only as scaling parameter of the third harmonic spectra. Deviations from the model only occur for gap sizes below 20 nm, indicating that only for these small distances the antenna hot spot contributes noticeable to the third harmonic generation. Because of its simplicity and intuitiveness, our model allows for the rational design of efficient plasmonic nonlinear light sources and is thus crucial for the design of future plasmonic devices that give substantial enhancement of nonlinear processes such as higher harmonics generation as well as difference frequency mixing for plasmonically enhanced terahertz generation.