We developed a time-of-flight measurement system for relativistic heavy ions with a requested resolution of 40ps Full Width Half Maximum. Such a resolution is mandatory to assign the correct mass number to every fission fragment, identified using the Bρ-ToF-ΔE method with the recoil spectrometer designed for the SOFIA experiment—which hold very recently at GSI. To achieve such a performance, fast plastic scintillators read-out by dedicated photomultiplier tubes were chosen among other possible options. We have led several test-measurements from 2009 to 2011, in order to investigate: the effect of the addition of a quenching molecule in the scintillator's matrix, the influence of the detector's size and the impact of the photomultiplier tube. The contribution of the dedicated electronics is also characterized. Time-of-flight measurements were performed realized with electron pulses and relativistic heavy ions, respectively provided by the LASER driven electron–accelerator (ELSA) at CEA–DAM Ile-de-France and by the SIS18/FRS facility at GSI. The reported results exhibit a time resolution better than 20ps Full Width Half Maximum reached with the last prototype at GSI with an Uranium beam. These results confirm that the SOFIA experiment should enable the measurement of the relativistic fission fragments' time-of-flight with the requested resolution.