The performance of hadronic calorimeters will be a key parameter at the next generation of High Energy Physics accelerators. A detector combining fine granularity with excellent timing information would prove beneficial for the reconstruction of both jets and electromagnetic particles with high energy resolution. In this work, the space and time structure of high energy showers is studied by means of a Geant4-based simulation toolkit. In particular, the relevant time scales of the different physics phenomena contributing to the energy loss are investigated. A correlation between the fluctuations of the energy deposition of high energy hadrons and the time development of the showers is observed, which allows for an event-by-event correction to be computed to improve the energy resolution of the calorimeter. These studies are intended to set the basic requirements for the development of a new-concept, total absorption time-imaging calorimeter, which seems now within reach thanks to major technological advancements in the production of fast scintillating materials and compact photodetectors.