UP - logo
E-resources
Full text
Peer reviewed Open access
  • Exploring the sources of un...
    Petropoulos, Fotios; Hyndman, Rob J.; Bergmeir, Christoph

    European journal of operational research, 07/2018, Volume: 268, Issue: 2
    Journal Article

    •Bootstrapping with aggregation (bagging) performs well for time series forecasting.•Bagging handles three sources of uncertainty: data, model and parameter uncertainty.•We decompose the performance benefits of bagging for each source of uncertainty.•Tackling model uncertainty brings the most benefits, even outperforming bagging.•We propose a strategy for weighted combinations of the suitable models. In a recent study, Bergmeir, Hyndman and Benítez (2016) successfully employed a bootstrap aggregation (bagging) technique for improving the performance of exponential smoothing. Each series is Box-Cox transformed, and decomposed by Seasonal and Trend decomposition using Loess (STL); then bootstrapping is applied on the remainder series before the trend and seasonality are added back, and the transformation reversed to create bootstrapped versions of the series. Subsequently, they apply automatic exponential smoothing on the original series and the bootstrapped versions of the series, with the final forecast being the equal-weight combination across all forecasts. In this study we attempt to address the question: why does bagging for time series forecasting work? We assume three sources of uncertainty (model uncertainty, data uncertainty, and parameter uncertainty) and we separately explore the benefits of bagging for time series forecasting for each one of them. Our analysis considers 4004 time series (from the M- and M3-competitions) and two families of models. The results show that the benefits of bagging predominantly originate from the model uncertainty: the fact that different models might be selected as optimal for the bootstrapped series. As such, a suitable weighted combination of the most suitable models should be preferred to selecting a single model.