This template is provided as a reference to calculate the health of the modeled forecast for one Product/SKU over time. There are a variety of metrics provided by both academics and software providers causing a lot of confusion about what each of these mean. Hopefully, this template will settle the debate by clarifying each metric and illustrating the correct method to calculate these metrics.
This template can be used as a model diagnostic to evaluate the fitted model. There are several metrics available to use as a model diagnostic including R-squared, Running Mean Absolute Deviation, Weighted Mean Absolute Percent Error, Co-efficient of Variation, Mean Absolute Scaled Error, Geometric Mean Absolute Relative Error and the Forecasting Efficiency Quotient. You can also track forecast bias using the Forecast Bias measure, the Tracking Signal and the Mean Percent Error.
This template can also be used to calculate the observed forecast error for the same SKU if you have a history of Lag forecasts available for the same SKU. This type of reporting is made available in our Vinayware software package which tracks multiple versions of the forecast.
The template is provided for just a few months. If you want to calculate this over multiple months, just insert rows and the formulas will self-adjust.
Based on our consulting experience we believe, Operation Management Professionals using these metrics will be able to judge the health of their forecast and understand their demand plans in a better way.
The calculations are self-explanatory. Refer to the particular comments and feel free to contact us with any concern.