Significant Digits in Business Forecasting

0

My favorite dog trick is the group hug. This is achieved by taking a dog's bad habit (rising up on strangers who don't really want a 70# dog rising up on them), and "flipping it" into something cute and adorable. It's all a matter of controlling perception, and that is something forecasters are good at in the abuse of significant digits.

Do You Really Need All Those Digits?

Armstrong's Principles of ForecastingIn "The Forecasting Dictionary," Armstrong1 cites a 1990 study by Teigen2 that showed more precise reporting can make a forecast more acceptable, unless such precision seems unreasonable. Thus, management may have more faith in my competence (and the accuracy of my forecasts) if I project revenues of $147,000, $263,000, and $72,500 for my three products (rather than $100,000, $300,000, and $70,000.). However, they'll likely see through my ruse if I forecast $147,362.27, $262,951.85, and $72,515.03. (Not even the most naïve executive believes a forecast can be that that close to being right!)

So how many significant digits should we use in reporting our forecasts? More digits (as long as there aren't too many!) can give a false sense of precision, implying we have more confidence in a forecast when such confidence isn't really merited. Fewer digits are just another way of saying we don't have much confidence at all in our forecast, implying a wide prediction interval in which the actual value will fall.

Armstrong (p. 810) suggests "A good rule of thumb is to use three significant digits unless the measures do have greater precision and the added precision is needed by the decision maker." I suspect there are very few circumstances in which more than three digits are needed. You are probably safe to configure your forecasting software to show only three significant digits.

Think of it this way: Suppose you can create perfect forecasts (100% accurate), but are limited to just three significant digits. What is the worst case forecast error?

If the perfect forecast is 1005, but you are limited to three significant digits, then the forecast would be 1010 or 1000 (depending on whether you round up or down). When the actual turns out to be 1005 (as predicted with the perfect forecast), then your forecast error is 0.5%.

If the perfect forecast is 9995, then the three significant digit forecast is 10,000 or 9990 (depending on whether you round up or down). When the actual turns out to be 9995 (as we predicted with the perfect forecast), your forecast error is 0.05%.

Limiting the forecast to three significant digits creates at most a 0.5% forecast error (and often considerably less than that). What forecaster wouldn't sell his soul for a 0.5% error? Given that typical business forecast errors are in the 20-50% range, another half a percent (worse case!) is nothing.

To conclude: In the continuing pursuit to streamline the forecasting process, and make it appear less ridiculous, get rid of all those extraneous decimal points and digits, and limit your forecasts to just three.

----------------

1In Armstrong, J.S. (2001), Principles of Forecasting. Kluwer Academic Publishers, pp. 761-824.

2Teigen, K.H. (1990), "To be convincing or to be right: A question of preciseness," in K.J. Gilhooly, M.T.G. Keane, R.H. Logie & G. Erdos (eds.), Lines of Thinking. Chichester: John Wiley, pp. 299-313.

 

 

 

Share

About Author

Mike Gilliland

Product Marketing Manager

Michael Gilliland is a longtime business forecasting practitioner and formerly a Product Marketing Manager for SAS Forecasting. He is on the Board of Directors of the International Institute of Forecasters, and is Associate Editor of their practitioner journal Foresight: The International Journal of Applied Forecasting. Mike is author of The Business Forecasting Deal (Wiley, 2010) and former editor of the free e-book Forecasting with SAS: Special Collection (SAS Press, 2020). He is principal editor of Business Forecasting: Practical Problems and Solutions (Wiley, 2015) and Business Forecasting: The Emerging Role of Artificial Intelligence and Machine Learning (Wiley, 2021). In 2017 Mike received the Institute of Business Forecasting's Lifetime Achievement Award. In 2021 his paper "FVA: A Reality Check on Forecasting Practices" was inducted into the Foresight Hall of Fame. Mike initiated The Business Forecasting Deal blog in 2009 to help expose the seamy underbelly of forecasting practice, and to provide practical solutions to its most vexing problems.

Comments are closed.

Back to Top