Looking Forward: The Occasional Pitfalls of Predictive Analytics

Remember the days when a rear-view mirror was all we needed to make business decisions? Now, predictive analytics appears poised to turn hindsight into a relic of the past.

Two Gartner analysts echo that sentiment, stating, “Few technology areas will have greater potential to improve the financial performance and position of a commercial global enterprise than predictive analytics.”

Executives are eager to jump on the bandwagon too. Although only 13% of 250 executives surveyed by Accenture said they use big data primarily for predictive purposes, as many as 88% indicated big data analytics is a top priority for their company. With an increasing number of companies learning to master the precursors to developing predictive models — namely, connecting, monitoring, and analyzing — we can safely assume the art of gleaning business intelligence from foresight will continue to grow.

Amid the promises of predictive analytics, however, we also find a number of pitfalls. Some experts caution there are situations when predictive analytics techniques can prove inadequate, if not useless.

Let's consider three examples:

  • Predictive analytics works well in a stable environment in which the future of the business is likely to resemble its past and present. But Harvard Business School professor Clayton Christensen points out that in the event of a major disruption the past will do a poor job of foreshadowing future events. As an example, he cites the advent of PCs and commodity servers, arguing computer vendors who specialized in minicomputers in the 1980s couldn't possibly have predicted their sales impact, since they were innovations and there was no data to analyze.
  • Bias in favor of a positive result is another danger when interpreting data. One of the most common errors in predictive analytics projects. Speaking at the 2014 Predictive Analytics World conference in Boston, John Elder, president of consulting firm Elder Research, Inc., made a good point when he noted that people “'often look for data to justify our decisions,' when it should be the other way around.”
  • Mining big data will further do little good if the insights are not directly tied to an operational process. I've a feeling more companies than we realize are wasting precious time and manpower on big data projects that are not adequately understood, producing trivia rather than actionable business intelligence.

With the above challenges in mind, talent acquisition and thorough A/B tests will be key components of any predictive analytics project. What else do you think organizations need to do to use foresight effectively?

1 comment on “Looking Forward: The Occasional Pitfalls of Predictive Analytics

  1. Susan Fourtané
    January 9, 2015

    In today's business world you rarely find a stable environment. However, this doesn't mean that predictive analytics will never work in the case of a disruption. First, it depends on the disruption and second, it depends on the time line. 

    Of course, if you are taking as example the case of computer vendors in the 80s you can't expect that they were going to predict sales impact as far as 30+ years in the future. Big data analytics didn't even exist as we know it today. Predictive analytics works best within reasonable periods of time. 


Leave a Reply

This site uses Akismet to reduce spam. Learn how your comment data is processed.