Remember when the morning talk show hosts started talking about Twitter? That was weird at first. But now, even your small, home-town news stations have a Twitter handle, and so does your boss, most likely.
“Big data” took a similar route into the mainstream vernacular. At first, we heard pundits saying that only the banks had big data. Or only big government needed to worry about big data. But then, before we knew it, 60 Minutes and The Atlantic were running regular features discussing big data.
I’m not sure if Hadoop will ever hit that level of mainstream attention, but it has become an everyday topic with the leaders I talk to at conferences and customer events. And the Hadoop naysayers are getting harder to find.
Why is that? Four reasons:
- Organizations are seeing Hadoop as more than just a dumping ground for their data. They’re approaching it with strategic business problems and learning how to treat it as an analytics platform.
- The early adopters who took the risks with the platform are seeing real results, and now everyone else is realizing it’s time to catch up.
- Today’s data volumes make it impossible to ignore Hadoop. We talked about this when discussing the Internet of Things, which is an undeniably huge growing source of big data.
- Hadoop is becoming enterprise hardened and easier to implement and maintain. Vendors like Cloudera and Hortonworks are developing ecosystems around Hadoop that improve its stability and offer layers of governance and security that make it a viable option for even the most conservative companies.
Recently at the SAS Global Forum Executive Conference I discussed some of these topics on a panel with SAS CEO Jim Goodnight, Cloudera co-founder Mike Olson and Hortonworks president Herb Cunitz.
Jim was the first to say he's seeing more customers use Hadoop for analytics, and the other panelists agreed, mentioning Hadoop use cases from MasterCard and the Financial Industry Regulatory Authority. Herb and Mike both talked about how the technology that started out in many IT shops is now catching the attention of business leaders too.
Watch the video below to hear us discuss the growing use of Hadoop in the cloud, and learn one thing that Jim says is stupid to do with Hadoop (hint: it involves a straw). Fair warning, if you stop watching too early, you won’t hear why boards of directors are suddenly paying attention to Hadoop now too.