Predictive analytics and Hadoop: Challenges and solutions for managing the whole analytics lifecycle

So, you've heard the Hadoop hype and you are looking – or have already invested – into Hadoop. Maybe you have also realized some benefits from the Hadoop ecosystem. But now you want to maximize those benefits by using advanced analytics, or you might have heard about algorithms or machine learning libraries available for Hadoop that you want to try.

Indeed, there is a plethora of options in terms of analytic algorithms that you can use with Hadoop, ranging from open source developments such as Apache Maheout or Apache Spark, to commercial vendor tools that are capable of accessing Hadoop.

Since you might already be confused about what tools to use at this stage, my goal is to provide the information you need as you look ahead to analyzing data in Hadoop. Making successful use of advanced analytics requires more than a technology investment and a group of highly skilled data analysts. You should also think about managing processes and resources properly. So, before you jump ahead and make a decision as to what tools to use and how to equip data scientists with them, you may want to step back and think about why you are doing this.

Read More »

Post a Comment

Get your house in order to cash in on retail’s omnichannel promise

200317886Would you build a house without a proper foundation? Most of us wouldn’t dare, but that’s exactly what many retail businesses are doing today.

When building a house, if you don’t get the foundation right, paint, wallpaper and fixtures won’t matter much. It’s no different in the retail industry. Success stems from a solid foundation of decision insight built from customer, merchandise, supply chain, employee and operational data. Your business depends on reliable, understandable data you can act upon.

Retailers implement new bells-and-whistles technologies daily to improve interactions with consumers in their quest to reach the omnichannel summit. But trying to keep up with that type of technology is overwhelming and draining. Each new technology brings new data, which adds to the flood of data already in the retail environment. Read More »

Post a Comment

Reaching the new energy consumer

Whether it’s to reduce churn in competitive markets or to elevate customer satisfaction rankings in regulated markets, customer analytics is hot right now in utilities.

However, the complexity that utilities have built into their processes and technologies over the past decades makes customer analytics a more challenging issue to tackle than one might think.

In addition, the utilities relationship with customers is impacted by broader consumerization evident across all markets. Consumers are more digital and connected than ever before. This is just one of three mega-trends that is impacting the landscape for utility marketers.

Figure 1: The Changing Landscape of Utility Marketing

Figure 1: The Changing Landscape of Utility Marketing

Read More »

Post a Comment

How Hadoop emerged and why it gained mainstream traction

In the world of IT, very few new technologies emerge that are not built on what came before, combined with a new, emerging need or idea. The history of Hadoop is no exception.

To understand how Hadoop came to be, we therefore need to understand what went before Hadoop that led to its creation. To understand why Hadoop stagnated for a few years we need to understand how it was initially used. To understand why Hadoop is now accelerating in its adoption, we need to look at what is happening now and where we are headed.

Looking back at the phases of evolution that led to the emergence and incubation of Hadoop along with the current and future path of the technology can help us understand why it has gained in importance and where the hype is coming from. Read More »

Post a Comment

Data and analytics in sports: three things to consider

487704373It’s a great time to be a sports fan – and an even better time to be a sports and data fan as these two worlds continue to meld together. For the last couple of years nearly every conversation about sports, analytics or both had to have at least one mention of “Moneyball” – the story of how Billy Beane and the Oakland Athletics used data to create a strong team through a recruitment strategy that was often at odds with the established ways baseball scouts evaluated players.

Where granular telemetry information that needed processing in near-real time was once reserved for high-end auto racing, we’re not far from a world where it becomes pervasive in other sports. Think about being able to see a soccer player’s heart rate as he walks up the pitch to take decisive penalty shot. Or knowing how fast the hockey puck is moving as it slides behind the goalkeeper. Or something as seemingly trivial as being able to quickly find the closest restroom in a crowded sports venue.

The Oakland As are no longer alone in embracing a data-driven decision making model: many sports leagues, individual teams, and sporting venues are exploring ways to capture and track player performance data, understand what fans need, and improve overall fan experience. If you're interested in doing the same, consider these tips. Read More »

Post a Comment

Does U.S. health care overlook the fraud part of fraud, waste and abuse?

health care professionals in hospital hallwayThe U.S. health care market has always had practices in place to try and manage, or at least limit, aberrant behavior, which includes activities that are often described as cost containment, payment integrity and affordability.   

In the past, many organizations have appeared satisfied with their efforts in this area and have taken offense at any insinuation that they're not performing at optimum levels. 

When looking overall at aberrant behavior, however, studies suggest that fraud accounts for five to ten percent of cost of claims, whereas waste and abuse account for anywhere from twenty to thirty percent. You could dispute the numbers, since no one can accurately calculate the exact number (hence the range).  Clearly, though, the waste and abuse portion accounts for a larger exposure than fraud.

Read More »

Post a Comment

Why Captain Kirk is a role model for the Internet of Things

USS EnterpriseThe rumors, flying for many moons now, have turned out to be true. Followed by U2's new album release, Apple announced the launch of the Apple Watch for early 2015.

Apple has finally unveiled its first foray into wearable technology. The Apple Watch (yep, not the iWatch), is an Apple made smartwatch that was shown off during Apple's 9 September iPhone 6 event.

It includes a new dial, close integration with iCloud and Siri, and a flexible sapphire display. There's even more to read in this excellent Apple watch article from the Wired magazine.

300 years in the future, Starship Enterprise's Captain James T. Kirk talks to his crew via a communicator; has his medical officer assess medical conditions through a handheld. But you, as Star Trek fan from the very beginning, know that, right? His successors' devices and technology features become even more fancy: They hold meetings in virtual-reality chambers, called holodecks, and operate alien spacecraft using displays mounted on their foreheads.

But the point is: For me Apple's presentation brought back some good old childhood memories. If you were also watching Star Trek science fiction from time to time, you know what I mean. Read More »

Post a Comment

Will social banking become the norm?


For the first time in three years, there is a decline in positive banking experiences, according to the 2014 World Retail Banking Report from Capgemini. This is partly due to the trend that people between 18 and 34 want to conduct more of their banking through social media. However, most banks are not keeping up in this area.

In the 18-34 age group only 41.7 percent cited positive banking experiences, compared to 63.4 percent of those in other age groups. Banks have incorporated the Internet into their channel mix, and they have done enough to keep their customers satisfied, but now they are expected to go further.

A social banking example
The challenge for banks is to use social channels to revive the personal aspect of their customer experience – and social media fits this perfectly. One bank who did this well is Citibank. The Senior Vice President of Social Media at Citibank, Frank Eliason, realized that security is an important thing to consider, as he knew that giving account information on Twitter would be dangerous.

Here’s how Citibank succeeds at customer service on Twitter: when someone mentions Citibank or Citi in a tweet, the Citibank social team takes the conversation into Direct Messages. Then, they guide the person towards a chat application, so they can easily ask any question they have.

Read More »

Post a Comment

Searching for signs of life in the universe ... with SAS

99385267Light years from Earth, within the constellation Virgo, two galaxies crashed into one another. Not something you could’ve seen peering into the night sky with the naked eye.

We know it happened because astronomers pieced together images from several powerful telescopes to create what CBS News called a “cosmic magnifying glass.” With it, they documented an otherwise imperceptible event.

A video illustrating their discovery is startling – and thought provoking.

It brought to mind an amateur astronomer in Chicago named Robert H. Gray, who uses SAS in his search for radio signals from other worlds.

Yes, you read that right. SAS has a role in searching the universe for intelligent life!

Read More »

Post a Comment

A day in the life with my connected car



In the morning at 6am my iPhone buzzes. But it is not the alarm clock, rather it's important information from an app.

What is this, I think to myself and look sleepily at the screen: "Danger of black ice! Already 15 km traffic jam on the A3 towards Cologne! Recommendations: Suggest alternative route via the A61 and move up your departure time from 8:00 to 7:00 am."

So, I trot out of bed and into the shower. Showered and in a suit, I sit down at the breakfast table. It's 6:45 am. Again, the iPhone vibrates, "Seat and window heater in operation." Very nice … so I don`t have to start the defrosting myself.

Read More »

Post a Comment