Ten "big data" Insights from Google, Adobe, TED, DARPA and more

4

Every day we hear more about the impact of big data: 900 million users posting status updates and uploading images to Facebook, 140 million Twitter users generating 400 million tweets per day, smart grids optimizing electricity utilization, and sensors optimizing traffic flow on highways or factory floors. But, how do we manage this onslaught of data? How do we determine which information is relevant? And, how do we ensure that our information is trusted?

Last week SAS sponsored and I attended the Economist “Big Data” Information conference which focused on how Big Data, social media, and smart sensors are transforming the world and attempting to answer these questions.  SAS is making huge waves in this space with our high-performance analytics (HPA), visual analytics and big data information management offerings. HPA, for example, leverages grid arrays of big data, in-memory, and in-database technologies to optimize your business decisions (like predicting churn or likelihood of loan default) by speeding computations that would normally take hours or weeks into taking only minutes or seconds.

Conference attendees and speakers were made up of a veritable litany of technology rockstars and many thought leaders who are putting their own “dents in the universe”, to quote Steve Jobs. It would be challenging to distill the amount of brainpower and ideas in the room into even 10 blog entries, but some of the more noteworthy paraphrased quotes, questions or concepts included:

  1. "When the world changes, correlation goes away… Causals are what endure." -  Geoffrey Nunberg, UCAL Berkeley
  2. "Measuring more makes you more certain about the world." - Jeff Hammerbacher, Cloudera
  3. Every day, thousands of transactions between doctors and patients, insurance companies and members are being made with healthcare data. - Jon Bush, CEO, Athena Health
  4. "The Internet is a nervous system in the process of being born and we are all part of it." - Juliette Powel, Author of VibrantData.org  quoting  John Perry Barlow
  5. For every doubling of the size of a city, there is a 15 percent increase in every economic indicator (capital, crime, patents, wages) and a 15 percent savings on infrastructure costs. All companies die, but cities don't die. Unbounded growth requires accelerating cycles of innovation or else the system will collapse. - Geoffrey West, Theoretical Physicist, Santa Fe Institute
  6. "Gamifying" photoshop badges for work (ie., "Mayor with Most Layers") similar to Foursquare.  - Kevin Lynch, CTO, Adobe
  7. Nowcasting is predicting the present . "401k" as search term is a predictor of a bad economy. - Hal Varian, Chief Economist, Google
  8. Invests in companies that own the data generator not just the data. - Max Levchin, Kaggle.com
  9. Building out Android apps to assist troops in theatre incorporating movement maps and IED blast sensors to save lives. - Mari Maeda, DARPA
  10. "Learning is remembering what you are interested in."  - Richard Saul Wurman, Creator, TED

And here's a bonus of two more insights from Wurman:

  1. There are only 5 ways to organize information: location, alphabetic, random, categorical, and chronological.
  2. A good question is better than a brilliant answer.

I found the conference enlightening and intellectually thrilling. One co-founder of a big data startup said that he thought "it was a moral imperative" to leverage this ever increasing volume of information to help change the world. How's that for making a dent in the universe?

Learn more from "big data" experts in this special 32-page report on high-performance analytics.

Share

About Author

Matthew Magne

Principal Product Marketing Manager

@bigdatamagnet - Matthew is a TEDx speaker, musician, and Catan player. He is currently the Global Product Marketing Manager for SAS Data Management focusing on Big Data, Master Data Management, Data Quality, Data Integration and Data Governance. Previously, Matthew was an Information Management Solutions Architect at SAS, worked as a Certified Data Management Consulting IT Professional at IBM, and is a recovering software engineer and entrepreneur. Mr. Magne received his BS, cum laude, in Computer Engineering at Boston University, has done graduate work in Object Oriented Development and completed his MBA at UNCW.

4 Comments

  1. Great insight Matt and thanks for the posting. If he knew then, I wonder if Douglas Adams would have a different entry on planet earth in the Hitchhikers Guide to the Galaxy?

  2. Geoffrey West's findings (they were partially published in recent issue of The Economist) makes me quite skeptical - though I have to dig in them in more details

    But can you explain little bit what Nunberg meant about correlation and causals?

    • Hi Barouth,
      West also showed metabolism in all mammals is log related to body mass (slope of 3/4) - bigger you are the less energy you need per cell to stay alive. Really interesting stuff.

      My take on what Nunberg was saying = he was just pointing out the fact that correlation does not imply causation. If you throw enough data at a problem, you might get different correlations- but, you still need to bring insight, focus and understanding to big data to make sense of the results as opposed to blind faith in the data. You can click on the "World of Big Data" video to see the full discussion on the conference page: http://www.economist.com/events-conferences/americas/information-2012

Back to Top