While big data is rife with potential, as Larry Greenemeier explained in his recent Scientific American blog post Why Big Data Isn’t Necessarily Better Data, context is often lacking when data is pulled from disparate sources, leading to questionable conclusions. His blog post examined the difficulties that Google Flu Trends
Teller, the normally silent half of the magician duo Penn & Teller, revealed some of magic’s secrets in a Smithsonian Magazine article about how magicians manipulate the human mind. Given the big data-fueled potential of data science to manipulate our decision-making, we should listen to what Teller has to tell
Were you a mother who listened to classical music during your pregnancy, or a parent who played classical music in your newborn baby’s nursery because you heard it stimulates creativity and improves intelligence? If so, do you know where this “classical music makes you smarter” idea came from? In 1993, a
With the increasing emphasis on responsiveness, resiliency, flexibility and agility, I suppose it was only a matter of time before the “agile” concept caught up with strategy itself. While I may have hinted at this idea four years ago in two of my earliest posts for the Value Alley, “Strategy
Dylan Jones says one way to improve data accuracy is to increase the frequency and quality of reality checks.
In my previous post, I outlined the main components needed for a phased approach to MDM. Now, let's talk about some of the other issues around approaching MDM: data governance and the move to enterprise MDM. Where does governance come in? Throughout your MDM program, it's important that deep expertise
The "Internet of Things" is the latest buzzword characterizing the machine-generated big data that has outstripped our ability to derive value from it. Think of UPS delivering 16 million packages every day through various hubs and all the logistics and decisioning that goes into that. But how does an organization
For decades, data quality experts have been telling us poor quality is bad for our data, bad for our decisions, bad for our business and just plain all around bad, bad, bad – did I already mention it’s bad? So why does poor data quality continue to exist and persist?
As the “Year of Statistics” comes to a close, I write this blog in support of the many statisticians who carefully fulfil their analysis tasks day by day, and to defend what may appear to be demanding behavior when it comes to data requirements. How do statisticians get this reputation? Are we
In my previous post, I used a game show metaphor for one aspect of metadata management, namely making sure table definitions are not ambiguously labeled. In this post, I will use name tags as a metaphor to discuss an important intersection of metadata management and master data management (MDM), an
Loraine Lawson recently used the Eight-Fold Path of Buddhism, in which practitioners are encouraged to pursue right views, intentions, speech, actions, livelihood, efforts, mindfulness and concentration, as inspiration for her blog post The Five-Fold Path for Ensuring Data = Information. The post offered five recommendations for ensuring that data is transformed into
Since tomorrow is How-long-has-it-been-since-you-used-this-data-ween, it’s time to review your organization’s preparedness for preventing the zombie data-pocalypse. (Please Note: This should not be confused with your organization’s preparedness for preventing the zombie apocalypse, for which check out the resources provided by the Centers for Disease Control and Prevention by ever-so-carefully clicking on
The third part of my data governance primer series addresses data quality analysis. Don’t even start a data quality analysis until you have completed the first two steps of your root cause analysis: investigate and prioritize any potential causative factors, then start your metadata assessment. Otherwise, you may be misled
In the era of big data, Kenneth Cukier and Viktor Mayer-Schonberger noted in their book Big Data: A Revolution That Will Transform How We Live, Work, and Think, “we are in the midst of a great infrastructure project that in some ways rivals those of the past, from the Roman aqueducts
My aunt Susanne is an elderly lady, who lives at the countryside and looks forward to celebrating her 80th birthday soon. Since the 1960's she has had a telephone connection with her fixed line provider. At that time, and for many years later, in the country where my aunt lives,
The second part of my data governance primer series addresses ways to "mind your metadata." I can just hear the collective groans, and perhaps a stifled yawn. Sorry, but metadata collection is one of those necessary evils that may not be fun, but having it available as a resource to
I've written, talked and thought about data management for an entire decade now. In that time, I've collected examples of how data – and the processes for managing that data – can affect our everyday life. For years I used the "Have you ever gotten multiple pieces of mail from
Dylan Jones (@dataqualitypro) shares an example of why data quality should be a business-as-usual practice.
Are your data quality metrics making the important measurable instead of making the measurable important?
Dylan Jones (@dataqualitypro) explains how data overloading occurs -- and how to find a better solution.
Don’t worry! This is not an excerpt from a romantic love letter. The title of this blog post is an allusion to my talk on "Missing Values", at the A2013 conference in June in London. There is not much time for emotions: dealing with missing values in analysis is not
I have encountered quite a few companies that are now anticipating the move of as many of their source systems as possible into SAP. I think this is probably a good decision for quite a few of these organizations. However, in doing so, we must keep or create data management
Joyce Norris-Montanari declares this the perfect time to prepare your data for 2013. See what her plans entail.
Blogger Dylan Jones offers 3 tips for more effective data profiling.
Do null sets always spell bad news? @philsimon says no. Find out why.
This is a dramatic interpretation of an actual conversation I recently had with the CIO of one of North Carolina’s leading cities. We discussed his experience using data quality, data integration, business intelligence and analytics in the daily operation of the city. I may have taken some...well, a lot of
The downturn in the economy beginning in 2008 and continuing even to now has put tremendous pressure on local governments to do “less with less”. In the past when economic downturns caused service level cut backs the cry was to do “more with less”. The idea was to identify ways
The recent mail bomb attempt on US-bound cargo and commercial airliners is another reminder of the terrorist threat the United States continues to face. While there may be a lull in the news cycles from time to time, the threat is there every day. A key component in detecting and
What's the Fifth Law of Data Quality? Jim Harris explains.
