How to improve your data profiling performance

Data profiling is a core technique of data quality management and often the starting point for so many projects these days. Because it’s such a relatively simple technique to apply, it’s easy to overlook some of the more advanced techniques that can take your data profiling to the next level. […]

Post a Comment

Innovation needs contamination

In his book Where Good Ideas Come From: The Natural History of Innovation, Steven Johnson explained that “error is not simply a phase you have to suffer through on the way to genius. Error often creates a path that leads you out of your comfortable assumptions. Being right keeps you in […]

Post a Comment

Leaders need to shine a light on their data

These days there is endless talk about data: how to use it, how to value it, where to get it, how to secure it and when to measure it. Data is pervasive, and it is beginning to influence our society with increasing impact and accelerating velocity. Let’s examine the effect on the […]

Post a Comment

Creating the data quality franchise

One of the growing trends I’m witnessing when talking to Data Quality Pro’s guest interviewees is the use of federated data quality tactics. The idea is a simple but compelling one. Rather than having a large team that manages data quality across the organisation, you create satellite teams that adopt […]

Post a Comment

Lean against bias for accurate analytics

We sometimes describe the potential of big data analytics as letting the data tell its story, casting the data scientist as storyteller. While the journalist has long been a newscaster, in recent years the term data-driven journalism has been adopted to describe the process of using big data analytics to […]

Post a Comment

Struggling to get started with data quality? Start with data lineage

Many people don’t know where to start with data quality. They get bogged down with questions on dimensions, ownerships, rules and tools. The problem can seem too vast to even begin making sense of their data landscape, let alone transforming it into a well-governed and high-quality asset. A lot of […]

Post a Comment

SAS Master Data Management: a smarter approach to a unified view

Sometimes you have to get small to win big. SAS Data Management breaks solution capabilities into smaller chunks – and deploys services as needed – to help customers reduce their total cost of ownership. SAS Master Data Management (MDM) is also a pioneer in "phased MDM." It's built on top of a data […]

Post a Comment

Are you making data quality a design task?

Ask any battle-hardened data quality practitioner and they will tell you that one of the leading causes of data quality defects stems from an inability to design quality into information systems. I am going to take a specific example of bad system design to explain how data defects quickly become […]

Post a Comment

Big data hubris

While big data is rife with potential, as Larry Greenemeier explained in his recent Scientific American blog post Why Big Data Isn’t Necessarily Better Data, context is often lacking when data is pulled from disparate sources, leading to questionable conclusions. His blog post examined the difficulties that Google Flu Trends […]

Post a Comment

Re-thinking issue management

For most organisations, issue management is seen as an administrative chore. Scattered across the organisation, data workers diligently resolve issues often via their own local issue management process. With silos of data comes silos of maintenance, and this is a real shame because the data these systems possess is a […]

Post a Comment