Data integration considerations for the data lake: The need for metadata

A few of our clients are exploring the use of a data lake as both a landing pad and a repository for collection of enterprise data sets. However, after probing a little bit about what they expected to do with this data lake, I found that the simple use of [...]

Post a Comment

Justifying the need for a data governance business case

Many people who plan data governance initiatives ignore the need for a business case. "We've already had approval for the project; why do we need a business case when we've got the budget signed off?" The perception is that because they have a strong commitment, there is no need to get [...]

Post a Comment

Drafting an operating model for data governance

The data governance “industry” thrives on a curious dichotomy. On the one hand, some service providers insist to clients that they need a data governance program, that they must create a data governance council and that they should immediately staff a collection of roles ranging from data governance council member [...]

Post a Comment

Data governance: The human resources analogy

Explaining data governance to a business community is difficult. Even more so when you need to convince business folks that they are pivotal to data governance success. Data governance demands not just business attention but business commitment. Policies and processes are not just tick boxes on a corporate charter; they are [...]

Post a Comment

Data modeling for data policy management

Operationalizing data governance means putting processes and tools in place for defining, enforcing and reporting on compliance with data quality and validation standards. There is a life cycle associated with a data policy, which is typically motivated by an externally mandated business policy or expectation, such as regulatory compliance. tags: [...]

Post a Comment

Struggling with data governance alignment? Look to history.

If your organization is large enough, it probably has multiple data-related initiatives going on at any given time. Perhaps a new data warehouse is planned, an ERP upgrade is imminent or a data quality project is underway. Whatever the initiative, it may raise questions around data governance – closely followed by discussions about the [...]

Post a Comment

ESP can determine if big data is eventful

Many recent posts on this blog have discussed various aspects of event stream processing (ESP) where data is continuously analyzed while it’s still in motion, within what are referred to as event streams. This differs from traditional data analytics where data is not analyzed until after it has stopped moving and has [...]

Post a Comment

Event stream processing – Tip 1: Don’t be overwhelmed

I believe most people become overwhelmed when considering the data that can be created during event processing. Number one, it is A LOT of data – and number two, the data needs real-time analysis. For the past few years, most of us have been analyzing data after we collected it, [...]

Post a Comment

Embedding event stream analytics

In my last two posts, I introduced some opportunities that arise from integrating event stream processing (ESP) within the nodes of a distributed network. We considered one type of deployment that includes the emergent Internet of Things (IoT) model in which there are numerous end nodes that monitor a set of sensors, [...]

Post a Comment