Managing big data, Part 2: Human questions and considerations
.@philsimon on the soft skills that Big Data requires.
Tag: data management
Is your data self-service?
I don’t know about you, but I'm asked every day where some type of data lives in our enterprise. I keep thinking that we have not done a good job of helping people learn to help themselves! A few things I have learned about corporate data assets are: The data
Apache YARN to become “the operating system for your data”
It’s been an amazing journey with Hadoop. As we discussed in an earlier blog, Hadoop is informing the basis of a comprehensive data enterprise platform that can power an ecosystem of analytic applications to uncover rich insights on large sets of data. With YARN (Yet Another Resource Negotiator) as its
Data integration – Job skills required for success
Data integration, on any project, can be very complex – and it requires a tremendous amount of detail. The person I would pick for my data integration team would have the following skills and characteristics: Has an enterprise perspective of data integration, data quality and extraction, transformation and load (ETL): Understands
Big data model convergence: Combining metadata and data virtualization as a collaboration tool - Part 2
I am currently cycling through a schema-on-read data modeling process on a specific task for one of my clients. I have been presented with a data set and have been asked to consider how that data can be best analyzed using a graph-based data management system. My process is to
Data integration considerations for the data lake: The need for metadata
A few of our clients are exploring the use of a data lake as both a landing pad and a repository for collection of enterprise data sets. However, after probing a little bit about what they expected to do with this data lake, I found that the simple use of
Justifying the need for a data governance business case
Many people who plan data governance initiatives ignore the need for a business case. "We've already had approval for the project; why do we need a business case when we've got the budget signed off?" The perception is that because they have a strong commitment, there is no need to get
Drafting an operating model for data governance
The data governance “industry” thrives on a curious dichotomy. On the one hand, some service providers insist to clients that they need a data governance program, that they must create a data governance council and that they should immediately staff a collection of roles ranging from data governance council member
Data governance: The human resources analogy
Explaining data governance to a business community is difficult. Even more so when you need to convince business folks that they are pivotal to data governance success. Data governance demands not just business attention but business commitment. Policies and processes are not just tick boxes on a corporate charter; they are
Data modeling for data policy management
Operationalizing data governance means putting processes and tools in place for defining, enforcing and reporting on compliance with data quality and validation standards. There is a life cycle associated with a data policy, which is typically motivated by an externally mandated business policy or expectation, such as regulatory compliance.