Non-geeks want to know: will Hadoop mess up my data warehouse ecosystem?

Hadoop recently turned eight years old, but it was only 3-4 years ago that Hadoop really started gaining traction. It had many of us “older” BI/DW folks scratching our heads wondering what Hadoop was up to and if our tried-and-true enterprise data warehouse (EDW) ecosystems were in jeopardy. You didn't […]

Post a Comment

What is reference data harmonization?

A few weeks back I noted that one of the objectives on an inventory process for reference data was data harmonization, which meant determining when two reference sets refer to the same conceptual domain and harmonizing the contents into a conformed standard domain. Conceptually it sounds relatively straightforward, but as […]

Post a Comment

Cracking the code to successful conversions: infrastructure management

How many projects have you worked on that forgot to test size, volume, and conduct load balancing in a newly converted environment? I have worked on a few of those types of projects. I know in a data warehousing effort, we always check any servers and databases, based on load, […]

Post a Comment

Cracking the code for a successful conversion: establishing security

What kind of security do we need for this conversion?  In fact, where are the security people?  Including security personnel upfront in any conversion project can sure save some time and heartache later.  It is important to include security for the following: Source system access – You must be able […]

Post a Comment

Considerations for master data application services

In a tiered approach to facilitating master data integration, the most critical step is paving a path for applications to seamlessly take advantage of the capabilities master data management (MDM) is intended to provide. Those capabilities include unique identification, access to the unified views of entities, the creation of new entity […]

Post a Comment

Services approach to master data integration

In my last series of posts, we looked at one of the most common issues with master data management (MDM) implementation, namely integrating existing applications with a newly-populated master data repository. We examined some common use cases for master data and speculated about the key performance dimensions relevant to those […]

Post a Comment

Integration planning for master data management

A few years ago, I was presenting a morning course on master data management in which I shared some thoughts about some of the barriers to success in transitioning the use of a developed master data management index and repository into production systems. During the coffee break, an attendee mentioned […]

Post a Comment

SAS Federation Server, data virtualization and the logical data warehouse

Lately, there's been lots of buzz around the logical data warehouse (LDW). In fact, Gartner is hearing LDW mentions as part of data warehouse (DW) inquiries almost 20% of the time and considers it a "megatrend." The definition usually includes some use of data virtualization or data federation capabilities to complement […]

Post a Comment

Everything is "big data" these days – but where is the data management?

When I first began working in the data management industry in 2003, I interviewed a VP of IT for a Fortune 500 manufacturer about their data quality and data integration initiatives. The executive was excited to talk about their rather novel approach to a massive ERP system integration. She mentioned that instead […]

Post a Comment

Data integration: The changing nature of tools and experiences

When I first thought about writing a blog post about data management, picking a topic was an obvious, if daunting, first step. The challenges facing both IT and business are increasing in the era of bigger, more complex and more immediate data. My experience working with organizations across a variety […]

Post a Comment