Data integration, on any project, can be very complex – and it requires a tremendous amount of detail. The person I would pick for my data integration team would have the following skills and characteristics:
- Has an enterprise perspective of data integration, data quality and extraction, transformation and load (ETL):
- Understands data quality, data profiling and ETL tools.
- Understands the need for enterprise data management:
- Including data modeling for the enterprise and each data integration project.
- Understands database performance for load and retrieval of data:
- This should include indexing, partitioning and views.
- Reporting environment implementation.
- Propagating data to other systems (if necessary).
- Possesses the ability to write highly optimized SQL and/or consult with developer to achieve results:
- Once in a while we have to “roll our sleeves up” and help out.
- Code reviews and testing will be required.
- Participates in gathering and prioritizing the requirements:
- Collaborates in writing the scope, requirements and detailed technical document.
- Is a MASTER at spreadsheets:
- Mapping from one or more sources to a target requires documentation on the process, quality of the data, anticipated values and any other technical notes required for the data integration project.
- Works well with others in a complex, intense development environment.
- Possesses leadership skills:
- Working and delegating to other team members.
- Reporting progress to project managers and upper management (when required).
- PowerPoint is a MUST.
Sounds like a SUPER person doesn’t it? Actually, data integration requires a super-person who understands the business needs and can articulate that information into technical documents. Not an easy job to fill, and it may take multiple people to accomplish these tasks. If you find someone with these qualities, hang onto this person. They are worth their weight in gold.
SAS is a leader in Gartner Magic Quadrant for data integration tools for the fifth consecutive year.