A major player in the Belgian public sector is looking for an experienced Data Engineer (ETL/ELT) to contribute to the implementation and evolution of a company repository. The project aims to improve data quality, consistency, uniqueness, and reusability, while reducing duplications and supporting the "Only Once" principle.
What you will do.
- Design and implement data integration, consolidation, and quality control processes.
- Define mechanisms for generating and managing a unique company identifier.
- Establish rules for deduplication, consolidation, and source prioritization.
- Define mechanisms for managing conflicts between different data sources.
- Design and maintain data feeding chains using the FME platform.
- Define rules for data transformation, normalization, and consolidation.
- Implement connectors and flows necessary for data feeding and dissemination.
- Ensure traceability of data exchanges and adherence to architectural standards.
- Define and automate Data Quality Management rules.
- Implement controls for format, completeness, temporal consistency, uniqueness, and cross-validation.
- Utilize FME and DataLift for integration, transformation, and quality control activities.
- Design mechanisms for detecting duplicates, outliers, and inconsistencies between systems or sources.
- Contribute to the definition of data quality indicators and monitoring dashboards.
- Implement reporting mechanisms to track the evolution of anomalies and prioritize corrective actions.
- Develop automated processes for data cleaning, normalization, deduplication, enrichment, and correction.
- Identify root causes of quality problems and contribute to their resolution at the source.
- Establish a permanent data quality monitoring system.
- Monitor indicators of accuracy, completeness, consistency, uniqueness, freshness, and compliance.
- Participate in the resolution of technical incidents related to data.
- Document processes and tools to facilitate their maintenance and handover to internal teams.
- Provide technical support for the gradual connection of applications to the repository.
- Analyze the technical and functional impacts of various connections.
- Contribute to the definition and execution of functional, technical, and integration test scenarios.
Profile
We are looking for an experienced Data Engineer with solid experience in data integration, ETL/ELT, modeling, and Data Quality.
What they ask
- Knowledge of data governance principles, particularly frameworks such as DAMA.
- Confirmed experience in using ETL tools and data quality analysis tools, especially FME and Talend.
- Proficiency in processes for analyzing and designing database management systems.
- Confirmed proficiency in Data Quality Management processes, both theoretically and practically.
- Good understanding of data integration mechanisms, ETL/ELT, and inter-system exchanges.
- Ability to define and automate quality control and data validation rules.
- Ability to work on projects involving multiple data sources and different business and technical stakeholders.
Preferences.
- Experience in data modeling and conceptualization.
- Experience in setting up processes for deduplication, normalization, consolidation, and data cleaning.
- Experience in designing monitoring, reporting, and tracking mechanisms for quality indicators.
How to apply
View the full assignment text and application details once your tailored application is ready.
Order a tailored application to view the full assignment and application details.
More context, less searching.
You get enough context to judge whether this job is relevant. The full brief, client details and next steps stay available inside the app.