You will be part of a B2B platform whose main mission is to serve B2B clients with electricity/gas, products and services, and green energy. The platform consists of approximately 180 people, including 125 on the business side and 55 on the IS and data side.
What you do
We are looking for an experienced Data Engineer to join the Data team of an organization. You will be responsible for designing and implementing scalable, efficient, and robust data solutions, pipelines, and models, in line with internal standards. The objective is to support current and future data-driven initiatives. Close collaboration with cross-functional teams, analysts, and project managers is essential to ensure that data is available, accessible, and exploitable.
Responsibilities.
- Design, implement, and maintain scalable data architectures (databases, data lakes on AWS, data warehouses), consistent with existing tools and frameworks.
- Build and optimize ETL (Extract, Transform, Load) processes to transfer data from various sources to the warehouses.
- Combine diverse data sources into coherent and unified views (gold datasets) for analysis and reporting.
- Ensure data consistency, quality, and reliability throughout its lifecycle.
- Manage and optimize data infrastructure (storage, processing, restitution) in terms of efficiency, capacity, and costs.
- Play a Tech Lead role to mentor other Data Engineers and promote good development practices.
- Develop and maintain data processing code in Python, Spark, SQL, and automate regular executions.
- Collaborate with cross-functional teams, analysts, and developers to understand data needs and deliver suitable solutions.
- Interact with business stakeholders to gather and understand their data-related needs.
- Work with various teams to ensure the scalability, security, and performance of data systems.
- Create and maintain comprehensive documentation of data processes, pipelines, and architectures.
- Monitor the production systems of the data platform.
- Share best practices with all data, IT, and business stakeholders.
What they ask
- Proven experience as a Senior Data Engineer or similar position.
- Confirmed experience in managing data platforms.
- Proficiency in AWS services: S3, Athena, Glue, Redshift.
- Proficiency in Databricks (ideally on AWS).
- Strong skills in Python, Spark, SQL, or other data engineering languages.
- Experience with data processing technologies.
- Knowledge of Agile methodologies (Scrum, Kanban).
- Knowledge of Dataiku.
- Knowledge of Azure DevOps and release pipelines.
- AWS Cloud Data Engineer certification.
Assets.
- Knowledge of systems such as Salesforce, SAP ISU.
- Knowledge of Agile tools such as Azure DevOps or Jira.
- Familiarity with financial closing reports is a plus.
- Other AWS certifications (Solution Architect, Systems Administrator).
Profile
- Team spirit.
- Good communication, especially for vulgarizing technical concepts to non-technical managers.
- Ability to work in a multicultural and international environment.
- Adaptability to technological evolutions and changing project needs.
- Rigorous organization and attention to detail.
- Bachelor's or Master's degree.
- Minimum 5 years of experience as a Data Engineer or in a similar role.
Languages.
- Proficiency in Dutch or French.
- Proficiency in English.
How to apply
View the full assignment text and application details once your tailored application is ready.
Order a tailored application to view the full assignment and application details.
More context, less searching.
You get enough context to judge whether this job is relevant. The full brief, client details and next steps stay available inside the app.