Do you want to contribute to a data-driven government organization, the entity behind critical government services? You will help build a future-proof data platform on a private cloud, based on modern, open-source tooling. As a Data Platform Engineer, you will work at the intersection of platform engineering, data engineering, and software development. You play a key role in developing a secure, scalable, and user-friendly platform.
What you will do. You will join a data team focused on serving internal colleagues who are involved with the provisions. You will ensure the next professionalization step for the platform, working towards a modern lakehouse architecture with Kubernetes on a private cloud, using open-source tooling. You will work on the technical foundation of the platform to make data securely and scalably accessible. You will also act as a point of contact for technical questions.
Possible activities.
- Develop and maintain the private-cloud environment (based on Kubernetes) and automate processes with CI/CD and GitOps.
- Implement and improve security controls: encryption, key management, network segmentation.
- Build robust data pipelines and data models (SQL, dbt).
- Oversee data quality by implementing monitoring, alerting, and data quality tests.
- Implement authentication, authorization (RBAC), and data-masking (for PII data).
- Improve the developer experience with scripts, tooling, or the development of web-apps and APIs.
- Develop Proof of Concepts with AI and contribute ideas on MLOps integration.
- Advise data owners and collaborate with data suppliers on data access.
What they ask
- HBO/WO (higher professional education/university) work and thinking level.
- Extensive experience with Kubernetes, Docker, CI/CD, and IaC tools such as Helm.
- Several years of experience with setting up data pipelines and data modeling (SQL, dbt, Spark).
- Experience with security (authorization, network) in data platforms, e.g., IAM policies, RBAC, firewalls, proxies.
- Knowledge of AI; the regulations, risks, and opportunities from a data-driven environment.
Profile
- You take initiative, have a clear vision, and dare to express it with a pragmatic approach.
- You can clearly communicate technical concepts to both technical and non-technical stakeholders and contribute to knowledge sharing.
- You take responsibility for your own work, ask for and provide help, and deliver work you are proud of with a critical eye and attention to detail.
- You are a team player and can collaborate effectively.
How to apply
View the full assignment text and application details once your tailored application is ready.
Order a tailored application to view the full assignment and application details.
More context, less searching.
You get enough context to judge whether this job is relevant. The full brief, client details and next steps stay available inside the app.