Do you want to contribute to more effective investigation through data and technology? Within a government organization, a data warehouse is being built for operational data in investigation and intelligence. This team is looking for a software developer who can program well, has coaching skills, loves data, and wants to work with colleagues on a single product. The team collects, processes, models, and unlocks large and diverse data sources.
The data products are used by thousands of colleagues, including developers, analysts, and operational teams. Work is carried out according to LeSS (Large-Scale Scrum) with multiple development teams collaborating on a single product, a single product backlog, a single product owner, and a shared architecture.
What you will do.
- Responsible for the design and construction of complex and new components of the data platform.
- Take the lead in devising an approach when the solution is not yet known.
- Think about and take ownership of the architecture of solutions, patterns, and techniques, and build them together with the teams.
- Model complex domains and ensure that models, processing, and disclosure continue to work at scale.
- Analyze structural bottlenecks in the platform, such as scalability, performance, data quality, and traceability.
- Advise the product owner and the architecture community on improvements.
- Daily write, test, and maintain programming language for software and applications, together with team members.
- Act as a mentor and technical point of contact.
- Develop the professional maturity of the entire team, explore development needs, and coach colleagues to a higher level.
- Monitor the coherence of the shared product across multiple teams and maintain an overview of the whole.
Technology. The platform is largely built in-house, using open source and some purchased components. The data processed is larger, much more diverse, and has special performance requirements compared to an average data warehouse.
- Event and stream processing: Kafka, RabbitMQ
- Storage: PostgreSQL, Elasticsearch, Redis, object storage
- Platform: Kubernetes, Docker, Infrastructure as Code, GitLab CI/CD
- Data modeling: Large, complex data model with a focus on data quality and traceability.
- Security, authorization, and traceability are design requirements.
Profile
- Experience with coaching colleagues.
- Clear interest in data.
- Writes clean, tested C# code, can explain and defend a design, and helps colleagues.
- Data modeling and data architecture as a profession, not a byproduct.
- Preferably, designed and built complex data platforms, data products, or data warehouses.
- Knows which choices work and don't work at scale and can convincingly substantiate these choices.
- Still enjoys writing code and simultaneously oversees an architecture with multiple storage technologies, streaming, and batch.
- Creative in finding solutions.
- Builds and maintains a network within and outside the team.
- Receptive to feedback and able to help colleagues grow through coaching.
What they ask
- HBO (bachelor) working and thinking level, preferably in the ICT field.
- Minimum of 5 years of experience as a software engineer or data engineer, with extensive experience in a senior or lead role.
- In-depth knowledge of C#.NET (or related programming languages) and designing complex, distributed software architectures.
- Demonstrable experience with data modeling.
- Experience with event-driven and streaming processing (Kafka, RabbitMQ or similar) and with multiple storage technologies.
- Experience with test and/or quality frameworks within software development, Git and CI/CD, and setting them up for multiple teams.
- Good command of Dutch and English, both written and spoken.
Preferences.
- Extensive experience in designing and building data platforms or data warehouses for large data volumes, including data quality, lineage, and traceability.
- Orchestration with Airflow, Temporal or similar tooling.
- Kubernetes, Docker, and Infrastructure as Code.
- Working in a LeSS or other multi-team Scrum environment.
- Working on front-end, back-end, and testing.
- Data processing in a regulated environment (Wpg, AVG or similar).
How to apply
View the full assignment text and application details once your tailored application is ready.
Order a tailored application to view the full assignment and application details.
More context, less searching.
You get enough context to judge whether this job is relevant. The full brief, client details and next steps stay available inside the app.