For a SaaS software company, a data warehouse is being built alongside an application. Customers currently run their reports on the live database. Each customer environment will receive its own data warehouse. A concept with ClickHouse is already running for a first customer. The goal is for customers to be able to work independently with their data, with AI and their own reports. The team consists of approximately 15 experienced developers in product teams and a small platform team.
What you do
- Finalize the data warehouse concept so that reports no longer run on the live database
- Advise on ClickHouse Cloud or self-hosted, including pros, cons
- Set up data synchronization from MySQL/MariaDB to the data warehouse using standard CDC/ETL tooling
- Automate the rollout per customer environment in the existing CI/CD pipeline, together with the team
- Set up Docker, security, monitoring, and logging and coordinate with the hosting partner
- Document and transfer, so the team can manage it themselves afterwards
What they ask
- Previously set up a data warehouse alongside an application
- Minimum 5 years of experience as a data, platform, or DevOps engineer
- Production experience with ClickHouse or another analytical database, such as StarRocks, BigQuery
- Experience with CDC or ETL between a relational and an analytical database, and with Docker and CI/CD
- You advise, involve the team in choices, and ask questions if something is incorrect
- You speak Dutch or English
- Plus: GitLab CI and experience with both ClickHouse Cloud and self-hosted
How to apply
View the full assignment text and application details once your tailored application is ready.
Order a tailored application to view the full assignment and application details.
More context, less searching.
You get enough context to judge whether this job is relevant. The full brief, client details and next steps stay available inside the app.