Azure Databricks Platform Engineer – Terraform & Unity Catalog

Our client, a prominent government agency focused on environmental policy and climate adaptation, is looking for an engineer to establish a secure and scalable data environment. This role focuses on the technical design and automated rollout of a platform that enables data scientists to develop models and manage AI functionalities responsibly.

• Design and implement the technical architecture for a new Azure Databricks environment within a cloud-native infrastructure.
• Translate data science platform requirements into a robust, reproducible setup using Terraform.
• Configure Databricks workspaces, compute policies, repositories, and automated workflows.
• Integrate platform solutions with Azure Data Lake Storage Gen2 and other relevant cloud resources.
• Establish essential provisions for AI/ML workloads, including logging, monitoring, and cost control measures.
• Develop technical documentation, architecture descriptions, and runbooks to facilitate knowledge transfer.

• You have 5+ years of experience as a Data Engineer.
• You bring proven expertise in the configuration and deployment of Azure Databricks platforms using Terraform.
• You possess strong experience with CI/CD workflows for Databricks using GitHub or Azure DevOps.
• You have practical experience with Python, Java, or Scala for developing ETL processes and data streams.
• You are fluent in Dutch with a C2 level.

Nice to Haves

• In-depth knowledge of Unity Catalog and Security-by-Design principles.
• Experience with AI/ML and data science platform infrastructure requirements.
• Knowledge of Azure Data Lake Storage Gen2.
• Possession of a Databricks certification.
• Experience working within public sector organizations and their specific technical standards.

• Start date: 01/09/2026
• Duration: 4 months
• Work regime: Full-time
• Location: Aalst
• Working model: Hybrid
• Contract: open to both permanent employees and freelancers