Pauwels Consulting Logo
Apply now

Azure Databricks Platform Engineer – Terraform & Unity Catalog

Digital
Data
Bachelor
Advanced (5+)
Location
Aalst, East Flanders
Work type
Consultancy
Work model
Fulltime, Hybrid

Our client, a prominent government agency focused on environmental policy and climate adaptation, is looking for an engineer to establish a secure and scalable data environment. This role focuses on the technical design and automated rollout of a platform that enables data scientists to develop models and manage AI functionalities responsibly.

Responsibilities

  • Design and implement the technical architecture for a new Azure Databricks environment within a cloud-native infrastructure.
  • Translate data science platform requirements into a robust, reproducible setup using Terraform.
  • Configure Databricks workspaces, compute policies, repositories, and automated workflows.
  • Integrate platform solutions with Azure Data Lake Storage Gen2 and other relevant cloud resources.
  • Establish essential provisions for AI/ML workloads, including logging, monitoring, and cost control measures.
  • Develop technical documentation, architecture descriptions, and runbooks to facilitate knowledge transfer.

Requirements

  • You have 5+ years of experience as a Data Engineer.
  • You bring proven expertise in the configuration and deployment of Azure Databricks platforms using Terraform.
  • You possess strong experience with CI/CD workflows for Databricks using GitHub or Azure DevOps.
  • You have practical experience with Python, Java, or Scala for developing ETL processes and data streams.
  • You are fluent in Dutch with a C2 level.

Nice to Haves

  • In-depth knowledge of Unity Catalog and Security-by-Design principles.
  • Experience with AI/ML and data science platform infrastructure requirements.
  • Knowledge of Azure Data Lake Storage Gen2.
  • Possession of a Databricks certification.
  • Experience working within public sector organizations and their specific technical standards.

Offer

  • Start date: 01/09/2026
  • Duration: 4 months
  • Work regime: Full-time
  • Location: Aalst
  • Working model: Hybrid
  • Contract: open to both permanent employees and freelancers

Thank you for your interest. Unfortunately, job applications are not available in your region. To ensure a high-quality match for our clients and streamline the application process, we have certain regional limitations in place. We value all potential candidates and encourage you to explore opportunities with us in the future.

Chat with Alex
Not sure if this job is right for you? Chat with Alex, our AI career coach, and discover the vacancies that match your profile.