Data Engineer – Kafka & Elasticsearch

Our client, a prominent organization in the public sector, is seeking an experienced professional to support their digital transformation through the design and management of an event-driven data architecture. The project focuses on implementing high-performance data pipelines to ensure scalability and observability from data ingestion to consumption.

• Design, implement, and manage event-driven architectures using Apache Kafka as a core buffer and processing layer.
• Build and maintain Elasticsearch stacks, including indexing strategies and lifecycle management for structured and unstructured data.
• Develop a data service layer using REST APIs and microservices to make data available for analysis and monitoring.
• Deploy and orchestrate data components within Docker, Kubernetes, and OpenShift environments.
• Optimize data pipelines and ensure system observability through GitLab CI and Python scripting.
• Ensure data consistency across the entire ecosystem while implementing robust error handling and performance tuning.
• Document technical configurations, schemas, and architectural choices to maintain high standards of knowledge transfer.

• 3+ years of experience with Apache Kafka, including Kafka Streams, Connect, Schema Registry, Avro, and ksqlDB.
• 3+ years of experience with Elasticsearch, covering Kibana, ingest pipelines, and index lifecycle management.
• You possess strong knowledge of container orchestration using Docker, Kubernetes, and OpenShift.
• You have experience developing data service layers through REST APIs and microservices.
• You bring proficiency in Python scripting and experience with PostgreSQL databases.
• You're familiar with CI/CD tools, specifically GitLab CI, for automating data pipelines.
• You have expertise in observability, error handling, and the optimization of complex data systems.
• You are methodical and precise, with a strong ability to document technical architectures and configurations.
• You are proactive and solution-oriented, thriving in multidisciplinary team environments.
• You have active knowledge of Dutch, French, and English.

Nice to Haves

• Willingness to adapt to flexible schedules within a complex technical environment.

• Start date: 01/09/2026
• Duration: 4 months (plus extensions)
• Work regime: Full-time
• Location: Brussels
• Working model: Hybrid (minimum 2 days per week onsite)
• Contract: open to both permanent employees and freelancers