Data Streaming Engineer – Azure & Kafka

Our client, a prominent organization in the telecommunications sector, is looking for a Data Streaming Engineer to support their data transformation program. This role involves re-engineering the enterprise data platform and migrating systems to a modern Azure Cloud technology stack.

• Design and develop high-availability solutions for real-time data ingestion, processing, and serving.
• Collaborate with architects, data scientists, and project managers to drive the data transformation initiative.
• Develop generic frameworks for system monitoring and logging within the data ecosystem.
• Implement real-time processing workflows to handle large-scale data streams.
• Participate in the migration of on-premises data assets to the cloud platform.

• You bring 5+ years of experience in big data and data streaming engineering.
• You possess profound knowledge of backend development using Java and Python.
• You have extensive experience with Azure Cloud services, specifically ADLS, Azure Functions, and Event Hub.
• You have solid experience with real-time processing frameworks such as Spark Streaming and Kafka Streams.
• You possess knowledge of NoSQL databases like Couchbase.
• You have experience with CI/CD tools including Git, Jenkins, GitHub CI, and Nexus.
• You're a proactive team player with strong analytical and troubleshooting skills.
• You're able to work autonomously and cooperate effectively with onsite and offshore teams.
• You are fluent in English.

Nice to Haves

• Knowledge of Cloudera and Kafka on-premises operations.
• Experience with Azure Kubernetes Service (AKS).
• Familiarity with Flink or Databricks structured streaming in real-time mode.
• Knowledge of Dutch and/or French.

• Start date: ASAP
• Duration: 6 months
• Work regime: Full-time
• Location: Brussels
• Working model: Hybrid
• Contract: open to both permanent employees and freelancers