Azure Data Engineer

Il y a 2 heures

Arrondissement of BrusselsCapital, Brussels, Belgique TiTANS België Temps plein
h3Context /h3 pAs part of its 2027 roadmap, STIB-MIVB is continuing to modernize and optimize its Data Platform. Following the migration of non-SAP data to Azure, our key priorities include: /p ul liDeveloping new business use cases to support reporting, analytics, and Data Science. /li liStrengthening data governance through Databricks Unity Catalog. /li liExpanding our self-service data strategy to empower business teams while ensuring proper governance and security. /li liMonitoring and optimizing Azure and Databricks consumption and costs to improve platform efficiency. /li liContinuously improving our Data Platform architecture, focusing on performance, scalability, and reliability. /li /ul pTo support these initiatives, we are looking for an experienced Azure Data Engineer with strong expertise in Azure Databricks and Unity Catalog to strengthen our Data Analytics team. /p h3Main Mission: /h3 pAs an Azure Data Engineer, you will play a key role in the continuous development, optimization, and governance of STIB-MIVB's Data Platform. /p pYou will design, develop, and maintain reliable and scalable data solutions on Microsoft Azure, while contributing to the evolution of our Azure Databricks architecture. /p pYou will also help implement data governance and self-service capabilities using Unity Catalog, monitor platform consumption and costs, and ensure that our Data Platform meets business needs in terms of performance, security, and reliability. /p h3Key

Responsibilities:
/h3 ul liDesign and develop data pipelines using Azure Data Factory, Databricks, and other Azure services. /li liImplement modern data architectures (Data Lake, Delta Lake, Lakehouse). /li liDevelop and industrialize new business use cases. /li liContribute to the implementation and management of Databricks Unity Catalog (catalogs, schemas, permissions, data sharing, and governance). /li liSupport the implementation of a self-service data strategy. /li liMonitor and optimize Azure and Databricks performance, resource consumption, and costs. /li liAutomate data ingestion, transformation, and deployment processes. /li liCollaborate with Data Analysts, Data Scientists, and business stakeholders. /li liDocument data flows, architecture, and best practices. /li liContribute to the maintenance and continuous improvement of the Azure Data Platform. /li /ul h3Required Technical

Skills:
/h3 ul liHands‑on experience with Databricks Unity Catalog, including access management, security, and data governance. /li liStrong knowledge of Azure Databricks architecture, including Lakehouse design, scalability, security, and best practices. /li liExperience with Spark, PySpark, and Delta Lake. /li liStrong skills in SQL and Python. /li liExperience with monitoring, performance tuning, and cost optimization in Azure and Databricks. /li liKnowledge of CI/CD principles applied to data engineering. /li liKnowledge of application integration patterns (REST API, AMQP). /li /ul h3Profile: /h3 ul liDegree in Computer Science, Data Engineering, or a related field. /li liMinimum 5 years of experience in a similar role. /li liProven experience with Azure Databricks, Unity Catalog, and Azure data architecture. /li liAnalytical mindset, autonomy, problem‑solving skills, and team spirit. /li liStrong communication skills and ability to explain technical concepts clearly. /li /ul h3Nice to Have: /h3 ul liMicrosoft Azure or Databricks certifications. /li liExperience with Power BI administration and governance. /li liExperience with real‑time data streaming. /li liExperience with Terraform or Infrastructure as Code. /li liFamiliarity with Azure Monitor and Log Analytics. /li liBasic SAP knowledge (S/4HANA or BW/4HANA as data sources). /li liExperience working in Agile/Scrum environments. /li /ul pIf you enjoy working with modern data technologies and want to contribute to the future of mobility in Brussels, we'd love to hear from you /p h3Skills /h3 ul liDatabricks
- Expert /li liDatabricks Unity Catalog
- Expert /li liPower BI
- Advanced /li liPython
- Expert /li liSpark
- Expert /li liSQL
- Expert /li /ul h3Languages /h3 ul liDutch or French
- Native or bilingual proficiency /li liEnglish
- Professional working proficiency /li /ul