Azure Data Engineer
Il y a 2 heures
Arrondissement of BrusselsCapital, Brussels, Belgique
TiTANS België
Temps plein
Gratuit avec email ou Google
Enregistrez cette offre et organisez votre recherche
Créez un compte gratuit pour enregistrer des offres d'emploi, créer des alertes et revenir à cette liste depuis votre tableau de bord.
Gratuit avec email ou Google
En continuant, vous acceptez nos Conditions d’utilisation & Politique de confidentialité.
h3Context /h3 pAs part of its 2027 roadmap, STIB-MIVB is continuing to modernize and optimize its Data Platform. Following the migration of non-SAP data to Azure, our key priorities include: /p ul liDeveloping new business use cases to support reporting, analytics, and Data Science. /li liStrengthening data governance through Databricks Unity Catalog. /li liExpanding our self-service data strategy to empower business teams while ensuring proper governance and security. /li liMonitoring and optimizing Azure and Databricks consumption and costs to improve platform efficiency. /li liContinuously improving our Data Platform architecture, focusing on performance, scalability, and reliability. /li /ul pTo support these initiatives, we are looking for an experienced Azure Data Engineer with strong expertise in Azure Databricks and Unity Catalog to strengthen our Data Analytics team. /p h3Main Mission: /h3 pAs an Azure Data Engineer, you will play a key role in the continuous development, optimization, and governance of STIB-MIVB's Data Platform. /p pYou will design, develop, and maintain reliable and scalable data solutions on Microsoft Azure, while contributing to the evolution of our Azure Databricks architecture. /p pYou will also help implement data governance and self-service capabilities using Unity Catalog, monitor platform consumption and costs, and ensure that our Data Platform meets business needs in terms of performance, security, and reliability. /p h3Key
Responsibilities:
/h3 ul liDesign and develop data pipelines using Azure Data Factory, Databricks, and other Azure services. /li liImplement modern data architectures (Data Lake, Delta Lake, Lakehouse). /li liDevelop and industrialize new business use cases. /li liContribute to the implementation and management of Databricks Unity Catalog (catalogs, schemas, permissions, data sharing, and governance). /li liSupport the implementation of a self-service data strategy. /li liMonitor and optimize Azure and Databricks performance, resource consumption, and costs. /li liAutomate data ingestion, transformation, and deployment processes. /li liCollaborate with Data Analysts, Data Scientists, and business stakeholders. /li liDocument data flows, architecture, and best practices. /li liContribute to the maintenance and continuous improvement of the Azure Data Platform. /li /ul h3Required Technical
Skills:
/h3 ul liHands‑on experience with Databricks Unity Catalog, including access management, security, and data governance. /li liStrong knowledge of Azure Databricks architecture, including Lakehouse design, scalability, security, and best practices. /li liExperience with Spark, PySpark, and Delta Lake. /li liStrong skills in SQL and Python. /li liExperience with monitoring, performance tuning, and cost optimization in Azure and Databricks. /li liKnowledge of CI/CD principles applied to data engineering. /li liKnowledge of application integration patterns (REST API, AMQP). /li /ul h3Profile: /h3 ul liDegree in Computer Science, Data Engineering, or a related field. /li liMinimum 5 years of experience in a similar role. /li liProven experience with Azure Databricks, Unity Catalog, and Azure data architecture. /li liAnalytical mindset, autonomy, problem‑solving skills, and team spirit. /li liStrong communication skills and ability to explain technical concepts clearly. /li /ul h3Nice to Have: /h3 ul liMicrosoft Azure or Databricks certifications. /li liExperience with Power BI administration and governance. /li liExperience with real‑time data streaming. /li liExperience with Terraform or Infrastructure as Code. /li liFamiliarity with Azure Monitor and Log Analytics. /li liBasic SAP knowledge (S/4HANA or BW/4HANA as data sources). /li liExperience working in Agile/Scrum environments. /li /ul pIf you enjoy working with modern data technologies and want to contribute to the future of mobility in Brussels, we'd love to hear from you /p h3Skills /h3 ul liDatabricks
- Expert /li liDatabricks Unity Catalog
- Expert /li liPower BI
- Advanced /li liPython
- Expert /li liSpark
- Expert /li liSQL
- Expert /li /ul h3Languages /h3 ul liDutch or French
- Native or bilingual proficiency /li liEnglish
- Professional working proficiency /li /ul
Responsibilities:
/h3 ul liDesign and develop data pipelines using Azure Data Factory, Databricks, and other Azure services. /li liImplement modern data architectures (Data Lake, Delta Lake, Lakehouse). /li liDevelop and industrialize new business use cases. /li liContribute to the implementation and management of Databricks Unity Catalog (catalogs, schemas, permissions, data sharing, and governance). /li liSupport the implementation of a self-service data strategy. /li liMonitor and optimize Azure and Databricks performance, resource consumption, and costs. /li liAutomate data ingestion, transformation, and deployment processes. /li liCollaborate with Data Analysts, Data Scientists, and business stakeholders. /li liDocument data flows, architecture, and best practices. /li liContribute to the maintenance and continuous improvement of the Azure Data Platform. /li /ul h3Required Technical
Skills:
/h3 ul liHands‑on experience with Databricks Unity Catalog, including access management, security, and data governance. /li liStrong knowledge of Azure Databricks architecture, including Lakehouse design, scalability, security, and best practices. /li liExperience with Spark, PySpark, and Delta Lake. /li liStrong skills in SQL and Python. /li liExperience with monitoring, performance tuning, and cost optimization in Azure and Databricks. /li liKnowledge of CI/CD principles applied to data engineering. /li liKnowledge of application integration patterns (REST API, AMQP). /li /ul h3Profile: /h3 ul liDegree in Computer Science, Data Engineering, or a related field. /li liMinimum 5 years of experience in a similar role. /li liProven experience with Azure Databricks, Unity Catalog, and Azure data architecture. /li liAnalytical mindset, autonomy, problem‑solving skills, and team spirit. /li liStrong communication skills and ability to explain technical concepts clearly. /li /ul h3Nice to Have: /h3 ul liMicrosoft Azure or Databricks certifications. /li liExperience with Power BI administration and governance. /li liExperience with real‑time data streaming. /li liExperience with Terraform or Infrastructure as Code. /li liFamiliarity with Azure Monitor and Log Analytics. /li liBasic SAP knowledge (S/4HANA or BW/4HANA as data sources). /li liExperience working in Agile/Scrum environments. /li /ul pIf you enjoy working with modern data technologies and want to contribute to the future of mobility in Brussels, we'd love to hear from you /p h3Skills /h3 ul liDatabricks
- Expert /li liDatabricks Unity Catalog
- Expert /li liPower BI
- Advanced /li liPython
- Expert /li liSpark
- Expert /li liSQL
- Expert /li /ul h3Languages /h3 ul liDutch or French
- Native or bilingual proficiency /li liEnglish
- Professional working proficiency /li /ul