Azure Data Engineer
Enregistrez cette offre et organisez votre recherche
Créez un compte gratuit pour enregistrer des offres d'emploi, créer des alertes et revenir à cette liste depuis votre tableau de bord.
En continuant, vous acceptez nos Conditions d’utilisation & Politique de confidentialité.
To support these initiatives, we are looking for an experienced Azure Data Engineer with strong expertise in Azure Databricks and Unity Catalog to strengthen our Data & Analytics team.
Main Mission:
As an Azure Data Engineer, you will play a key role in the continuous development, optimization, and governance of STIB-MIVB's Data Platform.
You will design, develop, and maintain reliable and scalable data solutions on Microsoft Azure, while contributing to the evolution of our Azure Databricks architecture.
You will also help implement data governance and self-service capabilities using Unity Catalog, monitor platform consumption and costs, and ensure that our Data Platform meets business needs in terms of performance, security, and reliability.
Key Responsibilities:
- Design and develop data pipelines using Azure Data Factory, Databricks, and other Azure services.
- Implement modern data architectures (Data Lake, Delta Lake, Lakehouse).
- Develop and industrialize new business use cases.
- Contribute to the implementation and management of Databricks Unity Catalog (catalogs, schemas, permissions, data sharing, and governance).
- Support the implementation of a self-service data strategy.
- Monitor and optimize Azure and Databricks performance, resource consumption, and costs.
- Automate data ingestion, transformation, and deployment processes.
- Collaborate with Data Analysts, Data Scientists, and business stakeholders.
- Document data flows, architecture, and best practices.
- Contribute to the maintenance and continuous improvement of the Azure Data Platform.
- Required Technical Skills:Strong experience with Azure services: Data Factory, Azure Databricks, Azure Storage, Azure SQL, Key Vault, Azure DevOps.
- Hands-on experience with Databricks Unity Catalog, including access management, security, and data governance.
- Strong knowledge of Azure Databricks architecture, including Lakehouse design, scalability, security, and best practices.
- Experience with Spark, PySpark, and Delta Lake
- Strong skills in SQL and Python.
- Experience with monitoring, performance tuning, and cost optimization in Azure and Databricks.
- Knowledge of CI/CD principles applied to data engineering.
- Knowledge of application integration patterns (REST API, AMQP).
Profile:
- Degree in Computer Science, Data Engineering, or a related field.
- Minimum 5 years of experience in a similar role.
- Proven experience with Azure Databricks, Unity Catalog, and Azure data architecture.
- Analytical mindset, autonomy, problem-solving skills, and team spirit.
- Strong communication skills and ability to explain technical concepts clearly.
Nice to Have:
- Microsoft Azure or Databricks certifications.
- Experience with Power BI administration and governance.
- Experience with real-time data streaming.
- Experience with Terraform or Infrastructure as Code.
- Familiarity with Azure Monitor and Log Analytics.
- Basic SAP knowledge (S/4HANA or BW/4HANA as data sources).
- Experience working in Agile/Scrum environments.
Skills
Azure Data Architecture
Azure Data Factory
Databricks
Databricks Unity Catalog
Power BI
Python
Spark
SQL
Languages
Dutch or French - Native or bilingual proficiency
English
Questions
Do you confirm that you can visit the site 2-3 times a week?