Azure Data Engineer

Il y a 6 heures

Arrondissement of BrusselsCapital, Brussels, Belgique Community Consulting Temps plein
pAs part of its 2027 roadmap, a major Brussels-based public transport organization is continuing to modernize and optimize its Azure Data Platform following the migration of non-SAP data to Microsoft Azure. /ppThe organization aims to develop new reporting, analytics and Data Science use cases, strengthen data governance through Databricks Unity Catalog, expand secure self-service data capabilities, optimize Azure and Databricks consumption and costs, and continuously improve platform performance, scalability and reliability. /ppAn experienced Azure Data Engineer is needed to support the Data Analytics team in delivering reliable, scalable and secure data solutions while evolving the Azure Databricks architecture. /ph3Responsibilities /h3ulliDesign, develop and maintain data pipelines using Azure Data Factory, Azure Databricks and other Azure services. /liliImplement modern data architectures including Data Lake, Delta Lake and Lakehouse. /liliDevelop and industrialize new business data use cases. /liliImplement and manage Databricks Unity Catalog, including catalogs, schemas, permissions, data sharing and governance. /liliSupport the implementation of a secure and governed self-service data strategy. /liliMonitor and optimize Azure and Databricks performance, resource consumption and costs. /liliAutomate data ingestion, transformation and deployment processes. /liliCollaborate with Data Analysts, Data Scientists and business stakeholders. /liliDocument data flows, architecture and technical best practices. /liliMaintain and continuously improve the Azure Data Platform to ensure performance, reliability, security and scalability. /li /ulh3Must have /h3ulliMinimum 5 years of experience in a similar role. /liliDegree in Computer Science, Data Engineering or a related field. /liliProven practical experience with Databricks Unity Catalog, including access management, security and data governance. /liliStrong understanding of Azure Databricks architecture, Lakehouse design, scalability, security and best practices. /liliExperience with Apache Spark, PySpark and Delta Lake. /liliStrong programming and querying skills in Python and SQL. /liliExperience with performance monitoring, tuning and cost optimization across Azure and Databricks. /liliKnowledge of CI/CD principles applied to Data Engineering. /liliKnowledge of application integration patterns, including REST API and AMQP. /liliStrong analytical thinking, autonomy, problem-solving abilities and team spirit. /liliStrong communication skills and ability to explain technical concepts clearly. /liliExcellent command of either French or Dutch. /liliGood command of the other national language (French or Dutch). /liliGood command of English. /li /ulh3Should have /h3ulliMicrosoft Azure or Databricks certifications. /liliExperience with Power BI administration and governance. /liliExperience with real-time data streaming. /liliExperience with Terraform or Infrastructure as Code. /liliFamiliarity with Azure Monitor and Log Analytics. /liliBasic knowledge of SAP S/4HANA or BW/4HANA as data sources. /liliExperience working in Agile/Scrum environments. /li /ulh3Who we are /h3pCommunity Consulting goes beyond traditional consulting; it’s all about fostering connections in an atmosphere of trust and confidence.br/bTransparency Honesty /b : We say things as they are. Clear communication for seamless collaboration.br/b#COMMUNITEAM /b : Work independently, but never alone. Collective intelligence drives us further, faster.br/bTotal Commitment /b : Always present, always engaged. We find solutions and make sure everyone moves forward together.br/bGuaranteed Efficiency /b : No fluff, just results. We act fast, keep our promises, and deliver top quality.br/This is our DNA. This is how we make a difference. /p