Senior Data Engineer/Analyst

Il y a 15 heures

belgium Euroclear Temps plein

Senior Data Engineer - Azure Databricks

Join Euroclear

Euroclear is a financial services company that specializes in the settlement of securities transactions, as well as the safekeeping and asset servicing of these securities. We are located in Brussels and several major cities in Europe and around the world. We are deeply convinced that diversity of talents, backgrounds and opinions is a key to success, by encouraging engagement, energy and innovation.

Our IT Division

The Data & AI division ensures Euroclear's competitiveness by delivering reliable and sustainable IT solutions for the financial securities markets.

Within Data & AI division, our Data Tribe supports advanced analytics, reporting, operational data products, and AI-driven capabilities across the Euroclear Group. We help transform data into business value by leveraging modern cloud technologies, data engineering practices, and innovative analytical solutions.

Our scope can be summarized as follows:

Operating and evolving the Data & Analytics Platform (DAP), including the Data Lake, Group Data Warehouse, and strategic Azure-based data platforms.Delivering data products and analytics capabilities for key business domains.Supporting business transformation initiatives through modern data engineering and cloud technologies.Providing expertise in data management, reporting, analytics, and AI.

Our tribe is working for both internal and external clients.

Your Role as a Senior Data Engineer

As a Senior Data Engineer, you will play a key role in designing, building, and evolving modern cloud-based data solutions supporting Euroclear's business domains.

You will work closely with business stakeholders, architects, product owners, and fellow engineers to deliver scalable, reliable, and high-performing data products that support operational processes, reporting, analytics, and future AI initiatives.

Key Responsibilities

Design, develop, test, and maintain scalable data engineering solutions on Microsoft Azure and Databricks.Build robust and reusable ETL/ELT pipelines using Python, PySpark, and SQL.Develop data products and applications supporting data ingestion, transformation, enrichment, validation, and distribution.Implement reliable batch and streaming data workflows using Azure Databricks, Delta Lake, and modern Lakehouse architectures.Contribute to the modernization and migration of strategic data platforms to Azure Cloud.Build and maintain datasets supporting operational, analytical, management, and regulatory reporting.Partner with business and technology teams to translate requirements into scalable, maintainable solutions.Promote engineering excellence through code quality, automation, performance optimization, and operational reliability.Mentor and support junior engineers through coaching, code reviews, and knowledge sharing.

Azure / Databricks Data Platform

Develop solutions leveraging Azure and Databricks services, including:

Azure DatabricksDelta Lake / Lakehouse ArchitectureAzure Data Lake StorageAzure Data Factory / Synapse PipelinesAzure Event Hubs and Streaming Ingestion PatternsAzure Key VaultAzure DevOps

Key Responsibilities

Design and implement curated data layers supporting analytics, reporting, operational processes, and AI use cases.Build and maintain scalable data modelsApply best practices for data quality, lineage, observability, performance optimization, and operational monitoring.Ensure data solutions are secure, scalable, resilient, and aligned with Enterprise Architecture standards.Collaborate with platform, infrastructure, and architecture teams to continuously improve the data ecosystem.

ETL, Data Pipelines & Software Engineering

Develop and maintain production-grade data pipelines using Python, PySpark, and SQL.Design reusable ingestion, transformation, validation, and monitoring frameworks.Implement automated testing, validation, logging, error handling, and monitoring.Optimize Spark jobs for performance, scalability, reliability, and cost efficiency.Apply software engineering best practices including clean code, modular design, version control, code reviews, and documentation.Build CI/CD pipelines using Azure DevOps YAML pipelines.Package, deploy, and maintain data engineering solutions across multiple environments.Contribute to operational support activities and continuous service improvement.

Infrastructure & DevOps Collaboration

Collaborate with Cloud, DevOps, Platform, and Security teams to ensure op