Senior Data Engineer
Enregistrez cette offre et organisez votre recherche
Créez un compte gratuit pour enregistrer des offres d'emploi, créer des alertes et revenir à cette liste depuis votre tableau de bord.
Senior Data Engineer – Python/PySpark | AWS | Databricks
Remember to check your CV before applying Also, ensure you read through all the requirements related to this role.
Role: Senior Data Engineer
Job Summary:
We are seeking a Senior Data Engineer with strong hands-on experience in Python, PySpark, Databricks, and AWS. The candidate will be responsible for developing scalable data pipelines, integrating and transforming structured/unstructured data, ensuring data quality, and supporting production data platforms.
Key Responsibilities:
- Design, develop, and maintain scalable data pipelines and ETL/ELT processes.
- Ingest, integrate, map, cleanse, transform, and validate structured and unstructured data.
- Develop data processing solutions using Python 3, PySpark, and Databricks.
- Build and manage workflows using Apache Airflow.
- Work with AWS cloud services for data engineering solutions.
- Write technical specifications, unit tests, and maintain technical documentation.
- Participate in data architecture and technical design discussions.
- Implement data engineering and data management best practices.
- Develop and maintain CI/CD pipelines using Azure DevOps/TFS/VSTS.
- Use Terraform for infrastructure automation where required.
- Perform API testing using Postman/Insomnia.
- Monitor production pipelines, troubleshoot issues, and provide maintenance/support. xirbnpk
- Ensure timely delivery and adherence to project deadlines.
Required Skills:
- Python 3 – Expert
- PySpark / Apache Spark – Expert
- Databricks – Advanced
- AWS – Advanced
- Apache Airflow
- Azure DevOps / TFS / VSTS
- Terraform
- CI/CD
- Postman / Insomnia
- C# – Good to have
-
Cegeka - Senior Data Engineer
Il y a 4 heures
Saint-Gilles, Brussels, Belgique Cegeka Temps pleinAre you an experienced Data Engineer ready to help shape and scale a modern data ecosystem built on Microsoft Fabric, Azure and advanced analytics platforms? We are currently looking for a Senior Data Engineer / Data Engineering Lead to help build and scale a xirbnpk modern data ecosystem for one of Belgium's leading healthcare organizations.Submit your CV...
-
Senior Backend
Il y a 4 heures
Woluwe-Saint-Lambert, Brussels, Belgique ING Banking Temps pleinKey Responsibilities1. Platform Development & ArchitectureDesign and implement backend services supporting MADP capabilitiesContribute to an event-driven architecture (event sourcing, CQRS, messaging)Build and evolve platform-level components (not just feature-specific code)Ensure solutions are reusable, scalable, and aligned with platform principles2. API &...
-
Senior Bi Engineer
Il y a 4 heures
Saint-Gilles, Brussels, Belgique LinkedIn Temps pleinRejoins l'équipe Data & AI de Mantu GroupSubmit your CV and any additional required information after you have read this description by clicking on the application button.Dans le cadre de notre développement, nous recherchons des Senior Data Engineer, Senior BI Engineer, Senior Data Analyst et Senior AI Engineer (F/H/X) pour rejoindre l'équipe Data & AI...
-
Senior Azure Databricks Data Engineer
Il y a 8 heures
Saint-Gilles, Brussels, Belgique LinkedIn Temps pleinSenior Azure Databricks Data Engineer - Banking ClientApplying for this role is straight forward Scroll down and click on Apply to be considered for this position.Location: Brussels, Belgium – HybridRate: FlexibleOnsite: 8 days per month in BrusselsRemote: Remaining days can be worked remotelyEngagement: Umbrella preferred; Belgian company/BV can also be...
-
Senior Software
Il y a 7 jours
Saint-Gilles, Brussels, Belgique LinkedIn Temps pleinAbout the jobInterested in this role You can find all the relevant information in the description below.Merlin Innovation is an AI consultancy building enterprise-grade, production-deployed applications for clients across a range of industries. Increasingly, these are AI-native products: LLM-powered features, retrieval pipelines (RAG), and agentic workflows...
-
Senior Data Analyst
Il y a 3 heures
Saint-Gilles, Brussels, Belgique Smals Temps pleinSmals realiseert innovatieve ICT-projecten in e-government en e-health voor instellingen uit de sociale zekerheid en de gezondheidszorg. 'ICT for society' is voor Smals meer dan een slogan: alle projecten hebben een positieve maatschappelijke impact. Zo bouwt Smals mee aan het portaal van de sociale zekerheid en het eHealth-platform. Grensverleggende...
-
Azure Data Engineer
Il y a 4 heures
Saint-Gilles, Brussels, Belgique LinkedIn Temps pleinAzure Data Engineer (Databricks, Spark, dbt, SQL Server)The following information provides an overview of the skills, qualities, and qualifications needed for this role.Brussels area, Belgium (Hybrid)Job DescriptionWe are seeking an experienced Azure Data Engineer to design, develop, and maintain scalable data pipelines and analytics solutions. The ideal...
-
Data Engineer
Il y a 4 jours
Saint-Gilles, Brussels, Belgique LinkedIn Temps plein**Permanent Position only**Do not pass up this chance, apply quickly if your experience and skills match what is in the following description.WHAT IS CREAM ALL ABOUT?We could be a Cream Factory, a cooking blog or even a detective agency...But in reality, we are a Business & Technology consulting company, active in large organizations and industry leaders in...
-
Senior Data Product Owner – Hr Data
Il y a 8 heures
Saint-Gilles, Brussels, Belgique LinkedIn Temps pleinAbout the RoleTo be considered for an interview, please make sure your application is full in line with the job specs as found below.We are looking for a Senior Data Product Owner to join the data organization of a leading international retail organization and take ownership of an HR-focused Data Product.You will act as the key link between HR business...
-
Atcon Global
Il y a 6 jours
Saint-Gilles, Brussels, Belgique ATCON GLOBAL Temps pleinWe are looking for a Senior Data Platform Engineer / Spark Engineer to join a major Asset Management transformation program and help build a new enterprise data platform following the integration with AXA Investment Managers.Have you got the right qualifications and skills for this job Find out below, and hit apply to be considered.This is a hands-on...
