Senior dbt Analytics Engineer – PySpark
Il y a 4 heures
Arrondissement of BrusselsCapital, Brussels, Belgique
All European Careers BENELUX
Temps plein
Gratuit avec email ou Google
Enregistrez cette offre et organisez votre recherche
Créez un compte gratuit pour enregistrer des offres d'emploi, créer des alertes et revenir à cette liste depuis votre tableau de bord.
Gratuit avec email ou Google
En continuant, vous acceptez nos Conditions d’utilisation & Politique de confidentialité.
pWe are looking for a bSenior Analytics Engineer /b in bBrussels, Belgium /b, with strong expertise in bdbt, SQL, PySpark and Apache Iceberg /b. /ppYou will design and optimize scalable data transformation pipelines, modernize legacy data processing workflows and ensure data quality across enterprise analytics environments. /ph3Hybrid Brussels – 6+ years of IT experience /h3h3Tasks and Responsibilities /h3ulliDesign, develop and maintain bscalable data transformation pipelines /b using dbt and PySpark; /liliOptimize bdbt project performance /b, SQL transformations and incremental data processing; /liliDevelop and maintain bdata quality checks, automated regression tests and pipeline validation procedures /b; /liliDesign modular dbt models using staging, intermediate and marts layers, reusable macros and established analytics engineering practices; /liliWork with bApache Iceberg tables /b, including schema evolution, partition evolution and snapshot management; /liliTranslate business requirements and legacy processing logic into reliable, production-ready data transformations; /liliSupport migration and reconciliation activities, ensuring functional equivalence between legacy and modern data pipelines; /liliEstablish dbt development best practices, maintain technical documentation and collaborate with data engineering and business teams. /li /ulh3Profile /h3ulliBachelor's or Master's degree and b6+ years of IT experience /b; /liliProven hands-on experience with bdbt /b, preferably dbt Core, including production development, testing, documentation and maintenance; /liliStrong knowledge of banalytics engineering, modern data modelling and modular dbt architectures /b; /liliAdvanced bSQL skills /b, including complex transformations, query optimization and incremental processing; /liliPractical experience with bPySpark and Apache Spark /b, including distributed processing, partitioning and performance optimization; /liliProven experience with bApache Iceberg /b, including schema evolution, partition evolution, snapshot management and time travel; /liliStrong understanding of bdata quality, reconciliation, automated testing and validation /b, particularly during legacy system migrations; /liliExperience with bGit, CI/CD pipelines, code reviews and automated deployment practices /b; /liliFamiliarity with bworkflow orchestration and scheduling tools /b, such as Dagster, for dbt and Spark workloads; /liliAbility to document technical solutions and collaborate with data engineers, analysts, business stakeholders and platform teams. /li /ulpExperience with bSAS-based ETL and migration from SAS to dbt /b would be a strong advantage. Knowledge of Spark job optimization and advanced Apache Iceberg internals, including compaction and transaction behavior, would also be beneficial. /p