Data Engineer – Lakehouse Data Platform Job ID:JP055174
Il y a 9 heures
Brussels, Brussels, Belgique
ITProposal
Temps plein
Gratuit avec email ou Google
Enregistrez cette offre et organisez votre recherche
Créez un compte gratuit pour enregistrer des offres d'emploi, créer des alertes et revenir à cette liste depuis votre tableau de bord.
Gratuit avec email ou Google
Data Engineer – Lakehouse & Data Platform We are looking for an experienced Data Engineer to help build and maintain a secure, on-premise data platform in a highly regulated environment. You will work in a multidisciplinary team alongside Data and Solution Architects and a BI Developer.
Key Responsibilities
Design and develop data ingestion pipelines from files, APIs, and relational databases. Implement incremental and streaming data pipelines with strong reliability and traceability. Develop Bronze, Silver, and Gold data layers using a Medallion/Lakehouse architecture. Manage Delta Lake tables, including ACID transactions, time travel, and data optimization. Build and maintain data orchestration workflows and monitoring. Implement data lineage, metadata management, and governance practices. Develop data endpoints and support BI dashboards and reporting solutions. Requirements Strong Python and SQL skills. Proven experience with dbt-core and Delta Lake . Knowledge of DuckDB , MSSQL/PostgreSQL, and advanced SQL/CDC. Experience with Dagster, Airflow, or equivalent orchestration tools. Comfortable working with Linux/OpenShift and PowerShell . Familiarity with DataHub, OpenMetadata, or similar governance platforms. Experience with BI development; Power BI is a plus. Knowledge of Kafka/Debezium, Spark, and Lakehouse architectures is an advantage. Strong analytical, documentation, communication, and problem-solving skills. Belgian nationality is mandatory due to the nature of the assignment.
Location:
Brussels, Belgium Work Arrangement: Hybrid
Key Responsibilities
Design and develop data ingestion pipelines from files, APIs, and relational databases. Implement incremental and streaming data pipelines with strong reliability and traceability. Develop Bronze, Silver, and Gold data layers using a Medallion/Lakehouse architecture. Manage Delta Lake tables, including ACID transactions, time travel, and data optimization. Build and maintain data orchestration workflows and monitoring. Implement data lineage, metadata management, and governance practices. Develop data endpoints and support BI dashboards and reporting solutions. Requirements Strong Python and SQL skills. Proven experience with dbt-core and Delta Lake . Knowledge of DuckDB , MSSQL/PostgreSQL, and advanced SQL/CDC. Experience with Dagster, Airflow, or equivalent orchestration tools. Comfortable working with Linux/OpenShift and PowerShell . Familiarity with DataHub, OpenMetadata, or similar governance platforms. Experience with BI development; Power BI is a plus. Knowledge of Kafka/Debezium, Spark, and Lakehouse architectures is an advantage. Strong analytical, documentation, communication, and problem-solving skills. Belgian nationality is mandatory due to the nature of the assignment.
Location:
Brussels, Belgium Work Arrangement: Hybrid