Senior Data Engineer Consultant

ph3Mission Overview: /h3 pKeystone Solutions is seeking a Senior Data Engineer for a consultancy mission at a client site. You will be part of a dynamic team working on the Data Exchange Platform (DEP) project, which involves building an on-premise data platform for a governmental organization. This role emphasizes the importance of security, governance, and data sovereignty. /p h3Main

Responsibilities:
/h3 ul liDesign and deploy data ingestion pipelines from heterogeneous sources: files, APIs, relational databases. /li liImplement pipelines for incremental and streaming ingestion. /li liEnsure reliability, idempotence, and traceability of each pipeline. /li liDevelop transformation models on Bronze, Silver, and Gold layers (Medallion architecture). /li liImplement best practices for data historization (e.g., SCD2, upsert, append only). /li liDevelop exports to Delta Lake. /li liManage and maintain Delta Lake tables. /li liGuarantee transactional consistency of data in a multi-domain environment. /li liImplement and maintain orchestration assets. /li liMonitor runs, manage errors, and automate alerts. /li liPush technical and business metadata to the data platform. /li liMaintain end-to-end lineage. /li liContribute to the drafting of DUA, SLA, and associated governance documents. /li liDevelop endpoints to expose the Gold layer to BI dashboards. /li liCollaborate with reporting teams for BI dashboard feeding. /li /ul h3Required Technical

Skills:
/h3 ul liProficiency in Python. /li liProficiency in SQL. /li liProven experience with dbt-core (models, snapshots, macros, tests, profiles). /li liGood knowledge of DuckDB as an embedded analytical query engine. /li liExperience with Delta Lake (ACID transactions, time travel, OPTIMIZE/VACUUM). /li liKnowledge of relational databases: MSSQL, PostgreSQL (advanced SQL, CDC). /li liExperience with a data orchestrator: Dagster, Airflow, or equivalent. /li liComfortable with Linux/OpenShift and using PowerShell (Windows dev environment). /li liFamiliarity with governance tools: DataHub, OpenMetadata, or equivalent. /li liExperience in BI development. /li /ul h3Preferred

Skills:
/h3 ul liExperience with Kafka/Debezium for real-time data capture. /li liKnowledge of Spark (Spark SQL, Thrift Server, Beeline). /li liExperience with Power BI Report Server (PBIRS) or Apache Superset. /li liAwareness of data security in restricted access environments. /li liKnowledge of Lakehouse concepts (Medallion architecture), DWH, and Datalake. /li /ul h3Soft

Skills:
/h3 ul liRigorous and autonomous in managing complex multi-domain pipelines. /li liAbility to document technical decisions and simplify for non-technical stakeholders. /li liTeam spirit. /li liCurious and solution-oriented mindset. /li /ul h3What

We Offer
/h3 ul liA stable mission that is long-term. /li liA high-impact project in a secure and technically stimulating environment. /li liA modern and open-source stack: DLT, dbt, DuckDB, Delta Lake, Dagster. /li liAn experienced and supportive team focused on quality and best practices. /li liOpportunities for skill enhancement in governance, orchestration, and lakehouse. /li /ul pIf you are ready to tackle technical and strategic challenges in a dynamic consultancy environment, apply today at Keystone Solutions Career Portal. /p h3Duration: /h3 pAs soon as possible
- 31/12/2026 5 months (full time) /p h3Skills required: /h3 ul libDagster /b
- Level: Junior
- Most recent: Any time /li libData acquisition (ETL, ELT, ...) /b
- Level: Confirmed
- Most recent: Any time /li libData architecture /b
- Level: Junior
- Most recent: Any time /li libdata engineering /b
- Level: Confirmed
- Most recent: Any time /li libData Governance /b
- Level: Confirmed
- Most recent: Any time /li libDataHub /b
- Level: Junior
- Most recent: Any time /li libdatalake /b
- Level: Junior
- Most recent: Any time /li libdbt /b
- Level: Junior
- Most recent: Any time /li libKafka /b
- Level: Junior
- Most recent: Any time /li libMetadata management /b
- Level: Confirmed
- Most recent: Any time /li libPOWER BI /b
- Level: Junior
- Most recent: Any time /li libPython (from a Data Engineer perspective), Pandas Apache Spark /b
- Level: Confirmed
- Most recent: Any time /li libSPARK /b
- Level: Junior
- Most recent: Any time /li libSQL /b
- Level: Confirmed
- Most recent: Any time /li /ul h3Language

requirements:
/h3 pDutchbr/Level Active knowledgebr/Englishbr/Level Active knowledgebr/Frenchbr/Level Native /p /p