Data Engineer

Il y a 4 heures

NazarethDe Pinte, Vlaams Gewest, Belgique IVC Evidensia Belgium Temps plein
pAt IVC Evidensia Belgium, we are transforming the way data is managed, consumed and leveraged across the organisation. /p pAs part of this exciting journey, we are implementing a Databricks platform that will become the foundation for analytics, reporting and data-driven decision making across Belgium. /p pWe are looking for a Data Engineer to take ownership of the technical evolution of this platform. /p pYou will be responsible for building and optimising scalable data pipelines, integrating new data sources, ensuring data quality and reliability, and continuously improving platform performance and cost efficiency. /p pWorking closely with the Data Analyst, business stakeholders and Group Data teams, you will play a critical role in enabling high-quality analytics while establishing best practices for data engineering, automation and governance. /p pbYour responsibilities /b /p pAs a Data Engineer, you will be responsible for: /p ul liDesign, build, maintain and optimise data pipelines within Azure Databricks. /li liTake technical ownership of data ingestion from source systems into the Belgium data platform. /li liBuild and maintain Bronze, Silver and Gold data layers using a medallion architecture. /li liAdd and integrate new data sources, including internal systems, external datasets, APIs and file-based feeds. /li liImprove pipeline performance, reliability, monitoring and observability. /li liIdentify opportunities to speed up data processing and reduce platform running costs. /li liSupport the transition from legacy reporting and data infrastructure to a modern Databricks Lakehouse platform. /li liWork closely with the Data Analyst to provide trusted, consumption-ready datasets for Power BI reporting and self-service analytics. /li liCollaborate with business users and SMEs to understand data requirements and translate them into robust technical solutions. /li liImplement data quality checks, validation rules and reconciliation processes. /li liSupport documentation of data flows, business definitions, assumptions and technical design decisions. /li liContribute to the definition of engineering standards, reusable patterns and platform best practices. /li liWork within DevOps ways of working, using version control, deployment practices and structured delivery methods. /li liSupport secure development practices, including access management, scalability, performance and other non-functional requirements. /li liProactively seek innovative solutions to improve the platform, automate manual processes and increase the value delivered from data. /li /ul pbWho are we looking for? /b /p ul liWe are looking for a technically skilled and business-aware Data Engineer with strong experience in modern cloud-based data platforms and a practical mindset for delivery. /li liYou should be comfortable working with data storage, processing, modelling and orchestration concepts, and have experience building and maintaining production-grade data pipelines. Experience with Azure Databricks, Azure Data Factory and cloud-based data engineering is particularly important for this role. /li liYou will act as a key interface between business stakeholders, the Belgium Data Analyst, technology teams and Group Data teams, so excellent communication and stakeholder engagement skills are essential. /li liYou should be confident working in an environment where the data platform is evolving, priorities may change, and pragmatic decisions are needed to balance short-term delivery with long-term platform health. /li /ul pbYour profile /b /p ul liProven experience as a Data Engineer or Analytics Engineer in a modern data environment. /li liHands-on experience with Databricks, including AI/BI Dashboards and Genie. /li liStrong SQL skills and experience working with relational data. /li liStrong Python and/or PySpark experience. /li liExperience designing, building and maintaining ELT/ETL data pipelines. /li liExperience with orchestration tools such as Azure Data Factory or equivalent. /li liGood understanding of medallion architecture, including Bronze, Silver and Gold data layers. /li liExperience working with cloud-based data storage and processing technologies. /li liUnderstanding of data modelling and building consumption-ready datasets for BI and analytics. /li liExperience integrating data from multiple structured and semi-structured sources, including APIs, JSON, databases and files. /li liGood understanding of performance optimisation, scalability and cost management in cloud data platforms. /li liExperience with Git, Azure DevOps or similar version control and delivery tooling. /li liStrong problem-solving skills and ability to troubleshoot pipeline, data quality and performance issues. /li liExcellent communication skills and ability to explain technical topics to non-technical stakeholders. /li liAbility to work collaboratively with analysts, architects, infrastructure teams and business users. /li liExcellent communication