Senior Data Engineer
Il y a 5 heures
Brussels, Belgique
Intact
Temps plein
Gratuit avec email ou Google
Enregistrez cette offre et organisez votre recherche
Créez un compte gratuit pour enregistrer des offres d'emploi, créer des alertes et revenir à cette liste depuis votre tableau de bord.
Gratuit avec email ou Google
En continuant, vous acceptez nos Conditions d’utilisation & Politique de confidentialité.
pHi, I'm Nishya, Head of Data and AI at Intact – the world's leading software provider for the Testing, Inspection and Certification (TIC) industry. We're looking for a Senior Data Engineer to build the data foundation for the next generation of our product. /ppWe have years of operational data on audits, certifications, standards, evidence, findings and organizations. Much of it is still locked in systems built to run workflows. We want to turn it into a trusted, scalable product asset. /ppYou'll design the pipelines, models, quality checks, and infrastructure that make this data ready for analytics, product features, and AI/ML. /ppThis is not a reporting role or a ticket queue. You'll help build a modern data platform that becomes part of the product itself. It will connect legacy and modern systems as Intact transforms domain by domain. You'll work closely with me and with our Product, Engineering, and Applied AI/ML teams. /ppSounds exciting? We'd love to hear from you. /ph3ARE YOU READY? /h3ulliBuild reliable, scalable, and cost-efficient batch and incremental data pipelines, with near-real-time processing where it's needed. /liliOwn Change Data Capture (CDC), incremental processing, and schema evolution, and make sure the data's history stays correct. /liliOwn data contracts with source teams so schema changes stay manageable. /liliDesign canonical analytical models for key business entities, events, and relationships. /liliBuild reusable transformations with clear layers between raw, transformed, and consumption-ready data. /liliDesign the data platform around how consumers use it, balancing performance, scalability, and cost. /liliBuild and evolve the data quality and governance framework, covering testing, monitoring, lineage, ownership, and failure recovery. /liliBuild self-serve patterns and documentation so teams can publish and consume data independently. /liliProvide trusted data for analytics, product features, and AI/ML use cases. /liliDesign mechanisms for access control, retention, deletion, anonymization, and pseudonymization. /liliMonitor data pipelines and keep them fast and cost-efficient. /liliTreat data engineering as software engineering, with version control, code review, automated testing, infrastructure as code, and CI/CD. /li /ulh3ARE YOU THE ONE? /h3pWe care more about how you approach problems than about which tools you've used. Here's what we have in mind. /ph3Technical foundation /h3ulli7+ years of building and running production data systems, ideally owning them from source to consumer. /liliAdvanced SQL and Python (or another data engineering language), with a solid understanding of how your queries perform. /liliClean, well-tested code that your teammates can easily maintain. /liliStrong dimensional, relational, and analytical data modeling, including tracking how data changes over time. /liliA degree in computer science, data engineering, or a related field, or equivalent practical experience. /li /ulh3Architecture and data platforms /h3ulliHands-on CDC experience (e.g., Debezium, AWS DMS, Fivetran, or native log-based CDC), including handling deletes, backfills, and schema changes. /liliExperience designing a modern cloud warehouse or lakehouse (e.g., Snowflake, Databricks, BigQuery, or Microsoft Fabric) with a strong focus on performance, scalability, and cost. /liliExperience with reusable ELT transformations (e.g., dbt) and orchestration tools (e.g., Airflow or Dagster). /liliPipelines that can be rerun safely and recover predictably from failures. /liliA strong batch background, and the judgment to know when near-real-time processing (e.g., Kafka or a managed equivalent) is worth the extra complexity. /li /ulh3Running data in production /h3ulliDocker, Terraform (or similar), and CI/CD as part of your everyday toolkit. /liliMonitoring, logging, and alerting built into everything you ship. /liliCost and performance considered in every design decision. /liliData quality, security, and governance built in from the start, covering contracts, validation, lineage, access control, and ownership. /liliA good understanding of privacy requirements such as the GDPR, including retention, deletion, and pseudonymization. /li /ulh3How you work /h3ulliYou're a systems thinker with pragmatic judgment and a strong sense of ownership, from design through operation. /liliYou prefer simple solutions that deliver value early over complex ones that take months to land. /liliYou're curious about the business meaning behind the data. /liliYou speak up when you see a better way and stay open to other people's ideas. /liliYou're fluent in English. German is a plus. /li /ulh3Nice to have /h3ulliExperience with open table formats such as Apache Iceberg or Delta Lake. /liliExperience with a data catalog or lineage tool such as DataHub or OpenMetadata. /liliExperience preparing data for AI/ML, such as evaluation datasets, features, or retrieval pipelines. /liliExperience moving data out of legacy,