Data Engineer

Il y a 2 heures

Brussels, Brussels, Belgique Innova Solutions Temps plein

Job Title: Data Quality Engineer

Job Type: Freelance

Location: Brussels, Belgium

Work regime: Hybrid

Keywords: Python, Spark, Data warehousing and SQL



All candidates should make sure to read the following job description and information carefully before applying.

Mission Overview

As a Senior Data Quality Developer, you will play a key role in strengthening enterprise data quality across multiple business domains. You will develop robust data quality controls, support large-scale IT and migration projects, and implement automated reconciliation processes that improve data reliability and business decision-making.

Working with modern data technologies and best practices, you will contribute to enterprise-wide data governance while ensuring high-performance, scalable, and maintainable data quality solutions.

Key Responsibilities

Data Quality Development

  • Design, develop, and maintain enterprise data quality solutions.
  • Build automated data quality checks using Python and Apache Spark.
  • Translate business requirements into scalable technical solutions.
  • Estimate development effort and technical feasibility for new requests.
  • Apply enterprise data quality methodologies and best practices.
  • Ensure solutions meet performance, scalability, and availability requirements.

Data Quality Framework & Governance

  • Develop and enhance the organization's Data Quality Framework.
  • Document data quality rules and technical assets within the enterprise data governance platform.
  • Ensure compliance with internal architecture, governance, and development standards.
  • Promote data quality best practices across development teams.

Data Integration & Reconciliation

  • Develop end-to-end reconciliation processes for enterprise data.
  • Integrate data from multiple internal and external sources.
  • Build consolidated data models for downstream processing.
  • Implement reconciliation rules defined by business analysts.
  • Produce consolidated datasets including issue categorization and audit information.
  • Maintain historical audit trails to monitor data evolution over time.

Data Engineering

  • Design and optimize large-scale data processing jobs.
  • Develop high-performance ETL and data integration processes.
  • Monitor data pipelines and job dependencies.
  • Perform root cause analysis for processing failures.
  • Conduct impact assessments and implement enhancements as business requirements evolve.

Reporting & Analytics Support

  • Develop statistical and reporting datasets.
  • Build reusable data assets that support business reporting.
  • Perform complex SQL queries and data analysis.
  • Support enterprise data cleansing and data quality initiatives.

IT Project Support

  • Support enterprise IT transformation and migration projects with a strong data quality component.
  • Collaborate with Agile delivery teams throughout the project lifecycle.
  • Participate in:
  • Sprint Planning
  • Backlog Refinement
  • Peer Reviews
  • Retrospectives
  • Release Planning
  • Communicate progress, risks, and deliverables to technical and business stakeholders.


Professional Experience

  • Minimum 8 years of experience developing enterprise data solutions.
  • Strong background in data quality, data engineering, or enterprise data management.
  • Experience delivering large-scale data-driven IT solutions.
  • Telecommunications industry experience is considered an advantage.

Technical Skills

Mandatory

  • SQL
  • Python
  • Apache Spark
  • Bash scripting

Preferred

  • Pandas
  • GitHub
  • GitLab
  • CI/CD pipelines
  • Data Quality Frameworks
  • Enterprise Data Governance
  • Collibra
  • Data Reconciliation
  • ETL Development

Core Competencies

  • Strong analytical and problem-solving skills
  • Excellent organizational and planning abilities
  • Strong communication and stakeholder management skills
  • Ability to explain technical concepts to business users
  • Experience working within Agile delivery environments
  • Strong collaboration and mentoring capabilities
  • Results-oriented with attention to detail
  • Ability to manage multiple priorities simultaneously
  • Continuous improvement mindset


A little about us:

Innova Solutions is a diverse and award-winning global technology servi