Big Data Engineer Python

Il y a 2 heures
Arrondissement of BrusselsCapital, Brussels, Belgique Europe Temps plein
h3Big Data Engineer /h3pThis role focuses on developing, integrating, and optimising large-scale data flows. It involves close collaboration with data scientists to translate analytical models into practical technical solutions, requiring hands-on expertise in data cleansing, pipeline design, component orchestration, and modern data technologies such as Hadoop, Spark, and API development. /ph3Mission Responsibilities /h3ulliTechnical Collaboration: work closely with data scientists to develop effective technical solutions /liliData Optimisation: perform data cleansing, preparation, and integration /liliPipeline Engineering: design and build robust data pipelines /liliSystem Integration: manage component orchestration /liliLarge-Scale Data Processing: responsible for batch Spark ETL, including data wrangling, joining, and aggregation /li /ulh3Technical Competencies /h3ulliAI Ecosystems Frameworks, including:ulliModern Data Stack (MDS) /liliOn-premises Data Lake technologies (Hadoop, Spark, Hive) /liliLarge-scale data processing (Spark) /liliOrchestration tools (Apache Airflow) /liliContainerisation (Docker / Kubernetes) /liliPython programming /li /ul /liliArchitecture Integrations:ulliAPI development /liliCloud architectures (AWS, Azure) /li /ul /li /ulpExperience with real-time architectures and event streaming infrastructure is advantageous. /ph3Behavioural Competencies /h3ulliCollaboration: able to work closely and effectively with data scientists to translate complex analytical needs into functional technical solutions /liliAnalytical Organised: precise and methodical approach to data cleansing, preparation, integration, and pipeline design /liliProblem Solving: quick and efficient in addressing bottlenecks in data processing or orchestration errors /li /ulpWe require full-time availability (100%), although 80% availability will be considered. /p

  • Big Data Engineer Python

    Il y a 4 heures

    Brussels, Brussels, Belgique Europe Temps plein

    Big Data Engineer This role focuses on developing, integrating, and optimising large-scale data flows. It involves close collaboration with data scientists to translate analytical models into practical technical solutions, requiring hands-on expertise in data cleansing, pipeline design, component orchestration, and modern data technologies such as Hadoop,...

  • Senior Big Data Engineer

    Il y a 4 heures

    Arrondissement of Brussels-Capital, Brussels, Belgique La Fosse Temps plein

    pLa Fosse in Belgium is seeking a Big Data Engineer to develop, integrate, and optimise large-scale data flows in close collaboration with data scientists. You will design robust data pipelines using Hadoop, Spark, Hive, Airflow, and modern data technologies, performing batch ETL and API integration. /ppThe role emphasizes hands-on data cleansing and...

  • Senior Big Data Engineer

    Il y a 8 heures

    Brussels, Brussels, Belgique La Fosse Temps plein

    La Fosse in Belgium is seeking a Big Data Engineer to develop, integrate, and optimise large-scale data flows in close collaboration with data scientists. You will design robust data pipelines using Hadoop, Spark, Hive, Airflow, and modern data technologies, performing batch ETL and API integration. The role emphasizes hands-on data cleansing and...

  • Cegeka - Freelance Big Data Engineer

    Il y a 22 heures

    Arrondissement of Brussels-Capital, Brussels, Belgique CEGEKA Temps plein

    pVoor een langetermijnopdracht zijn we op zoek naar een ervaren Freelance Big Data Engineer. /p pJe komt terecht in een technisch uitdagende dataomgeving waar je verantwoordelijk bent voor het realiseren, integreren en optimaliseren van grootschalige datastromen. Je werkt nauw samen met data scientists en vertaalt complexe analytische vraagstukken naar...

  • Cegeka - Freelance Big Data Engineer

    Il y a 8 heures

    Brussels, Brussels, Belgique CEGEKA Temps plein

    Voor een langetermijnopdracht zijn we op zoek naar een ervaren Freelance Big Data Engineer.Je komt terecht in een technisch uitdagende dataomgeving waar je verantwoordelijk bent voor het realiseren, integreren en optimaliseren van grootschalige datastromen. Je werkt nauw samen met data scientists en vertaalt complexe analytische vraagstukken naar concrete,...

  • Cegeka - Freelance Big Data Engineer

    Il y a 4 heures

    Brussels, Brussels, Belgique ictjob.be Temps plein

    Voor een langetermijnopdracht zijn we op zoek naar een ervaren Freelance Big Data Engineer. Je komt terecht in een technisch uitdagende dataomgeving waar je verantwoordelijk bent voor het realiseren, integreren en optimaliseren van grootschalige datastromen. Je werkt nauw samen met data scientists en vertaalt complexe analytische vraagstukken naar concrete,...

  • Data Engineer ICT BRM ICT

    Il y a 4 heures

    Arrondissement of Brussels-Capital, Brussels, Belgique Infrabel Temps plein

    ph3DE JOB /h3 pData speelt een cruciale rol in de toekomst van het spoor. Binnen bI-ICT /b werk je mee aan de digitalisering van de volledige levenscyclus van spoorwegassets en help je Infrabel om data om te zetten in concrete inzichten en performante digitale oplossingen. /p pBen jij een ervaren Data Engineer met een grondige expertise in Elastic Search?...

  • GCP Data Engineer: ETL, Spark

    Il y a 4 heures

    Arrondissement of Brussels-Capital, Brussels, Belgique BE001 ONEPOINT SA Temps plein

    pOnepoint is seeking a Google Cloud Platform - GCP Data Engineer to design, develop, and maintain robust data pipelines and optimize databases. You will work with Spark, Hadoop, Kafka, and GCP to deliver ready-to-use data for Data Science and BI teams. /ppYou will ensure data quality and security, comply with GDPR, and contribute to defining data...

  • Data Engineer

    Il y a 4 heures

    Brussels, Brussels, Belgique Trusted Advisors Group Temps plein

    Trusted Advisors Group in Brussels is seeking a data engineer / data modeller to establish, improve and deploy modelling standards for the Data Hub tribe, coaching engineers and ensuring consistent data governance. You will assess data models, collaborate with architects and managers, promote modelling techniques through trainings, and support non-prod and...

  • GCP Data Engineer: ETL, Spark

    Il y a 4 heures

    Brussels, Brussels, Belgique BE001 ONEPOINT SA Temps plein

    Onepoint is seeking a Google Cloud Platform - GCP Data Engineer to design, develop, and maintain robust data pipelines and optimize databases. You will work with Spark, Hadoop, Kafka, and GCP to deliver ready-to-use data for Data Science and BI teams. You will ensure data quality and security, comply with GDPR, and contribute to defining data architecture...

Emplois similaires à Arrondissement of BrusselsCapital

Villes principales