Senior Python Data Engineer

Il y a 7 jours

Brussels, Brussels, Belgique ITProposal Temps plein
Senior Python Data Engineer

Location:
Brussels, Belgium Work Model: Hybrid Start Date: ASAP Contract Duration: 6 Months (Full-Time) We are looking for an experienced Senior Python Data Engineer to join a cutting-edge data modernization initiative focused on migrating legacy ETL workloads to a modern Python-based data platform. This role is ideal for someone with strong Python data engineering expertise and hands-on experience leveraging AI-assisted development tools to deliver scalable, high-quality data solutions.

Key Responsibilities
Design, develop, and validate Python-based data transformation and ETL solutions. Review, optimize, and enhance AI-generated Python code. Build robust, maintainable, and high-performance data pipelines. Contribute to the migration of legacy ETL processes to modern Python-based architectures. Develop and optimize data models, schema management, and Parquet-based solutions. Support PySpark implementations for large-scale data processing. Improve AI-assisted development workflows and multi-agent orchestration processes. Enhance workflow automation, validation mechanisms, and human-in-the-loop review processes. Collaborate with data engineers, architects, and domain experts to ensure successful project delivery. Required Skills Python Pandas Polars PyArrow Parquet ETL / ELT Development Data Engineering Data Quality & Validation Schema Management Testing Frameworks AI-Assisted Development (e.g., GitHub Copilot) Workflow Orchestration Multi-Agent Systems Agentic Workflows Nice to Have PySpark Experience with legacy SAS environments. Knowledge of SAS DATA Steps, PROC SQL, SAS Macros, and ETL processing patterns. What We're Looking For 5+ years of hands-on Python development experience. Strong background in data engineering and modern ETL/ELT architectures. Experience using AI-assisted software development tools to improve productivity and code quality. Knowledge of workflow orchestration, automation, and agent-based systems. Strong analytical and problem-solving skills. Excellent communication and collaboration abilities within cross-functional teams.