Senior Databricks Data Engineer

Il y a 4 jours

Brussels, Brussels-Capital, Belgique Tata Consultancy Services Temps plein
📢 We’re Hiring: Senior Databricks Data Engineer 📍

Location:
TCS Belgium 💼 Role: Senior Databricks Data Engineer We are looking for an experienced Senior Databricks Data Engineer to join our team in Belgium. The ideal candidate will have strong hands-on expertise in Databricks, PySpark, Python, Spark SQL, Lakeflow Jobs, and Unity Catalog, with extensive experience building scalable and reliable data solutions on the Databricks Lakehouse platform. 🔹

Key Responsibilities
• Design, develop, and optimize scalable data pipelines using Databricks, Python, PySpark, and Spark SQL
• Orchestrate and schedule workflows using Lakeflow Jobs, notebooks, and Python wheel packages
• Work with Unity Catalog, managed tables, and streaming jobs
• Develop robust ETL/ELT pipelines for data ingestion, transformation, and loading
• Optimize Databricks workloads for performance, scalability, and cost efficiency
• Ensure strong data quality, integrity, reliability, and availability
• Troubleshoot data-related issues and continuously improve data engineering solutions 🔹 Key Requirements ✅ 10+ years of experience in the data domain, particularly Data Warehousing and ETL ✅ 4+ years of hands-on Databricks experience ✅ Strong expertise in PySpark, Spark SQL, and Python ✅ Solid understanding of Databricks architecture, Lakeflow Jobs, Unity Catalog, and data modelling ✅ Hands-on experience with Git ✅ Strong knowledge of Data Lakes, Data Warehousing, and Lakehouse architecture ✅ Databricks Certified Data Engineer Associate or Professional certification is an advantage ✅ Excellent communication and stakeholder management skills ✅ Fluent in English plus Dutch or French, or both If you are an experienced Data Engineer looking for an opportunity in Belgium and have strong Databricks expertise, we’d be happy to hear from you. 📩 Interested candidates can share their CV at: mehran.pandrowala@tcs.com Best Regards Mehran Pandrowala Recruiter-Overseas Hiring and Digital Transformation Please refer this link to see how we collect, store and use the private data of our candidates: https://ibegin.tcsapps.com/candidate/next/en-BE/policies/privacy-notice