Senior Databricks Data Engineer

Il y a 10 heures

Brussels, Belgique Tata Consultancy Services Limited Temps plein
pWe are looking for an experienced bSenior Databricks Data Engineer /b to join our team in Belgium. The ideal candidate will have strong hands-on expertise in bDatabricks, PySpark, Python, Spark SQL, Lakeflow Jobs, and Unity Catalog /b, with extensive experience building scalable and reliable data solutions on the Databricks Lakehouse platform. /p ul liDesign, develop, and optimize scalable data pipelines using bDatabricks, Python, PySpark, and Spark SQL /b /li liOrchestrate and schedule workflows using bLakeflow Jobs /b, notebooks, and Python wheel packages /li liWork with bUnity Catalog, managed tables, and streaming jobs /b /li liDevelop robust bETL/ELT pipelines /b for data ingestion, transformation, and loading /li liOptimize Databricks workloads for bperformance, scalability, and cost efficiency /b /li liEnsure strong data quality, integrity, reliability, and availability /li liTroubleshoot data-related issues and continuously improve data engineering solutions /li /ul pb10+ years of experience in the data domain /b, particularly Data Warehousing and ETL /p pb4+ years of hands-on Databricks experience /b /p pStrong expertise in bPySpark, Spark SQL, and Python /b /p pSolid understanding of bDatabricks architecture, Lakeflow Jobs, Unity Catalog, and data modelling /b /p pHands-on experience with bGit /b /p pStrong knowledge of bData Lakes, Data Warehousing, and Lakehouse architecture /b /p pbDatabricks Certified Data Engineer Associate or Professional /b certification is an advantage /p pExcellent communication and stakeholder management skills /p pFluent in bEnglish plus Dutch or French, or both /b /p pIf you are an experienced Data Engineer looking for an opportunity in bBelgium /b and have strong Databricks expertise, we’d be happy to hear from you. /p pPlease refer this link to see how we collect, store and use the private data of our candidates: /p