Data Engineer

Il y a 1 heure

Arrondissement of BrusselsCapital, Brussels, Belgique Taleo Consulting Temps plein
pul liDesign, develop and maintain scalable data pipelines on the Databricks platform /li liManage data ingestion processes from various sources into the Databricks environment. /li liImplement and optimize ETL (Extract, Transform, Load) processes to ensure efficient data transformation and integration. /li liEnsure data quality, integrity, and security across all data pipelines. /li liMonitor and troubleshoot data pipeline performance, implementing necessary maintenance and updates. /li liDocument data pipeline processes, technical specifications and bbest practices. /b /li liRealize knowledge transfer towards the Data engineer team which will take over the responsibility to run the platform in the future /li liYou demonstrate and use your developer experience to develop and maintain complex data transformation steps using Dataiku under specific guidelines (dev vs automation node, use of Dataiku’s low code recipes, etc.) /li /ul h3Required profile. /h3 pbRequired Skills /b /p ul liStrong skills in SQL (and other relevant programming languages like Python) and in Datawarehouse / Lakehouse projects /li liProven expertise in Databricks, Dataiku and with AWS services /li liAnalytical mindset with attention to detail /li liStrong communication and collaboration skills (within a Project team and with a Data engineer team /li /ul pbQualifications /b /p ul liBachelor’s degree in Computer Science, Engineering, Mathematics, or a related field. /li liMinimum 3 years of experience in SQL and Data warehousing /li liMinimum 2 years of experience with Databricks /li /ul pWe are always on the lookout for talented people to enrich our culture and growing family. /p /p