Senior Data Engineer

Il y a 4 heures

Brussels, Belgique Everience Temps plein
pEverience is an international consulting group delivering AI-augmented digital services and placing people at the heart of the AI revolution. /p pWith a presence in Europe, Africa, Asia and America, Everience offers its 4,000-strong workforce the most demanding and stimulating environment in which to transform and develop their skills, learning about new AI-based roles and building their future employability. /p pThrough its Symbiotic Academy the group offers a unique hub for training, practical application and exchange where everyone can experiment, learn, and progress in the fields of artificial intelligence and data. /p pIn accordance with its core purpose of orchestrating the symbiotic relationship between humans and AI in the workplace, Everience is making the augmented employee the driving force of a “symbiotic age”, where AI enhances talents and opens up new career opportunities. /p pAs a bSenior Data Engineer /b, you will play a key role in managing, integrating, and optimizing data across Upstream and Downstream activities, with a particular focus on data used for forecasting purposes. /p pYou will be responsible for ensuring data quality, consistency, and accessibility across multiple sources, enabling efficient use by business stakeholders, Data Analysts, and Data Scientists. You will contribute to data governance initiatives, support architectural decisions, and implement best practices in data management. /p ul liCapture, integrate, and process structured and unstructured data from various internal and external sources. /li liDesign, develop, and maintain robust ETL/ELT pipelines. /li liStructure, standardize, qualify, and document data to ensure consistency and usability. /li liMap and maintain data lineage and data source documentation. /li liMonitor and improve data quality through validation, testing, and cleansing processes. /li liIdentify and eliminate duplicate, incomplete, or inconsistent data. /li liEnsure the quality and reliability of data entering the Data Lake. /li liContribute to the creation and maintenance of data repositories when required. /li liPromote and implement best practices in data governance and data management. /li liDevelop solutions within the enterprise data framework. /li liWrite technical specifications and design documentation. /li liDevelop and execute unit tests to ensure solution reliability. /li liParticipate in technical and architectural discussions and contribute to strategic data platform decisions. /li liSupport the continuous improvement of data architecture and engineering practices. /li liEnsure timely delivery of development activities while maintaining high-quality standards. /li /ul h3Operations Support: /h3 ul liMonitor production systems and data pipelines. /li liPerform maintenance, troubleshooting, and issue resolution. /li liEnsure operational stability and performance of data processing environments. /li liCollaborate closely with business stakeholders, architects, developers, Data Analysts, and Data Scientists. /li /ul h3Qualifications /h3 ul liBachelor's or Master's degree in Computer Science, Data Engineering, Information Systems, or a related field. /li liStrong experience in bPython /bdevelopment for data processing, scripting, and ETL implementation. /li liAdvanced knowledge of bSQL /b, relational databases, and data warehouse concepts. /li liExperience designing and optimizing data models and database performance. /li liStrong understanding of software development best practices. /li liProficiency with version control systems, particularly bGit /b. /li liExperience developing and maintaining ETL/ELT solutions. /li /ul pPreferred /p ul liHands-on experience with bDatabricks /b, including:ul liDevelopment of ETL pipelines /li liSpark cluster management /li liSQL optimization and performance tuning /li /ul /li liExperience with bApache Airflow /b and the development of DAGs for workflow orchestration. /li liKnowledge of Big Data ecosystems, Data Lake architectures, and IoT platforms. /li liFamiliarity with cloud-based data platforms and modern data engineering frameworks. /li /ul pAll our positions are open to both women and men and are, of course, open to people with disabilities. /p