Data Streaming Engineer – Azure

Il y a 3 heures

Schaerbeek, Brussels, Belgique Pauwels Consulting Temps plein
pOur client, a prominent organization in the telecommunications sector, is looking for a Data Streaming Engineer to support their data transformation program. This role involves re-engineering the enterprise data platform and migrating systems to a modern Azure Cloud technology stack. /p ul liDesign and develop high-availability solutions for real-time data ingestion, processing, and serving. /li liCollaborate with architects, data scientists, and project managers to drive the data transformation initiative. /li liDevelop generic frameworks for system monitoring and logging within the data ecosystem. /li liImplement real-time processing workflows to handle large-scale data streams. /li liParticipate in the migration of on-premises data assets to the cloud platform. /li /ul ul liYou bring 5+ years of experience in big data and data streaming engineering. /li liYou possess profound knowledge of backend development using bJava /b and bPython /b. /li liYou have extensive experience with bAzure Cloud /b services, specifically bADLS /b, bAzure Functions /b, and bEvent Hub /b. /li liYou have solid experience with real-time processing frameworks such as bSpark Streaming /b and bKafka Streams /b. /li liYou possess knowledge of NoSQL databases like bCouchbase /b. /li liYou have experience with CI/CD tools including bGit /b, bJenkins /b, bGitHub CI /b, and bNexus /b. /li liYou're a proactive team player with strong analytical and troubleshooting skills. /li liYou're able to work autonomously and cooperate effectively with onsite and offshore teams. /li liYou are fluent in bEnglish /b. /li /ul h3Nice to Haves /h3 ul liKnowledge of bCloudera /b and bKafka /b on-premises operations. /li liExperience with bAzure Kubernetes Service (AKS) /b. /li liFamiliarity with bFlink /b or bDatabricks /b structured streaming in real-time mode. /li liKnowledge of bDutch /b and/or bFrench /b. /li /ul ul libStart date: /b ASAP /li libDuration: /b 6 months /li libWork regime: /b Full-time /li libLocation: /b Brussels /li libWorking model: /b Hybrid /li libContract: /b open to both permanent employees and freelancers /li /ul