data streaming engineer
Enregistrez cette offre et organisez votre recherche
Créez un compte gratuit pour enregistrer des offres d'emploi, créer des alertes et revenir à cette liste depuis votre tableau de bord.
En continuant, vous acceptez nos Conditions d’utilisation & Politique de confidentialité.
Data streaming engineer – Data streaming on Azure cloud & on-premises
Function
As Data Engineer you will interact with the business and IT people (architects, functional analysts, project managers, data scientists, developers) and participate in the data transformation program. As part of this program, we are re-engineering our enterprise data platform and moving to an Azure Cloud technology stack.
In this re-engineering and migration, you will design and develop solutions for real-time data ingestion, processing and serving in a highly available environment. You will also be working on several generic frameworks e.g. framework for logging, for monitoring, …
Skills
You are an IT professional withoud & on-premises a minimum of five years of experience with proven experience in big data & data streaming engineering.
Mandatory :
- You have solid experience with the Azure Cloud platform , especially the data streaming management/processing products such as ADLS, Azure Functions, Event Hub (Kafka interface), etc.
- Experience in real-time processing frameworks is mandatory: Spark (Structured) Streaming, Kafka Streams or equivalent. Knowledge on Flink & Databricks structured streaming Real time mode is an advantage
- You have profound knowledge on Java and Python programming languages (Java is a must to have - Python is a huge advantage)
- Experience in NoSQL databases like Couchbase or equivalent You have experience with CI/CD (Git, Jenkins / Github CI, Nexus)
Definitely a plus :
- We have a Cloudera data platform; knowledge on how the platform operates and knowledge on products such as Kafka is a great advantage.
- Experience in Azure Kubernetes service are an advantage.
- You are a team player and have a strong troubleshooting/analytical mindset.
- You do not hesitate to propose improvements when you notice them.
- You have excellent communication skills, this as well with your technical peers as with your stakeholders.
- You are fluent in English, both spoken and written. Knowledge of Dutch and/or French is an advantage.
- You can work autonomously, you can cooperate effectively with different teams onsite and offshore, you are eager to learn new technologies, and you like sharing knowledge and documenting solutions with the right level of detail.