Azure Developer
il y a 3 semaines
Will be primarily responsible for developing, deploying and operating the Azure Databricks and Data Factory/ Data Flow product.
- Also, build and extend the Databricks cloud offering, which is based on a microservice architecture and includes: a cluster management platform Spark job scheduling, notebook services deployment and automation.
- Expert in Azure Data Factory, Azure Data Lake Analytics, Python, Spark SQL, Azure Data Bricks
- Strong SQL skills with experience in Azure SQL DW
- Experience handling Structured and unstructured datasets
- Experience in Data Modeling and Advanced SQL techniques
- Experience implementing Azure Data Factory Pipelines using latest technologies and techniques
- Use the interactive Databricks notebook environment using Apache Spark SQL, Examine external data sets, Query existing data sets using Spark SQL
- Visualize query results and data using the built-in Databricks visualization features, Perform exploratory data analysis using Spark SQL.
- ETL processing and data extraction using Azure Databricks to write a basic ETL pipeline using the Spark design pattern, Ingest data using DBFS mounts in Azure Blob Storage, Ingest data using serial and parallel JDBC reads
- Perform an ETL job on a streaming data source, Parameterize a code base and manage task dependencies, Submit and monitor jobs using the REST API or Command Line Interface
- Mange Delta lake using Data bricks to use the interactive Databricks notebook environment, Create, append and upsert data into a data lake.
**Skills and Experience**
- Overall 12-14 years of ETL development experience
- **2-4 years of development experience in cloud platform includes Azure Databricks, Azure SQL, Apache Spark (Scala/Python) etc.**:
- 2-4 years of development experience in SSIS and SQL skills.
- Excellent problem analysis and solving skills, strong communication skills.
**Primary Responsibilities**
- Develop ETL processing and Data extraction using Azur Data Factory/ Data Flow/ Azure Databricks.
- Develop Apache Spark SQL using Scala/Python to examine and query datasets.
- Develop Dataframes for ETL transformation and loads
- Write scripts for automated testing of data in the target facts and dimensions.
- Capture audit information during all phases of the ETL transformation process.
- Write and maintain documentation of the ETL processes via process flow diagrams.
- Collaborate with business users, support team members, and other developers throughout the organization to help everyone understand issues that affect the data warehouse
**Job Type**: Temporary contract
Contract length: 6 months
**Salary**: €500.00 - €550.00 per day
Schedule:
- Day shift
**Experience**:
- ETL: 10 years (preferred)
- Data warehouse: 10 years (preferred)
- Azure Data Factory: 5 years (preferred)
- Azure Databricks: 5 years (preferred)
-
Azure .NET Developer
il y a 1 semaine
Brussels, Belgique Satellit Temps pleinContext **Tasks**: Design and develop middleware and product solutions Coaching junior developers Technical design Technical skills (must have) .NET core 6 / C# (7 or higher) Core Azure services (Service bus, logic apps, APIM, Application Insights, Key Vault, Cosmos DB, Azure function) Data storage, messaging, identity (AAD) Microservices, (cloud)...
-
Azure Cloud Developer
il y a 3 semaines
Brussels, Belgique Pixie Recruitment Services Limited Temps pleinWe are looking for senior profile that has high developer skills, can propose a solution to the lead designer. The person has to be willing to deep dive into the business area, together with the domain expert of business. The person has to partially analist as processing data is a key element. Sharing functional insights to the analyst have to be done...
-
Azure Integration Architect/developer
Il y a 2 mois
Brussels, Belgique Satellit Temps pleinOur client in the energy sector and located in Brussels is looking for an Azure Integration Architect/Developer with the following competencies: **Responsibilities**: Have hands-on experience as an Architect on one of the following Public Cloud platform: Microsoft Azure. Have designed and implemented end-to-end cloud infrastructure components combining...
-
Digitribe - Azure Infrastructure Developer
Il y a 2 mois
Brussels, Belgique DigiTribe Temps pleinBut the Cloud Center of Excellence is also fundamentally transforming the way IT is consumed: bringing Agile, DevOps, self-service IT and automation to the ForeFront of our way of working. Bringing more flexibility and agility to all IT projects within the bank. Their "product team" in the Cloud Center of Excellence is developing pre-configured products in...
-
Data Engineer
Il y a 2 mois
Brussels, Belgique Michael Page Temps plein- Define and implement data collection, storage, transformation and delivery solutions on the Azure platform, using services such as Azure Data Factory, Azure Databricks, Azure Synapse Analytics, Azure Data Lake, Azure Blob Storage, etc. - Develop and optimize SQL queries, Python scripts, Spark notebooks and ETL/ELT to ensure data quality, reliability and...
-
Azure Architect
Il y a 2 mois
Brussels, Belgique IT Human Resources Temps plein**Azure Architect (MUST be based in Belgium)** My client seeks an Azure Architect to play a pivotal role in shaping the architecture of cloud-based solutions for the EU Institutions. **Remit** - Conducting data analysis and modelling with large volumes of data from multiple sources. - Designing and developing architecture components and building blocks...
-
Net Azure Developer
il y a 1 semaine
Brussels, Belgique Assuralia Temps plein**Functie**: - Je ontwikkelt API’s, backend en frontend applicaties in C#,.NET, Angular en Azure - Je maakt testscenario's en voert testplannen uit - Je staat in voor het continu verbeteren en uitbreiden van zowel bestaande als nieuwe applicaties door problemen te analyseren en functionele analyses te vertalen naar technische analyses - Je zorgt voor de...
-
Senior Azure .NET Developers
Il y a 2 mois
Brussels, Belgique Pauwels Consulting Temps pleinYour main tasks will consist to: - Collaborate with cross-functional teams to design, develop, and test Engineering solutions on the Azure platform - Work closely with Product Owners to understand and translate requirements into technical solutions - Participate in code reviews and provide constructive feedback to enhance the overall code quality
-
Azure Architect
il y a 2 semaines
Brussels, Belgique EUROPEAN DYNAMICS Temps plein**Your tasks** - Data analysis and modelling (large volumes of data from several data sources); - Design and development of architecture components and building blocks using cloud components; - Engineering of Azure data lake storage (raw data, unstructured, semi-structured, scrapped content); - Technical interface between project leaders and developers; -...
-
Devops Engineer Azure
Il y a 2 mois
Brussels, Belgique Michael Page Temps pleinIn the role of DevOps Engineer, your contribution consists of the following activities:You work principally as an Ops Engineer, with Automation Scripting Development responsibilitiesYou work closely with various stakeholders (Developers, Testers, cross-department SPOCs, Offshore teams, etc...).You are responsible of the Application's Life Cycle Management,...
-
Lead Cloud Architect- Azure
Il y a 2 mois
Brussels, Belgique Apollo Solutions Temps pleinLead Cloud Architect - Azure Apollo Solutions have partnered with a global financial services company based in the Netherlands, who are seeking an Interim Head Of Cloud & Architecture (Freelancer) to help grow and manage their existing 20+ strong Infrastructure team. They are currently undergoing a digital transformation project of taking VMs into a...
-
Lead Cloud Architect- Azure
il y a 11 heures
Brussels, Belgique Apollo Solutions Temps pleinLead Cloud Architect - Azure Apollo Solutions have partnered with a global financial services company based in the Netherlands, who are seeking an Interim Head Of Cloud & Architecture (Freelancer) to help grow and manage their existing 20+ strong Infrastructure team. They are currently undergoing a digital transformation project of taking VMs into a...
-
Azure DevOps Specialist
il y a 1 semaine
Brussels, Belgique Avanade Temps pleinCome join us By joining Avanade’s Software Engineering practice as an Azure DevOps Specialist, you’ll get the opportunity to operate at the forefront of technology, with access to best clients, on challenging and exciting projects. We’re a diverse team, and we’re proud of our culture that welcomes every individual. On our team, you’ll find...
-
Expert Développeur .NET
il y a 2 semaines
Brussels, Belgique Altelios Technology Group Temps pleinMARDI OBLIGATOIRE SUR LE SITE DE BRUXELLES. 2ÈME JOUR SUR SITE AU CHOIX ENTRE PARIS ET BRUXELLES **Contexte de la mission** Les activités principales sont: - Prendre en compte les spécifications fonctionnelles - Concevoir la solution technique - Estimation de la charge de travail - Développement (et tests unitaires) et documentation de l'API Web -...
-
Java Developer
il y a 3 semaines
Brussels, Belgique HNM Solutions Temps pleinRole: Java Developer AM Location: Brussels, Belgium Language: English Description: we are looking for a I(D)AM Java Developer. **Requirements**: Experience with RADIUS authentication and SCIM provisioning and setting up SSL trust are considered a plus. Good skills with debugging authentication flows, Azure AD Multi-Factor authentication (e.g. using any...
-
Data Integration Developer
Il y a 2 mois
Brussels, Belgique YER Temps pleinSalarisindicatie Interesting career opportunity with attractive conditions. - Jobdomein IT - Dienstverband Fulltime - Vacaturenummer VAC-10027452 - Locatie Brussel - Type overeenkomst Interim / ZZP, Projectsourcing via YER - Branche/sector IT & Telecom **Samenvatting**: Our client is actively searching a Azure Integration Services Developer to join it's...
-
Senior Azure Cloud Architect
il y a 4 semaines
Brussels, Belgique Avanade Temps pleinAvanade Belgium is looking for an experienced Azure Cloud Architect - are you looking to work with the latest Microsoft technology and want to make a difference to our clients from the enterprise market? Then this opportunity might just be what you’re looking for! Your role As an Azure Cloud Architect, you will design, build, and operate scalable and...
-
Senior Azure Cloud Architect
il y a 1 jour
Brussels, Belgique Avanade Temps pleinAvanade Belgium is looking for an experienced Azure Cloud Architect - are you looking to work with the latest Microsoft technology and want to make a difference to our clients from the enterprise market? Then this opportunity might just be what you’re looking for! Your role As an Azure Cloud Architect, you will design, build, and operate scalable and...
-
Senior Databricks Developer
Il y a 2 mois
Brussels, Belgique aug.e Temps pleinCompany Description **Job Description**: As a Senior Databricks Developer, you will be responsible for designing, developing, and implementing data solutions using Apache Spark, Azure and Python in a Medallion architecture. You will collaborate with cross-functional teams to develop and implement innovative solutions that meet our clients' data needs. You...
-
Java Developer Am
il y a 3 semaines
Brussels, Belgique HNM Solutions Temps plein**Job ID: HNMJD2900**: **Role: Java Developer** **AM** **Location**: **Brussels, Belgium** **Requirements**: - Experience with RADIUS authentication and SCIM provisioning and setting up SSL trust are considered a plus.- Good skills with debugging authentication flows, Azure AD Multi-Factor authentication (e.g. using any browser tracing/debugging tool) and...