Freelance Senior Databricks Platform Engineer
Enregistrez cette offre et organisez votre recherche
Créez un compte gratuit pour enregistrer des offres d'emploi, créer des alertes et revenir à cette liste depuis votre tableau de bord.
En continuant, vous acceptez nos Conditions d’utilisation & Politique de confidentialité.
adesso Belgium , who are we?
We are an IT (start-up) provider working under the adesso umbrella with proven track record in different industries. The new Belgian entity of adesso is part of the expansion and growth strategy of the adesso group.
Requirements
Start date: ASAP- Remote work Duration: 6 months Rate: TBD- depending on your location
Senior Databricks Platform engineer
Your Role in projects:
- Design & build data platforms
- Design and implement Lakehouse architectures on Databricks (medallion / bronze-silver-gold patterns, Delta Lake, Unity Catalog).
- Build robust batch and streaming data pipelines using PySpark and Spark SQL, orchestrated via Databricks Workflows / Jobs.
- Model data for analytics use cases (e.g. star schema for BI, curated datasets for data science).
Ingest, transform & govern data
- Ingest data from APIs, files, databases and SaaS sources into data lakes and lakehouses.
- Implement clear and testable transformation logic (data quality checks, deduplication, SCD, CDC, business rules).
- Apply data governance best practices (cataloguing, lineage, RBAC, masking of sensitive data).
Operate & optimize
- Set up CI/CD and deployment pipelines (Azure DevOps / GitHub) for Databricks assets (notebooks, jobs, pipelines, workflows).
- Using Terraform to automated IaaC setup and reusability
- Monitor, optimize and troubleshoot pipelines and clusters for performance, robustness and cost efficiency.
- Help define and implement best practices, coding standards and reusable components within the team.
Your profile - Required technical skills & knowledge:
- Proven experience in:
- Databricks platform architecture
- Unity Catalog and governance
- CI/CD and DevOps for Databricks - Enterprise GitHub
- Terraform / Infrastructure as Code
- Lakehouse architecture
- Data Product Platform enablement
- The Knowledge Graph, ontology and agentic AI are considered a strong plus.
- Unity catalogue, CICD, IAC and terraform skills in mode implementation and integration
Why join adesso Belgium ?
- Work in an international group with strong local expertise in Belgium.
- Collaborate with cross-functional teams within the international data & AI adesso community.
- Flexible freelance setup with the support of a growing adesso Belgium community.
For one of our international customers, we are urgently looking for a senior Databricks Platform engineer.