AI Engineer – LLMOps

Il y a 3 jours

Brussel, Brussel-Hoofdstad, Belgique Pauwels Consulting Temps plein 70 000 € - 120 000 €/an

Our client, a leading organization in the transport sector, is looking for a specialist to manage the operational phase of its AI-driven services. This role focuses on maintaining the reliability, performance, and security of production-scale AI agents and retrieval-based systems.

  • Monitor production AI services for availability and latency while managing incident root-cause analysis and resolution.
  • Maintain evaluation sets and track answer quality to detect and mitigate performance regressions.
  • Operate ingestion pipelines and manage the integration of new content sources and business domains.
  • Oversee agent interactions and monitor tool calls to ensure seamless integration with business systems.
  • Manage model version upgrades and configuration changes through validated deployment pipelines.
  • Track token consumption and service costs to propose architectural and operational optimizations.
  • Maintain infrastructure consistency using Terraform and Helm across multiple environments.
  • 3+ years of experience in AI development using Python and LangChain.
  • 3+ years of experience with Azure services, specifically Azure OpenAI, Azure AI Search, and Azure API Management.
  • 3+ years of experience managing containerized environments using Azure Kubernetes Service (AKS).
  • 3+ years of experience in Infrastructure as Code with Terraform and Helm.
  • Proven track record of operating RAG systems or AI agents in a production setting.
  • Hands-on experience with MLflow, Databricks, or OpenTelemetry for monitoring and tracing.
  • Practical knowledge of Azure DevOps for CI/CD pipeline management.
  • Experience with Vector databases and data ingestion workflows.
  • Proactive and analytical approach to troubleshooting complex technical issues.
  • You are fluent in English with a level of Native Dutch or Native French.

Nice to Haves

  • Experience with data protection impact assessments and access control logic.
  • Understanding of prompt engineering best practices for production reliability.
  • Start date: 04/01/2027.
  • Duration: 12 months.
  • Work regime: Full-time.
  • Location: Brussels.
  • Working model: Hybrid (2 to 3 days per week onsite).
  • Contract: open to both permanent employees and freelancers.