Staff Data Engineer, AI Evaluation

Overview

Data Engineer focused on building and optimizing data and analytics pipelines for AI evaluation.

Ideal candidate has 5+ years in data engineering with strong Python and SQL skills.

Locations

• United Kingdom, England, London

Requirements

• Proficiency in Python and SQL
• Experience with data processing frameworks
• Ability to design scalable ETL pipelines
• Knowledge of data modelling best practices
• Experience in workflow orchestration
• Strong understanding of testing tools
• Familiarity with cloud infrastructure
• Ability to collaborate with stakeholders

Responsibilities

• Build scalable data pipelines
• Collaborate with cross-functional teams
• Improve pipeline observability
• Enable LLM-driven workflows
• Reduce tech debt
• Design distributed data pipelines
• Integrate with Databricks
• Shape evaluation data