AI Data Engineering Lead

Moonvalley

Overview

Role involves architecting and scaling data pipelines for generative video models.

Ideal candidate has deep experience in building data infrastructure for large-scale ML systems.

250k usd / yearremotepermanentfull-timeEnglishPythonSparkAirflowKubernetesTerraform

Locations

  • United Kingdom

Requirements

  • Experience in building data infrastructure
  • Experience in ML engineering
  • Experience managing large datasets
  • Experience leading small teams
  • Expertise in Python and Spark
  • Understanding of Kubernetes and Terraform

Responsibilities

  • Design and lead scalable data pipelines
  • Build systems for data ingestion and quality
  • Collaborate on data quality benchmarks
  • Optimize performance across data frameworks
  • Work with infrastructure teams
  • Manage data engineering team
  • Collaborate with filmmakers on data acquisition