Lead Machine Learning Engineer - Applied Scientist

Overview

Role focused on evaluating and improving LLMs and AI agents' performance.

Ideal candidate should have deep familiarity with LLM evaluation methodologies and hands-on experience in Python and ML frameworks.

Only candidates from 21 U.S. states are considered

Locations

• United States

Requirements

• Experience with LLM evaluation methodologies
• Hands-on experience in Python and ML frameworks
• Ability to work across teams and disciplines

Responsibilities

• Develop evaluation pipelines for LLM systems
• Define quality metrics for LLMs
• Lead experiments to improve system behaviors
• Collaborate with partners for product development
• Build automated testing and monitoring tools
• Share findings through documentation and demos

Benefits

• Comprehensive medical coverage
• Unlimited PTO
• 401(k) plan with matching
• 12 weeks of paid parental leave
• Employee Stock Purchase Plan