Posted 6 months ago

Senior AI/ML Engineer (AI Platform)

BostonRemoteFull-time

AI Summary

Senior AI/ML Engineer responsible for building and operating production AI systems, LLM tooling, and experimentation pipelines to power WHOOP's AI features, with mentorship of engineers and cross-team collaboration.

About this role

At WHOOP, we’re on a mission to unlock human performance and healthspan. WHOOP empowers members to perform at a higher level and live longer by using AI to transform continuous physiological data into clear insights and actionable recommendations. Our AI platform is central to this mission, turning raw physiological signals into trusted, personalized guidance that members can act on every day.

WHOOP is hiring a Senior AI/ML Engineer to help scale the intelligence layer behind WHOOP’s AI-powered experiences, including WHOOP Coach, AI-powered Support, and new intelligent features across the product. In this role, you will own core components of the AI Platform that power our internal AI Studio: evaluation pipelines, fine-tuning workflows, LLM observability, and experimentation tooling. You will partner closely with product and data science to translate real member needs into reliable, impactful AI systems that improve continuously based on real-world usage.

RESPONSIBILITIES:

Design, build, and operate production AI systems and scaffolding around language models that power conversational, predictive, and generative capabilities across WHOOP products.

Lead end-to-end AI system initiatives spanning problem definition, data flows, dataset design, evaluation harnesses, deployment, and iteration in close partnership with data science and product.

Build and maintain pipelines for collecting, curating, and reshaping messy, multi-source data into high-quality, well-structured training and evaluation datasets for language model–based systems.

Operationalize fine-tuning and evaluation workflows for large language models behind member-facing features such as WHOOP Coach and AI Support, including defining datasets, labels, and taxonomies that reflect real member needs.

Develop tooling and frameworks that make experimentation, offline/online evaluation, and model deployment faster, safer, and more repeatable, including robust observability for AI features in production.

Build and maintain feedback loops that connect real member interactions, offline evaluations, and training data updates so that models improve continuously based on real-world behavior.

Mentor other engineers and data scientists, share best practices in applied AI/ML, and help elevate the overall technical bar of the AI Platform team.

QUALIFICATIONS:

3+ years of experience in applied machine learning, AI engineering, or ML-focused software engineering roles, including significant work in production environments.

Hands-on experience building with modern language models (open-weight or API-based), including prompt design, fine-tuning, and rigorous evaluation.

Solid working understanding of ML fundamentals (dataset construction, feature engineering, training workflows, evaluation metrics, experiment design) sufficient to make good engineering tradeoffs and partner effectively with data scientists.

Familiarity with modern LLM training and alignment techniques such as supervised fine-tuning (SFT), direct preference optimization (DPO), and reinforcement learning (RL), and how they influence data requirements, evaluation strategies, and system design in production.

Proven track record building, shipping, and operating ML-powered systems end to end, from data pipelines (batch and/or streaming) that transform large datasets into usable training and evaluation sets to production deployments with inference optimization, observability, and lifecycle management.

Strong proficiency in data manipulation and analysis, including working with messy, multi-source, and semi-structured data and translating product questions into well-defined datasets, labels, and evaluation splits.

Familiarity with best practices for secure, privacy-aware AI and working with sensitive data.

Excellent communication and collaboration skills, with the ability to influence across teams and drive alignment on technical direction.

Skills

A/b TestingBatch/streaming ProcessingData PipelinesDataset DesignData WranglingDPOEvaluationExperimentation ToolingFine-tuningInference OptimizationLanguage ModelsLLM AlignmentML MetricsMultisource DataObservabilityPrivacy-preserving AIPrompt DesignRLHFSFTTraining Workflows

Explore related jobs

More jobs at Whoop

Similar A/b Testing jobs

Jobs in Boston

Browse these categories

A/b Testing Jobs Data Pipelines Jobs Observability Jobs Jobs in Boston Jobs in United States