Posted 3 months ago

Applied Scientist — ML, Experimentation & Decision Systems

AustinOn-siteFull-time

AI Summary

Applied Scientist builds and measures ML systems powering engagement and operational workflows, trains models, evaluates performance, and designs A/B tests to impact real-world outcomes.

About this role

Everlywell is a digital health company pioneering the next generation of biomarker intelligence—combining AI-powered technology with human insight to deliver personalized, actionable health answers. We transform complex biomarker data into life-changing insights—seamlessly integrating advanced diagnostics, virtual care, and patient engagement to reshape how and where health happens.

Over the past decade, Everlywell has delivered close to 1 billion personalized health insights, transforming care for 60 million people and powering hundreds of enterprise partners. In 2024 alone, an estimated 1 in 86 U.S. households received an Everlywell test, solidifying our spot as the #1 at-home testing brand in the country. And we’re just getting started. Fueled by AI and built for scale, we’re breaking down barriers, closing care gaps, and unlocking a more connected healthcare experience that is smarter, faster, and more personalized.

Everlywell operates large-scale health engagement programs that help health plan members complete important care actions — from returning diagnostic kits to accessing preventive and virtual care.

We’re hiring an Applied Scientist to build and measure the ML systems that power these programs. This role is focused on machine learning, experimentation, and production measurement. You’ll train models, evaluate performance, design A/B tests, and work with engineering and business stakeholders to improve real-world outcomes.

This is a high-impact opportunity to apply ML and experimentation skills to systems that influence real member outcomes at scale. You’ll work on practical, production-facing problems with clear business value, strong cross-functional visibility, and room to help shape how Everlywell uses both ML and AI in operational workflows.If you’re excited by hands-on modeling, rigorous experimentation, and building systems that improve decisions in the real world, we’d love to hear from you.

Responsibilities

Build and improve ML models used in engagement and operational workflows

Develop models for prediction, prioritization, uplift, and related decisioning use cases

Define and monitor model performance, business impact, and system health

Design and analyze A/B tests and other measurement approaches to evaluate incremental impact

Partner with stakeholders to define success metrics and turn findings into decisions

Support production rollout and ongoing monitoring with engineering teams

Help evaluate AI- and LLM-powered workflows used in production settings

Skills & Abilities Required:

5+ years in Applied Science, Data Science, ML, Decision Science, or similar roles

Strong hands-on experience training, evaluating, and improving ML models

Strong experience designing and analyzing A/B tests

Strong Python and SQL skills

Experience measuring model, program, or product performance in production

Ability to work cross-functionally and communicate clearly with stakeholders

PreferredExperience in experimentation platforms, growth or lifecycle modeling, or ML-driven decision systems

Experience with causal inference or uplift modeling

Experience with LLMs, AI agents, or automated workflows in production

Experience in healthcare or regulated environments

Snowflake, Python, dbt, Airflow, model registry systems, GitLab

Skills

A/b TestingAI AgentsAirflowCausal InferenceDbtDecision SystemsExperimentation PlatformsGitLabGrowth Or Lifecycle ModelingLLMsMeasurement Of Model/program/product PerformanceML Model DevelopmentML WorkflowsModel Registry SystemsProduction MonitoringPythonSnowflakeSQLUplift Modeling

Applied Scientist — ML, Experimentation & Decision Systems

About this role

Responsibilities

Skills & Abilities Required:

Skills

Explore related jobs

More jobs at EverlyWell

Similar A/b Testing jobs

Jobs in Austin

Browse these categories