Senior Software Engineer, AI

About UpDoc

At UpDoc, we are building the first clinically validated, physician-supervised AI agent that manages chronic diseases. We are an early-stage startup founded by Stanford physicians.

We are seeking a talented and motivated senior engineer to join our team. You will primarily work on UpDoc’s patient-facing conversational agent. This is a fully remote position.

Who You Are

You’re an experienced senior engineer with a backend tilt. You’re well-versed in all things web and have experience building LLM applications end-to-end, even if not in a professional context. You follow the AI/LLM space closely, play with new technologies as they come out, and are excited to use these technologies to build safe, reliable medical AI systems.

What You'll Do

• Lead the development of our patient-facing conversational agent

• Implement a scalable, low-latency system for voice/multimodal conversations

• Implement rigorous prompt engineering processes and develop useful metrics for system evaluation

• Identify where fine-tuning and alignment might be valuable, and create data pipelines to enable fast experimentation

• Work with other backend engineers to deploy AI models and chat/voice APIs

• Help identify, evaluate, and implement emerging LLM technologies, tools and frameworks

• Collaborate with clinical experts to validate performance and medical accuracy

• Work on developing backend services using FastAPI and Pydantic

What You’ll Need

• 5+ years of professional software development experience, including 2+ years of experience with backend web development

• Experienced and comfortable working with type-hinted, modern Python

• 2+ years of experience building end-to-end LLM applications, personally or professionally

  • Experience integrating/optimizing LLMs in production environments

  • Knowledge of evaluation frameworks

  • Knowledge and experience with MLOps/LLMOps best practices

  • Experience building AI infrastructure from 0 -> 1

• Experience with cloud platforms (especially Azure) and containerization technologies

Highly Desired

• Professional experience building end-to-end LLM-powered applications

• Experience with model fine-tuning/alignment

• Experience in an early stage startup environment

• Experience with healthcare industry standards, such as FHIR, and regulations, including HIPAA and SOC 2