
Posted 24 days ago
Founding Engineer
AI Summary
Founding engineer owning systems end to end across frontend, backend, infrastructure and data, working directly with customers to ship features that help companies get recommended and used by coding agents. Includes building evals, benchmarks and agent-driven documentation pipelines.
About this role
Company Description
AI agents are becoming how software gets chosen. Developers ask Claude Code, Codex, Cursor and ChatGPT which tool to use, and more and more they let the agent pick and integrate it. If an agent doesn't recommend you, or loops trying to figure out how to use your product, it moves on to something else.
Lightsage gets companies ready for the agent economy: visible to agents, so they get recommended, and usable by agents, so integrations work the first time. We track how often coding agents and AI answer engines recommend a company against its competitors, run real coding agents against its APIs, CLIs and MCP servers to find where they fail, and tell the team exactly what to change.
We work with category leaders in AI and developer tools, including Firecrawl, Reducto, Scalekit, TinyFish, Daytona, Rime and Meetstream, and we run DevToolArena.com, a public benchmark that ranks developer tools by how well coding agents use them.
We've raised a $4M seed led by Nexus Venture Partners, and we're backed by growth leaders and founders of Postman, Apollo, Firecrawl, Resend, Daytona, TinyFish and others. Our goal is to be the default for any company that wants to win with agents.
Role Description
This is one of the first engineering roles at Lightsage. You'll join the founding team in San Francisco. You'll own systems end to end across frontend, backend, infrastructure and data, and work directly with customers to turn their problems into shipped features.
Early projects include:
Improving recommendation quality, and measuring whether a recommended change actually helps a customer
Designing the experiments and benchmarks that tell us which changes actually make agents recommend and use a product
Building agents that write, publish and re-test documentation changes for customers
Adding support for new coding agents and models as they're released
Scaling eval and data pipelines for enterprise customers
New models ship every few weeks, so the work changes constantly. The team builds with AI coding tools and our own agent orchestrator, and reviews all code before it ships.
Requirements
Track record of taking a loosely defined customer or product problem to a shipped solution with little direction
Strong backend experience, including building reliable systems that handle production load
Hands-on experience shipping quickly with AI coding tools such as Claude Code or Codex
Clear thinking about technical trade-offs, and clear written communication
Experience doing research or running rigorous experiments, such as LLM evals, benchmarks or A/B tests, and drawing sound conclusions from noisy results is a plus
Experience with Next.js, FastAPI, Supabase or Microsoft Azure is a plus
Prior founder or early-stage startup experience is a plus
This is a full-time, on-site role in San Francisco. It's a demanding schedule that regularly includes weekends, with significant ownership over the company's technical direction.
Skills
Explore related jobs
More jobs at Lightsage
Similar A/b Testing jobs
- A
Consultant – Oracle CC&B TestingAvance Consulting Services · San Francisco, CA - R
Oracle CC&B Test LeadRed Clay Consulting · Remote - M
Amazon Graphic Designer (with A/B Testing)Multiplymii · Remote Philippines - K
B-52 Test ManagerKellogg Brown & Root Pty Ltd · Beavercreek Township, Ohio - N
Google Ads / SEA Marketing ManagerIn für Growth Hacking | A/B-Testing | Performance MarketingNetzproduzenten® GmbH · Dresden, Germany - T
Sr Data Analyst, Ecommerce & Product Analytics (Experimentation, Math/Stats, A/B testing, ML)Target Corporation · 1000 Nicollet Mall, Minneapolis
Jobs in San Francisco
- O
SMB Customer Account ExecutiveOkta · San Francisco, CA - A
Assistant Director, People & CultureAccorhotel · San Francisco, CA - S
Data Scientist, GrowthSuperhuman · Hub - San Francisco - T
AI Safety & Red Teaming Leadtalentpluto · San Francisco, CA - K
Business Development RepresentativeKinly · San Francisco, California - V
Principal Perfusionist - San Francisco, CAVitalhire · San Francisco, CA
Browse these categories
Market data for this role
All reports →- SeriesRole reportsOne role family at a time: how many openings, what changed this week, who is hiring, what it pays.
- SeriesSalary reportsWhat employers publish in job postings, by level and workplace. Not self-reported pay.
- Market overviewState of tech hiring, September 2026: up 4.8%Tech hiring rose 4.8% month over month in September 2026, with 411,122 new listings. Customer support and account executive roles led the growth.