
Open since Jul 2025
Software Engineer, Applied AI
AI Summary
Builds and ships AI-powered voice and audio intelligence systems that enable real-world conversational agents, extracting insights from offline audio data and powering natural speech interfaces for enterprise customers.
About this role
A Foundational Company
Rilla is on a mission to index the offline world.
Today, we’ve built the leading sales coaching software for organizations doing sales offline. We have over 1000 customers, including The Home Depot, KKR, Neighborly, and PulteGroup, using our product to enable AI sales coaching across their organization.
We are backed by Google Ventures, Bessemer Ventures, Crew Capital, and Broom Ventures, along with others.
We’re an in office team in NYC with builders who operate like high speed reinforcement learners. We obsess over our customers, move at a high velocity, are not afraid of failure, and look to maximize our real-world impact.
If you want to build the products and systems for how billions of conversations in the real world are captured and indexed, Rilla is the place to do it.
The Role
The Applied AI team at Rilla is redefining how humans interact with machines—using voice, intelligence, and a whole new class of data.
Every day, you’ll architect and ship AI-powered systems that make it possible for people to talk to Rilla like they would a human. You’ll help build agents that operate natively on real-world audio, extract insights from conversations no one else can even access, and push the boundaries of what’s possible in AI.
We’re building:
A voice-first interface that lets users command Rilla directly through natural speech
A search engine that uncovers business-critical insights from voice data that’s never been searchable
A first-of-its-kind audio intelligence pipeline—designed for the messy, noisy, wildly unstructured conversations that happen in the real world, not in an online meeting
As an early AI engineer, you’ll shape the foundations of our AI stack and drive the invention of new techniques, tooling, and models. You’ll work across the full AI lifecycle—from data acquisition to real-time inference and user-facing chat interfaces.
If you’re obsessive about your craft, think like a founder, and want to be on the frontier of voice and offline AI, this is your team. The scale of the problems we’re solving is unmatched—and the surface area for ownership is only getting bigger.
Technologies We Use
We work primarily in Python and TypeScript, with FastAPI for API development
AI/ML technologies including PyTorch, OpenAI APIs, Baseten, and LiteLLM
Cloud infrastructure with AWS and LiveKit for real-time communications
PostgreSQL, Redis, and S3 for data storage
What We Value
An infinite learner. Someone who is relentless in their curiosity.
A customer obsessive. Someone who deeply care about delighting customers and solving real pains, not vanity metrics.
A winning attitude. You thrive with extreme accountability, learning as a team, and both giving and receiving rapid feedback.
Extreme empathy. Our customers are not tech companies. They live and work in the real world. Empathy is critical to arriving at correct solutions.
Unafraid of failure. You take risks. You see failure as an opportunity to learn, grow, and be better the next time. In a weird way, you trick your brain into being excited when you fail, because it means you got a new opportunity to learn more.
What We Require
Experience building and deploying AI/LLM systems in production
Familiarity with tools that power today's AI: eval frameworks, agent tooling, and prompt engineering
Comfort working directly with customers to understand their needs and solve real-world problems
Don’t Work Here
Please don't join if you're not excited about:
Building an AI product for an industry untouched by modern software
Constantly talking to and visiting customers in the field
Working ~60 hrs/week in person with some of the most ambitious people in NYC
Attempting to build a generational company, and the intensity required to do so
Compensation
The estimated salary range for this position is $200,000 - $300,000/year.
Successful candidates with competing offers will receive matching and competitive offers.
Total compensation for this position may also include Incentive Stock Options, sign-on bonus, and other potential future incentives. This estimate excludes the value of any potential sign-on bonus; the value of any benefits offered; and the potential future value of any long-term incentives.
Our benefits aim to empower Rilla employees in removing roadblocks to achieving their life’s work. The list below details our available benefits and some of the perks that can be enjoyed as an employee of Rilla.
Benefits
Medical, dental, and vision insurance
Breakfast, lunch, dinner, and supplementary food and drink
Gym membership
Commuter benefits
Relocation assistance
Take what you need paid time off, not accrual based
$1,000 stipend for learning and personal growth
$1,500 a month rent stipend
Tech equipment
Skills
Explore related jobs
More jobs at Rilla
Similar Agent Tooling jobs
- C
Product Designer: AI Agent ToolsConstructor · Remote - Emea - 9
AI Engineer (Agents & Tools)99brightminds · Amman, Amman Governorate - T
Backend Engineer, Agent ToolsTrm Labs · United States - C
Tech Lead Manager, Human Agent ToolingChime Financial, Inc · San Francisco, CA - C
Senior Associate, Product Management | Capital One Travel - Agent Toolingcapital one · New York, New York - P
Agentic Tooling Engineer EU/UK remote remotePliant · Remote (European Union)
Jobs in New York
- M
Bezahlte Studie in New York - Deutsch-Muttersprachler:innen aus DeutschlandMindrift · New York, NY - M
Flexible Gig for German Speakers - 3-Day Paid Study, NYCMindrift · New York, NY - M
Paid Study for International Students - Native German Speakers from AustMindrift · New York, NY - M
Side Income for German Speakers - 3-Day Paid Study, NYCMindrift · New York, NY - M
Bilingual German-English Participant - Paid UX Study, New YorkMindrift · New York, NY - M
German Speaker Study Participant - NYC, $1,200-1,600Mindrift · New York, NY
Browse these categories
Market data for software engineer roles
All reports →- Role reportSoftware engineer jobs, Sep 2026: new listings down 9.7%New software engineer listings fell 9.7% to 1,506 this week, the first weekly drop in a month. Prioritize applications while 1,506 fresh roles remain open.
- Salary reportSoftware engineer salary 2026: median midpoint is $190,587The median published range midpoint for US software engineer roles is $190,587, with the middle half from $166,000 to $222,000.
- Market overviewState of tech hiring, September 2026: up 4.8%Tech hiring rose 4.8% month over month in September 2026, with 411,122 new listings. Customer support and account executive roles led the growth.