Principal Software Engineer
AI Summary
A Principal Software Engineer owns and drives platform-level, cross-team initiatives end-to-end — from requirements and architecture through implementation, rollout, and observability — while mentoring senior engineers and setting technical standards.
About this role
Arcadia's platform is the backbone of how partners and customers act on healthcare data at national scale. Principal Engineers are the technical owners of the cross-team initiatives and platform-level outcomes that define what Arcadia's engineering organization is capable of — the engineers others look to when the right answer is structural, not incremental.
A Principal Engineer at Arcadia owns the complete vertical slice: requirements through customer validation, design through long-term operation. They raise the floor for the engineers around them through direct coaching, reusable patterns, and the tooling they leave behind. They define how the team adopts AI as a leverage multiplier — not just for their own productivity, but as a standard the team and the org can adopt.
- You have deep familiarity with your domain's platform surface, key dependencies, and the customer outcomes the team owns
- You have identified the two or three most leveraged technical investments in your area and aligned with Product, Engineering Management, and key partners on a plan
- You have established working relationships with the Senior Engineers you'll coach and the cross-team peers you'll collaborate with most often
- You are driving a multi-team or platform-level initiative end-to-end — requirements and architecture through implementation, rollout, and observability
- You are visibly raising the floor on Senior Engineer execution through design reviews, code review, pairing, and direct coaching
- You have shipped AI-native tooling, workflows, or patterns that other teams in the org have adopted, with at least one peer team actively coached on how to apply them
- You own the technical health, scalability, and customer-facing outcomes of a significant platform domain
- You are recognized cross-team for technical judgment, calibration, and the quality of the engineers whose trajectory you've shaped
- You have defined and operate a measurable bar for how engineers across multiple teams adopt agentic AI-assisted engineering — what good looks like, what to avoid, and how to spread it
What You'll Be Doing
What You'll Bring
Would Love for You to Have
Tech You'll Work With
Arcadia's platform processes petabyte-scale healthcare data through a lakehouse architecture built on open table formats. Apache Spark drives distributed compute; dbt drives transformations; Kafka moves streams; Cassandra/Scylla handles high-throughput storage; OpenSearch / Elasticsearch powers search and indexing — all orchestrated on Kubernetes in AWS, with services spanning TypeScript/Node, Python, Go, and Java/Kotlin (polyglot, by design).
We're actively expanding this entire platform-stack to be AI-native — enabling the creation of custom agents built on Arcadia's data foundation to solve some of healthcare's biggest challenges. Principal Engineers shape the patterns here. Depth in distributed compute, data infrastructure, or platform engineering translates directly.
What You'll Get
Skills
Explore related jobs
More jobs at Arcadia
Head of Revenue OperationsRemote (USA)
Staff Applied AI Engineer, Product & Agent PerformanceRemote (USA)
Chief of Staff - Commercial StrategyRemote (USA)
Senior / Lead Analyst, Customer InsightsRemote (USA)
Business Development RepresentativeBoston, DC
Principal Talent Acquisition Manager (Technical Recruiting)Remote (USA)
Similar Apache Spark jobs
- Software Engineer 2 (Hybrid) - Linux/Bash/Apache Airflow/Apache Spark/Docker/Podman/Git/AWSCaptivation Software · Annapolis Junction, MD - Hybrid
- Senior Data Engineer – Apache Spark | Kafka | Flink | Trino | Iceberg | Big Data | Streaming | Data Platform 8–12 YearsCisco Systems, Inc. · Bangalore, India
Software Engineer, Spark PlatformDoorDash USA · San Francisco, CA
Browse these categories
Market data for software engineer roles
All reports →- Role reportSoftware engineer jobs, Sep 2026: new listings down 9.7%New software engineer listings fell 9.7% to 1,506 this week, the first weekly drop in a month. Prioritize applications while 1,506 fresh roles remain open.
- Salary reportSoftware engineer salary 2026: median midpoint is $190,587The median published range midpoint for US software engineer roles is $190,587, with the middle half from $166,000 to $222,000.
- Market overviewState of tech hiring, September 2026: up 4.8%Tech hiring rose 4.8% month over month in September 2026, with 411,122 new listings. Customer support and account executive roles led the growth.