
Posted 1 month ago
Founding Platform Engineer
AI Summary
Builds the control plane, API, and serving layer for a heterogeneous inference cloud, scheduling mixed GPU and ASIC fleets and turning rack capacity into a sellable product as a founding technical hire.
About this role
About us
General Compute is the neocloud for alternative chips.
Inference is fragmenting: purpose-built silicon from SambaNova, Cerebras, Positron, d-Matrix, and others already beats GPUs on decode, and we productionize that hardware — we buy the racks, find the data center space, and run it for our customers. Each piece of hardware runs the workload it's actually built for: prefill stays on GPUs, decode moves to the chip built for it, and today that means generating tokens 5–7× faster than existing GPU-based competitors. Our customers are frontier labs, fast-growing AI application companies, and asset-light clouds.
We closed a $15M seed round in May 2026, and have since closed a $400M debt facility — $100M funded upfront by Upper90, with the balance available for drawdown — collateralized by our inference chips.
About the role
You will build the inference cloud itself — the control plane, API, and serving layer that turn racks into a sellable product. There's no existing platform team to inherit or manage, no legacy system to work around, and no established playbook to follow — just the platform itself to build, with reliability treated as core infrastructure from day one rather than something bolted on after the first outage.The technical problem is also genuinely unsolved elsewhere. The fleet is heterogeneous by design — GPUs for prefill, multiple ASIC vendors for decode — so there's no single-vendor playbook to lean on; you'll be defining how a mixed-hardware inference cloud gets scheduled, routed, and served reliably, in close partnership with the teams standing up the physical fleet.
What you'll do:
Build/own the control plane — routing, model placement, scheduling across a mixed ASIC/GPU pool
Build the API and serving layer exposing rack capacity as a sellable product
Build in reliability and observability from day one
Scale the platform ahead of the demand curve
Partner closely with data center deployment and model bring-up teams
Be a founding technical voice on platform architecture
Work at the boundary with the inference team. Own fleet-wide routing, placement, and capacity; hand off to the Inference Engineer for per-model serving performance (batching, KV-cache, quantization) rather than owning that layer yourself
What we need from you:
Strong systems engineering background on distributed cloud control planes and multi-tenant orchestration at scale (e.g., Kubernetes-style schedulers)
Comfort being a high-impact IC rather than a manager
Track record building reliability from scratch
Experience with resource scheduling or bin-packing algorithms for heterogeneous compute pools
Experience with multi-cluster federation or distributed consensus systems (Raft, ZooKeeper, or similar)
Comfort with hardware heterogeneity/ambiguity
Genuine interest in being an early hire at a ~6–7 person company
Nice-to-haves:
Experience with distributed job schedulers or cluster orchestration systems (Kubernetes, Nomad, Slurm, or similar)
Experience running non-NVIDIA accelerators (TPUs/ASICs) in production
Skills
Explore related jobs
More jobs at General Compute
Similar API Design jobs
- N
Senior API DesignerNN Personeel B.V. · Madrid - S
Principal Product Owner – Agentic API Design & GovernanceSabre Travel Technologies · Krakow, Małopolskie - CManager, Product Management- Enterprise API Platforms, API Designcapital one · McLean, Virginia
- T
Business Analyst | APIsTECDATA ENGINEERING · Barcelona, Spain - CPrincipal CX/UX Designer (API Developer Platform) – Hybrid (CT/ET) R0060120CCH Incorporated · USA - Coppell, Texas
- E
Openings for App Developer!!Endeavor IT Solution · Indore, MP
Browse these categories
Market data for devops / sre / platform engineer roles
All reports →- SeriesRole reportsOne role family at a time: how many openings, what changed this week, who is hiring, what it pays.
- SeriesSalary reportsWhat employers publish in job postings, by level and workplace. Not self-reported pay.
- Market overviewState of tech hiring, September 2026: up 4.8%Tech hiring rose 4.8% month over month in September 2026, with 411,122 new listings. Customer support and account executive roles led the growth.