Software Engineer, Distributed Systems
AI Summary
An experienced software engineer designing, building, and scaling large distributed compute platforms, owning core platform components and forward designs to support massive scale and low-latency global workloads.
About this role
You are an experienced software engineer who thrives on building large-scale computing platforms. You have deep expertise in large scale distributed systems that deal with high complexity, a lot of traffic and data. You know how to achieve reliability and scale with minimum operational load.
Key responsibilities
Build our core Python/Rust platform: request routing, AI workload orchestration, scheduling, GPU autoscaling, large scale file storage, queueing, etc
Produce forward designs for platform evolution as we scale to 100x current traffic and need to provide low latency across the world
Leverage AI to an extreme level to automate the mundane parts of building complex but reliable systems
Profile and tune low level CPU and memory performance
Requirements
5+ years experience building distributed compute and orchestration platforms in Python or Rust
Strong understanding of distributed systems fundamentals: consensus, scheduling, fault tolerance, capacity planning
Deep understanding of computational complexity and memory allocation
Track record of designing systems that scale under real production load
Experience building and using observability to drive performance and reliability decisions
Excellent communication and ability to drive technical decisions across teams
Self-starter who executes quickly, takes ownership, and constantly seeks improvement
Nice to have
Experience with AI/ML inference or training infrastructure
Experience with high-performance systems programming (async runtimes, zero-copy, memory-safe concurrency)
Background in building multi-tenant compute platforms
Understanding of networking fundamentals and performance characteristics
Familiarity with GPU workload characteristics and scheduling constraints
Location
Turkey
What we offer at fal
Interesting and challenging work
A lot of learning and growth opportunities
Regular team events and offsites
Skills
Explore related jobs
More jobs at fal
Similar AI/ML Inference jobs
Browse these categories
Market data for software engineer roles
All reports →- Role reportSoftware engineer jobs, Sep 2026: new listings down 9.7%New software engineer listings fell 9.7% to 1,506 this week, the first weekly drop in a month. Prioritize applications while 1,506 fresh roles remain open.
- Salary reportSoftware engineer salary 2026: median midpoint is $190,587The median published range midpoint for US software engineer roles is $190,587, with the middle half from $166,000 to $222,000.
- Market overviewState of tech hiring, September 2026: up 4.8%Tech hiring rose 4.8% month over month in September 2026, with 411,122 new listings. Customer support and account executive roles led the growth.
