Member of Technical Staff, Inference (Paris, London)
AI Summary
Build and optimize low-latency, distributed inference pipelines for on-device and cluster deployments, implementing efficient low-level kernels and serving systems to maximize throughput and real-time performance.
About this role
What You’ll Do
Build low-latency inference pipelines for on-device deployment, enabling real-time next-token and diffusion-based control loops in robotics
Design and optimize distributed inference systems on GPU clusters, pushing throughput with large-batch serving and efficient resource utilization
Implement efficient low-level code (CUDA, Triton, custom kernels) and integrate it seamlessly into high-level frameworks
Optimize workloads for both throughput (batching, scheduling, quantization) and latency (caching, memory management, graph compilation)
Develop monitoring and debugging tools to guarantee reliability, determinism, and rapid diagnosis of regressions across both stacks
What You’ll Bring
Deep experience in distributed systems, ML infrastructure, or high-performance serving (8+ years)
Production-grade expertise in Python, with strong background in systems languages (C++/Rust/Go)
Low-level performance mastery: CUDA, Triton, kernel optimization, quantization, memory and compute scheduling
Proven track record scaling inference workloads in both throughput-oriented cluster environments and latency-critical on-device deployments
System-level mindset with a history of tuning hardware–software interactions for maximum efficiency, throughput, and responsiveness
Skills
Explore related jobs
More jobs at Genesis
Similar Batching jobs
Jobs in Paris
Senior Teleoperations LeadTSMG · Paris
Robotics AI Data Collection OperatorTSMG · Paris
Robotics Teleoperations SpecialistTSMG · Paris
Hibachi ChefShogun Hibachi & Sushi · Paris, Texas
Vendeur.se Paris Saint Lazare-30h/sem CDD-aoûtEtam · PARIS, France
Vendeur.se Paris Saint Lazare-30h/sem CDD-aoûtGroupe ETAM · PARIS, France
