Software Engineer - ML Infrastructure
AI Summary
Builds and scales ML infrastructure for real-time perception and inference across an edge-cloud platform, owning training, deployment, and optimization of computer vision and sensor fusion models.
About this role
Company Background
Specter is creating a software-defined "control plane" for the physical world. We are starting with protecting American businesses by granting them ubiquitous perception over their physical assets.
To do so, we are creating a connected hardware-software ecosystem on top of multi-modal wireless mesh sensing technology. This allows us to drive down the cost and time of deploying sensors by 10x. Our platform will ultimately become the perception engine for a company's physical footprint, enabling real-time perimeter visibility and autonomous operations management.
Our co-founders Xerxes and Philip are passionate about empowering our partners in the fast-approaching world of physical AI and robotics. We are a small, fast-growing team who hail from Anduril, Tesla, Uber, and the U.S. Special Forces.
Role + Responsibilities
Specter is hiring an ML infrastructure engineer to build and scale the machine learning systems that power real-time perception and inference across our edge-cloud platform. This role owns the training, deployment, and optimization of computer vision and sensor fusion models that enable autonomous monitoring and decision-making for our customers' physical assets.
Key responsibilities include:
Designing and implementing scalable ML training pipelines for computer vision models (object detection, tracking, classification, segmentation).
Building efficient model serving infrastructure for real-time inference on edge devices with constrained compute and power budgets.
Optimizing models for deployment on embedded hardware (quantization, pruning, TensorRT, ONNX, CoreML).
Developing continuous training and evaluation systems to improve model performance from production data feedback loops.
Creating data pipelines for ingesting, labeling, versioning, and managing massive multi-modal sensor datasets (video, radar, lidar, thermal).
Implementing model monitoring, A/B testing frameworks, and performance analytics for deployed perception systems.
Collaborating with perception researchers to transition models from research to production at scale across thousands of edge nodes.
Building tools and infrastructure for distributed training, hyperparameter optimization, and experiment tracking.
Preferred Qualifications
Strong experience with ML frameworks (PyTorch, TensorFlow) and model optimization tools (TensorRT, ONNX Runtime, OpenVINO).
Deep understanding of computer vision architectures and their deployment tradeoffs (YOLO, transformers, CNNs, real-time detection/tracking).
Hands-on experience deploying models on edge devices (NVIDIA Jetson, ARM processors, or similar embedded platforms).
Expertise building MLOps infrastructure — experiment tracking (Weights & Biases, MLflow), feature stores, model registries, CI/CD for ML.
Experience with distributed training frameworks (PyTorch DDP, DeepSpeed, Ray) and GPU cluster management.
Strong software engineering skills in Python and systems languages (C++, Rust) for performance-critical inference code.
Familiarity with video processing, sensor fusion, or multi-modal perception systems is a plus.
Prior experience in robotics, autonomous systems, or real-time ML applications is highly valued.
Skills
Explore related jobs
More jobs at Specter
Similar C++ jobs
Jobs in San Francisco
- Culinary Arts InstructorEquus · San Francisco, CA
- VP of MarketingMirantis · San Francisco, California
- Associate Project ManagerTurner & Townsend · San Francisco, California
- Cost Manager / Quantity Surveyor - Construction ManagementTurner & Townsend · San Francisco, California
- Community ManagerSia · San Francisco, CA
- Cost Manager / Quantity Surveyor - ConstructionTurner & Townsend · San Francisco, California
Browse these categories
Market data for software engineer roles
All reports →- Role reportSoftware engineer jobs, Sep 2026: new listings down 9.7%New software engineer listings fell 9.7% to 1,506 this week, the first weekly drop in a month. Prioritize applications while 1,506 fresh roles remain open.
- Salary reportSoftware engineer salary 2026: median midpoint is $190,587The median published range midpoint for US software engineer roles is $190,587, with the middle half from $166,000 to $222,000.
- Market overviewState of tech hiring, September 2026: up 4.8%Tech hiring rose 4.8% month over month in September 2026, with 411,122 new listings. Customer support and account executive roles led the growth.
