Posted 3 months ago
Senior Software Engineer Modelzoo
AI Summary
Implement and optimize machine learning models on specialized hardware accelerators, focusing on quantization, performance tuning, and deployment of deep learning models.
About this role
Job Title: Software Engineer (2-3 years experience)
Job Summary
We're looking for a skilled and motivated Machine Learning Software to join our team. The ideal candidate will have a solid foundation in deep learning and a strong interest in optimizing and deploying ML models on specialized hardware. This role involves implementing model optimizations, with a particular focus on quantization, to improve the performance of machine learning inference on target platforms.
Key Responsibilities
- Model Porting & Deployment: Port and deploy deep learning models from frameworks like PyTorch and TensorFlow to proprietary or commercial ML accelerator hardware platforms.
- Performance Optimization: Analyze and improve the performance of ML models for target hardware, focusing on latency and throughput.
- Quantization: Contribute to model quantization efforts (e.g., INT8) to reduce model size and accelerate inference while maintaining model accuracy.
- Profiling & Debugging: Use profiling tools to identify and fix performance bottlenecks in the ML inference pipeline on the accelerator.
Required Qualifications
Technical Skills:
- Proficiency in deep learning frameworks such as PyTorch and TensorFlow.
- Hands-on experience with deploying and optimizing models on GPUs or other specialized accelerators.
- Some experience with model quantization (Post-Training Quantization).
- Strong proficiency in C++ and Python.
- Experience with GPU programming models like CUDA/cuDNN is a plus.
- Familiarity with ML inference engines and runtimes (e.g., TensorRT, OpenVINO, TensorFlow Lite).
- Foundational understanding of computer architecture principles.
- Version Control: Proficient with Git and collaborative development workflows.
- Education: Bachelor's or Master's degree in Computer Science, Electrical Engineering, or a related field.
Preferred Qualifications
- Knowledge of hardware-aware model design.
- Familiarity with compiler technologies for deep learning.
- Experience with real-time or embedded systems.
- Knowledge of cloud platforms (AWS, GCP, Azure).
- Experience with CI/CD pipelines for ML models.
Skills
Explore related jobs
More jobs at NXP USA Inc.
Similar C++ jobs
Jobs in Hyderabad
- GArchitect- DEXGlobalpepsico · Hyderabad, TS
- LCost Manager CSA for India Data Centre ProjectsLinesight · Hyderabad, India
- LCost Manager MEP for India Data Centre ProjectsLinesight · Hyderabad, India
- GDeputy Director - DevSecOpsGlobalpepsico · Hyderabad, TS
- GArchitect-Agentic AIGlobalpepsico · Hyderabad, TS
- GSr. Executive -ClaimsGlobalpepsico · Hyderabad, TS
Browse these categories
Market data for software engineer roles
All reports →- Role reportSoftware engineer jobs, Sep 2026: new listings down 9.7%New software engineer listings fell 9.7% to 1,506 this week, the first weekly drop in a month. Prioritize applications while 1,506 fresh roles remain open.
- Salary reportSoftware engineer salary 2026: median midpoint is $190,587The median published range midpoint for US software engineer roles is $190,587, with the middle half from $166,000 to $222,000.
- Market overviewState of tech hiring, September 2026: up 4.8%Tech hiring rose 4.8% month over month in September 2026, with 411,122 new listings. Customer support and account executive roles led the growth.