Posted 2 months ago
AI Specialist (AI Engineering)
BostonRemoteFull-time
AI Summary
An AI Specialist Engineer compresses and optimizes large language and vision models for on-device inference, developing pipelines for model distillation and hardware-specific compilation, and benchmarking performance across NPU/GPU architectures.
About this role
We are looking for an AI Specialist Engineer to enhance the performance of large language and vision models for on-device inference. Your expertise will be crucial in developing and deploying cutting-edge AI solutions, ensuring optimal efficiency across diverse hardware architectures.
Responsibilities:
- Compress and optimize large language and vision models for on-device inference.
- Develop pipelines for model distillation and hardware-specific compilation.
- Benchmark performance across various NPU/GPU architectures.
Qualifications:
- Expertise in model distillation, pruning, and 4-bit/8-bit quantization techniques.
- Hands-on experience with TensorRT, ONNX Runtime, and edge deployment.
- Strong C++ and Python skills.
Skills
C++Edge DeploymentModel DistillationONNX RuntimePruningPythonQuantization 4-bit/8-bitTensorRT
Explore related jobs
More jobs at Hyphen Connect Limited
- General Counsel (Crypto & Commercial Litigation) - Hong Kong OnsiteAPAC
- Content Operations Specialist (US stock contract) - Crypto ExchangeGlobal
- VIP BD Manager/ Director - Global RemoteGlobal
- Web3 Frontend Developer (UX)APAC
- Sales Operations ManagerRemote - Hangzhou, China
- Compliance Officer/ Money Laundering Reporting Officer (CO/MLRO)Hong Kong
Similar C++ jobs
Jobs in Boston
Senior Teleoperations LeadTSMG · Boston, Morocco
Robot Teleoperator (AI & Robotics)TSMG · Boston, Morocco
Robotics Operations TechnicianTSMG · Boston, Morocco
Pre-pull Engineer - BostonSubstantial Group · Boston- Home Infusion NurseLUX Infusion · Boston, Massachusetts
Robotics AI Data Collection Operator (Robot Trainer)TSMG · Boston, Morocco