Jobless Developer
Hyphen Connect Limited logo
Hyphen Connect Limited

Posted 2 months ago

Open

AI Specialist (AI Engineering)

Hong KongOn-siteFull-time

AI Summary

AI Specialist Engineer focuses on optimizing large language and vision models for on-device inference, including model distillation, quantization, and hardware-specific deployment across NPU/GPU architectures.

About this role

We are looking for an AI Specialist Engineer to enhance the performance of large language and vision models for on-device inference. Your expertise will be crucial in developing and deploying cutting-edge AI solutions, ensuring optimal efficiency across diverse hardware architectures.

Responsibilities:

  • Compress and optimize large language and vision models for on-device inference.
  • Develop pipelines for model distillation and hardware-specific compilation.
  • Benchmark performance across various NPU/GPU architectures.

Qualifications:

  • Expertise in model distillation, pruning, and 4-bit/8-bit quantization techniques.
  • Hands-on experience with TensorRT, ONNX Runtime, and edge deployment.
  • Strong C++ and Python skills.

Skills

BenchmarkingC++Edge DeploymentGPUHardware-specific CompilationModel DistillationModel PruningNPUONNX RuntimePythonQuantization 4-bitQuantization 8-bitTensorRT

Explore related jobs

Browse these categories