Jobless Developer
Hyphen Connect Limited logo
Hyphen Connect Limited

Posted 1 month ago

Open

AI Specialist (AI Engineering)

ChinaOn-siteFull-time

AI Summary

AI Specialist Engineer focused on compressing and optimizing large language and vision models for on-device inference, including model distillation, hardware-specific compilation, and benchmarking across NPU/GPU architectures.

About this role

We are looking for an AI Specialist Engineer to enhance the performance of large language and vision models for on-device inference. Your expertise will be crucial in developing and deploying cutting-edge AI solutions, ensuring optimal efficiency across diverse hardware architectures.

Responsibilities:

  • Compress and optimize large language and vision models for on-device inference.
  • Develop pipelines for model distillation and hardware-specific compilation.
  • Benchmark performance across various NPU/GPU architectures.

Qualifications:

  • Expertise in model distillation, pruning, and 4-bit/8-bit quantization techniques.
  • Hands-on experience with TensorRT, ONNX Runtime, and edge deployment.
  • Strong C++ and Python skills.

Skills

4-bit Quantization8-bit QuantizationC++Edge DeploymentModel DistillationONNX RuntimePruningPythonTensorRT

Explore related jobs

Browse these categories