
Posted 1 month ago
AI ML Ops EngineerTarento Technologies · Bengaluru
AI ML Ops Engineer
BengaluruHybridFull-time
AI Summary
Deploys, scales and monitors ML models and pipelines in production, building the infrastructure and CI/CD automation that moves models from training to serving and keeps them healthy, with a focus on GPU inference for speech and translation models.
About this role
About Tarento:
Tarento is a fast-growing technology consulting company headquartered in Stockholm, with a strong presence in India and clients across the globe. We specialize in digital transformation, product engineering, and enterprise solutions, working across diverse industries including retail, manufacturing, and healthcare. Our teams combine Nordic values with Indian expertise to deliver innovative, scalable, and high-impact solutions.
We're proud to be recognized as a Great Place to Work, a testament to our inclusive culture, strong leadership, and commitment to employee well-being and growth. At Tarento, you’ll be part of a collaborative environment where ideas are valued, learning is continuous, and careers are built on passion and purpose.
Designation: Senior Software Engineer – Analytics
Location: Indore
Educational Qualifications: B.E/B.Tech
Exp: 3-5 Years
Mode of work: Hybrid
Role Overview
We are seeking an AI/ML Ops Engineer to own the deployment, monitoring, and scaling of ML models and pipelines in production. You will build the infrastructure and automation that lets models move reliably from training to production and stay healthy once there.
What you'll do
- Deploy and scale ASR, NMT and TTS models on GPU servers using Docker, Kubernetes and Triton Inference Server
- Build and maintain CI/CD pipelines that take models from training to production
- Monitor services for latency, throughput, errors and GPU utilization, and help debug production issues
- Help optimize inference performance for real-time use cases such as live transcription and voice agents
- Help manage GPU capacity across cloud and on-prem environments
Must have
- 2+ years of hands-on Docker and Kubernetes experience
- CI/CD tooling (GitHub Actions, GitLab CI or Jenkins)
- Strong Python for automation and tooling
- Experience on any cloud platform (AWS, Azure or GCP)
- Has deployed at least one ML model to production with any serving framework (Triton, TorchServe, FastAPI or similar)
- Comfortable with Linux and debugging services
Good to have
- Triton Inference Server: model repositories and dynamic batching
- GPU infrastructure (NVIDIA drivers/CUDA, GPUs on Kubernetes)
- Prometheus and Grafana
- ONNX or TensorRT model conversion
- Serving speech or LLM models where latency matters
- gRPC or streaming services
- NVIDIA NVCF or NIM
- Helm or Terraform
Skills
AWSAzureCI/CDCUDADockerGCPGitHub ActionsGitLab CIGrafanaHelmJenkinsKubernetesLinuxONNXPrometheusPythonTensorRTTerraformTriton Inference Server
Explore related jobs
More jobs at Tarento Technologies
Similar CI/CD jobs
- DSenior Technical Specialist - AWS/AWS Lambda/AWS Glue/AWS SNSDatavail · Bengaluru, Karnataka
- C
AWS EngineerCaxton Associates · Bengaluru, Karnataka - L
Arquitecto AWSLogicalis Spain · Madrid, Spain - S
Consultant - AWSSoftwareOne · Mumbai, India - A
Architect AWSArete Technologies, Inc. · Cambridge, MA - E
AWS DeveloperExcyl Inc · Washington, DC
Jobs in Bengaluru
- T
Machine Learning EngineerTop Closers · Bengaluru, Karnataka - O
Optical ConsultantOptical Consultant at shivaopticals · Bangalore, Karnataka - PPayroll AssociatePayroll Associate at Resolveindia7 · Bangalore, Karnataka
- PSenior Web Engineer - APIPlivo · Bengaluru, Karnataka
- NTerritory Business ManagerNovopay · Bangalore, Karnataka
- NTechnical ArchitectNovopay · Bangalore, Karnataka
Browse these categories
Market data for ai / ml engineer roles
All reports →- SeriesRole reportsOne role family at a time: how many openings, what changed this week, who is hiring, what it pays.
- SeriesSalary reportsWhat employers publish in job postings, by level and workplace. Not self-reported pay.
- Market overviewState of tech hiring, September 2026: up 4.8%Tech hiring rose 4.8% month over month in September 2026, with 411,122 new listings. Customer support and account executive roles led the growth.