
Posted 14 days ago
LLM Deployment Engineer
AI Summary
Deploys and scales open-weights LLMs on cloud and local clusters, connects them to internal automation use cases, evaluates model effectiveness, and embeds security and privacy into the pipeline.
About this role
About the role
We are seeking an LLM Deployment Engineer to drive the adoption of AI-powered automation across the organization. In this role, you will deploy and scale LLMs to streamline business processes and assist engineering R&D.
You'll work at the intersection of ML, software infrastructure engineering, and enterprise systems, by developing integration and automation solutions that enable teams across the organization to operate more efficiently.
What You´ll Do
· Deploy and maintain open-weights LLMs on cloud and local cluster.
· Scale deployments to serve a large number of users within the organization.
· Be up-to-date with new model releases, to keep our deployment state of the art.
· Connect LLMs to specific use cases, helping users across the organization to automate their work routine.
· Analyze the effectiveness of models on automation tasks.
· Embed security and privacy in the automation pipeline, to safeguard sensitive content.
Requirements
What You’ll Need
· 3+ years of professional experience in software engineering
· Experience working with LLM APIs, both open-weight and proprietary
· Familiarity with LLM applications, including tools, retrieval-augmented generation (RAG) and routing
· Experience with CI/CD pipelines, infrastructure as code, and modern software delivery practices
· Understanding of security and privacy considerations in enterprise environments
· Strong problem-solving skills and the ability to collaborate effectively across technical and non-technical teams
Nice to have
· Knowledge of Model Context Protocol (MCP) or similar interoperability standards
· Experience with AI governance, observability, or operational monitoring
· Proficiency with cloud platforms (AWS, GCP, or Azure), and high-performance computing environments (Kubernetes, SLURM).
· Experience in evaluating ML models.
Who You Are
You thrive in fast-paced environments where ambiguity is part of the challenge, and you can turn it into defined goals. You take ownership seriously and move things forward without waiting for perfect conditions. You know how to balance structure with flexibility without losing focus. Above all, you measure success by outcomes and take pride in getting things done.
Skills
Explore related jobs
More jobs at Destinus
Similar AI Observability jobs
- A
AI Observability EngineerAIG Employee Services, Inc. · GA-Atlanta - P
Principal Product Manager - AI Observability (Chronosphere)Palo Alto Networks, Inc. · Victoria, Australia - P
Manager, Software Engineering - AI Observability (Chronosphere)Palo Alto Networks, Inc. · Victoria, Australia - 9
Platform Engineer - AI Observability & Governance (OpenShift)94-1687665 Bank of America, National Association · Charlotte - C
AI Observability Engineering Technical LeaderCisco Systems, Inc. · Milpitas, California - B
Staff AI Observability & Telemetry EngineerBitdeer Technologies Group · San Jose, United States
Jobs in Zürich
- G
Sales Advisor - French & English-Speaking Closing SpecialistGOWAGO AG · Zürich, Switzerland - M
Extra / Aushilfe Dumpling Bar (Globus Bellevue), approx. 20h per weekMadame Sum · Zürich, Switzerland - VSteuerberaterIn (60-100%)VIVA HR Consulting · Zürich, Switzerland
- W
Senior Expert Java DevOps Engineer (Ref.Nr.: 48308)Wavestone Germany AG · Zürich, Switzerland
Browse these categories
Market data for this role
All reports →- SeriesRole reportsOne role family at a time: how many openings, what changed this week, who is hiring, what it pays.
- SeriesSalary reportsWhat employers publish in job postings, by level and workplace. Not self-reported pay.
- Market overviewState of tech hiring, September 2026: up 4.8%Tech hiring rose 4.8% month over month in September 2026, with 411,122 new listings. Customer support and account executive roles led the growth.