Senior AI Architect

We are seeking a highly experienced German-speaking Senior AI Architect for a long-term public-sector project in Germany. We're looking for an architect with a deep technical foundation in modern AI systems: someone who has led the architecture of multiple GenAI solutions and understands LLMs not just conceptually, but from the inside, including fine-tuning and productive deployment.

The environment is primarily on-premises / sovereign cloud, so experience designing AI systems outside of hyperscaler-native setups is key.

This is a long-term, full-time contract position, approx. 90% remote and 10% on site in Nuremberg.

Work Conditions

• Start Date: ASAP

• Location: ~90% remote, ~10% on site in Nuremberg

• Workload: Full-time

• Long-term contract based-role

Requirements

• Very good German and strong communication skills.

• Lead architect experience on at least 2–3 GenAI projects, ideally in the public sector (not required).

• In-depth knowledge of LLMs, RAG, GraphRAG, AI Gateways, and comparable architectures.

• Deep understanding of modern AI model architecture and hands-on implementation experience, e.g. LLM fine-tuning or building productive GenAI solutions.

• Experience with on-prem architectures or sovereign cloud environments.

• Technical background, ideally a degree in computer science, machine learning, artificial intelligence, or data science.

• Project management qualities are a strong plus.

Technical Requirements

Mandatory

• Large Language Models: architecture, selection, evaluation, deployment

• RAG and GraphRAG architectures

• AI Gateways and LLM orchestration patterns

• LLM fine-tuning and/or productive GenAI solution development

• On-prem or sovereign cloud AI infrastructure

Nice to have

• Public sector project experience (Germany / DACH)

• AWS

• Project management or technical delivery lead experience

• Academic background in ML, AI, or data science