AI Systems Architect - LLM & Vector Infrastructure
AI Summary
Senior AI Systems Architect designing and implementing AI-native application cores, including LLM, vector database, RAG, memory, and agent frameworks integrated into web and mobile products.
About this role
We are seeking a senior AI Systems Architect to design and implement AI-native application cores where Large Language Models (LLMs), vector databases, retrieval systems, and agent frameworks form the primary computational layer of our web and mobile applications.
This role is responsible for architecting scalable AI pipelines, retrieval-augmented generation (RAG) systems, memory architectures, AI agents, and orchestration workflows integrated with our development stack (Web, Mobile, n8n automation, and AI services).
The ideal candidate understands that AI is not a feature, it is the operating system of the product.
Key Responsibilities
1. AI Core Architecture Design
- Design AI-first system architecture for web and mobile applications
- Architect RAG pipelines using vector databases
- Define long-term memory, short-term memory, and contextual state systems
- Implement multi-agent AI systems
- Design AI orchestration layers
2. Vector Database & Embedding Systems
-
Select and implement vector databases such as:
- Pinecone
- Weaviate
- Qdrant
- Milvus
- Supabase (pgvector)
-
Optimize embedding strategies
-
Implement hybrid search (semantic + keyword)
-
Design scalable indexing pipelines
3. LLM Integration & Optimization
-
Work with models such as:
- OpenAI APIs
- Anthropic
- Meta (LLaMA)
- DeepSeek
- Alibaba (Qwen)
-
Implement structured output pipelines
-
Design evaluation and prompt testing frameworks
-
Optimize cost-performance ratio
4. AI Agent Systems & Orchestration
-
Build autonomous AI agents
-
Design tool-calling systems
-
Integrate with:
- n8n
- LangGraph / LangChain style agent flows
-
Implement memory-aware agents
5. Production AI Engineering
- Build monitoring systems for hallucination detection
- Design guardrails and validation layers
- Implement evaluation datasets and benchmarking
- Ensure security of AI pipelines
- Build scalable infrastructure (Docker, Kubernetes, GPU optimization)
Requirements
Technical Expertise
-
5+ years software engineering experience
-
2+ years building production AI systems
-
Deep knowledge of:
- Vector embeddings & similarity search
- RAG architectures
- Tokenization and context window optimization
- Fine-tuning & LoRA concepts
- Prompt evaluation frameworks
-
Experience with Python (mandatory)
-
Experience with FastAPI / backend services
-
Experience designing scalable APIs
Architecture Experience
- Designing distributed systems
- Microservices & event-driven architecture
- Experience with PostgreSQL + pgvector
- Experience deploying LLM systems in production
Skills
Explore related jobs
More jobs at Star
Private Computer Science TeacherRiyadh, Riyadh Province
Sales Associate - Training & Professional CertificationsRiyadh, Riyadh Province
Female Private English Tutor - KS3 & KS4Riyadh, Riyadh Province
Male Private A-Level TeacherRiyadh, Riyadh Province
Private Subject TeacherRiyadh, Riyadh Province
UI/UX DesignerRiyadh, Riyadh Province
Similar Docker jobs
Jobs in Riyadh
- Country Manager - SaudiEBANX · Riyadh
- Sourcing Inspector/ Car Buyer - Saudi NationalSellAnyCar.com · Riyadh, Riyadh Province
Pre-Sales Systems Engineer, Giga Projects (Riyadh)Everpure · Riyadh, Saudi Arabia- Senior Sales Engineer (Chemical, Process & Industrial)Rotork · Riyadh, Riyadh Province
Jr. AuditorBurjline Builders · Riyadh, Saudi Arabia- Managed Services Client Delivery SpecialistNTT DATA India Private Limited · Riyadh, Saudi Arabia
Browse these categories
Market data for this role
All reports →- SeriesRole reportsOne role family at a time: how many openings, what changed this week, who is hiring, what it pays.
- SeriesSalary reportsWhat employers publish in job postings, by level and workplace. Not self-reported pay.
- Market overviewState of tech hiring, September 2026: up 4.8%Tech hiring rose 4.8% month over month in September 2026, with 411,122 new listings. Customer support and account executive roles led the growth.