
Posted 16 days ago
Agentic AI Architect
AI Summary
Designs and builds agentic AI systems using LLMs, RAG pipelines and multi-agent orchestration, co-designed with FPGA/ASIC hardware acceleration, and leads architecture reviews and mentors engineers.
About this role
Job Details:
Job Description:
Location: Shanghai, China
Role Overview
We are seeking aPrincipal Engineer – Agentic AI Architect to lead the design and development of next-generationagentic AI systems integrated withFPGA/ASIC platforms.
This role sits at the intersection of:
Large Language Models (LLMs)
Agent frameworks & autonomous systems
Retrieval-Augmented Generation (RAG)
Hardware-aware AI system design (FPGA / ASIC / EDA)
You will define architecture, drive technical strategy, and build scalable AI systems that bridgesoftware intelligence and hardware acceleration.
Key Responsibilities
AI Architecture & System Design
Design and implementagentic AI systems using LLMs, tools, and multi-agent orchestration
ArchitectRAG pipelines for enterprise-scale knowledge integration
Defineend-to-end AI system architecture from data ingestion → reasoning → action
Agentic AI & LLM Development
Develop advanced workflows using:
tool-using agents
planning & reasoning agents
multi-agent collaboration frameworks
Evaluate and integrate leading LLMs (open-source and proprietary)
Optimize prompt engineering, memory, and reasoning capabilities
Hardware-Aware AI Optimization
Co-design AI systems with:
FPGA acceleration
ASIC platforms
heterogeneous compute (CPU/GPU/FPGA)
ExploreLLM inference optimization on FPGA (quantization, compilation, partitioning)
Collaborate with hardware teams onEDA and system integration
Framework & Platform Development
Build internal platforms using
LangChain
LlamaIndex
custom agent orchestration framework
Develop reusable components for:
memory management
tool integration
knowledge retrieval
Technical Leadership
Lead architecture reviews and guide engineering teams
Mentor senior engineers and influence cross-functional teams
Drive innovation inAI + hardware convergence
What Makes This Role Unique
Opportunity to defineagentic AI architecture for hardware-driven systems
Work at the convergence of:
AI reasoning systems
FPGA acceleration
next-generation computing platforms
High-impact role influencingfuture AI + semiconductor integration
Impact
You will help shape howAI agents interact with hardware, enabling:
intelligent system orchestration
real-time decision-making pipelines
scalable AI deployment on FPGA platforms
Summary
This role is ideal for asenior technical leader who can:
bridgeLLM + Agentic AI + RAG withFPGA/ASIC system architecture
and drive innovation innext-generation AI systems.
Qualifications:
Master’s or Bachelor’s degree with 10+ years of experience in one or more of the following:
AI/ML systems
Distributed systems
Hardware–software co-design
Recognized expertise in AI/ Large Language Models (LLMs)
Deep understanding of:
LLM architectures and inference
RAG systems and vector databases
Agentic AI / autonomous agents
Hands-on experience building:
Production-grade LLM applications
Multi-step reasoning and orchestration workflows
Scalable and reliable AI systems in production
Strong background in:
FPGA / ASIC / EDA systems
Heterogeneous computing architectures
Familiarity with:
Hardware acceleration for AI workloads
Performance optimization across system stack
Technical Skills
Programming:
Python
C++ (preferred)
Experience with:
Distributed systems design
APIs and microservices architecture
Cloud and/or edge AI deployment
Hands-on experience with:
LLM fine-tuning, quantization, and model distillation
On-device / edge AI deployment
Robotics, autonomous systems, or real-time AI pipelines
Knowledge of:
Compiler stacks (e.g., MLIR, TVM)
AI model optimization for FPGA platforms
Job Type:
RegularShift:
Shift 1 (China)Primary Location:
Shanghai, ChinaAdditional Locations:
Posting Statement:
All qualified applicants will receive consideration for employment without regard to race, color, religion, religious creed, sex, national origin, ancestry, age, physical or mental disability, medical condition, genetic information, military and veteran status, marital status, pregnancy, gender, gender expression, gender identity, sexual orientation, or any other characteristic protected by local law, regulation, or ordinance.Skills
Explore related jobs
More jobs at Altera Semiconductor Technology Canada ULC
- A
Head of AI & Product SecuritySan Jose, California - A
Engineering Compute studentHaifa, Israel - A
Product Development EngineerTaipei, Taiwan (Remote) - A
Software Security / DevSecOps ArchitectSan Jose, California - A
Physical AI Solutions ArchitectMarlow, Buckinghamshire - A
FPGA SW Validation Engineer (PR)Bengaluru, Karnataka
Similar Agentic AI jobs
Browse these categories
Market data for this role
All reports →- SeriesRole reportsOne role family at a time: how many openings, what changed this week, who is hiring, what it pays.
- SeriesSalary reportsWhat employers publish in job postings, by level and workplace. Not self-reported pay.
- Market overviewState of tech hiring, September 2026: up 4.8%Tech hiring rose 4.8% month over month in September 2026, with 411,122 new listings. Customer support and account executive roles led the growth.