Posted 8 months ago
Prompt Engineer (LLM Systems, Evals & Safety)
AI Summary
Designs high-quality prompts, evaluation harnesses, and versioned prompt libraries to make LLM features accurate, safe, and cost-effective; partners with engineers to integrate prompts into production.
About this role
Do you want to love what you do at work? Do you want to make a difference, an impact, and transform peoples lives? Do you want to work with a team that believes in disrupting the normal, boring, and average?
If yes, then this is the job you are looking for ,webook.com is Saudi’s #1 event ticketing and experience booking platform in terms of technology, features, agility, revenue serving some of the largest mega events in the Kingdom surpassing over 2 billion in sales.
Role Overview
Design high-quality prompts, system instructions, and tooling that make our LLM features accurate, safe, and cost-effective. You’ll own evaluation, prompt versioning, and continuous improvement.
**Key Responsibilities **:
- Author, refactor, and chain prompts (system/tool/policy) for varied tasks.
- Create offline/online evaluation harnesses (rubrics, golden sets, metrics).
- Build prompt libraries with versioning, A/B testing, and telemetry.
- Reduce hallucinations via verification, constrained decoding, and tool use.
- Implement safety: jailbreak/prompt-injection tests, content policy checks, PII handling.
- Partner with engineers to integrate prompts into production features.
Requirements
- Demonstrated prompt design across multiple task types and models.
- Experience building eval datasets and automated scoring (e.g., accuracy, faithfulness, utility, cost/latency).
- Familiarity with retrieval-augmented generation concepts and tool/function calling.
- Strong scripting (Python/TypeScript) for data prep, evals, and analysis.
- Clear writing; ability to translate business goals into measurable prompt specs.
Nice-to-Haves
- Experience with LangChain/LLM orchestration, vector stores, and rerankers.
- Knowledge of safety tooling and red-teaming techniques.
- Experiment platforms (feature flags, A/B tests), analytics.
Skills
Explore related jobs
More jobs at webook.com
Similar A/b Testing jobs
Spezialist für Conversion-Optimierung im E-Commerce (m/w/d) | A/B-Testing | User-Research | Performance MarketingNetzproduzenten® GmbH · Dresden, Germany- Test Technician- Assembly B-ShiftViking Pump, Inc. · West Henrietta, New York
- Test Stand Operator B - 2nd shiftTyco Fire & Security Czech Republic s.r.o · San Antonio-Texas-United States of America
Jobs in Amman
- Head of CommunicationsMSF AMMAN · Amman, Al ‘A̅şimah
Appointment Setting Representative - RemoteTribe Wellness Sales · Amman, Jordan
Product Specialist LSV R&B Middle East & PakistanSyngenta Group · Amman, Jordan- ServiceNow TraineeshipDevoteam · Amman, Jordan
Marketing SpecialistTDM Group · Amman, Jordan- Customer Service Representative (Bilingual: Italian/English) - AmmanConcentrix Services Mexico, S.A. de C.V. · JOR Amman - Suliman Al Nabulsi St, Abdali Mall Building
Browse these categories
Market data for this role
All reports →- SeriesRole reportsOne role family at a time: how many openings, what changed this week, who is hiring, what it pays.
- SeriesSalary reportsWhat employers publish in job postings, by level and workplace. Not self-reported pay.
- Market overviewState of tech hiring, September 2026: up 4.8%Tech hiring rose 4.8% month over month in September 2026, with 411,122 new listings. Customer support and account executive roles led the growth.