
Posted 1 month ago
Full-Stack Engineer | Web Crawling
AI Summary
Builds and scales large-scale web crawlers and extraction systems, handling anti-bot defenses and turning raw HTML/PDF into clean structured data.
About this role
Company Culture
About the Job
We build and operate large-scale web crawling and extraction systems that turn unstructured, dynamic websites into clean, structured, and correct data. You'll own crawlers
end-to-end: discovery, resilient fetching against real anti-bot defenses, and turning HTML/PDF into trustworthy structured output.
Your mission
What you will do
• Build and scale crawlers that handle dynamic, large-scale sites - and keep them running as those sites change and fight back.
• Stay ahead of anti-bot measures: TLS/browser fingerprinting, proxies, session and rate-limit strategy, change detection.
• Turn raw HTML and PDF into clean, correct structured data - including LLMassisted extraction - where silently-wrong output is worse than a crash.
• Design and operate pipelines for ingestion, deduplication, versioning, and enrichment.
• Ship and run containerized apps in the cloud, with CI/CD.
• Shape our technical architecture and engineering culture.
Our Tech Stack
Python, Docker, GCP (Cloud Run jobs) and Azure Blob, MongoDB. Go services and a React frontend on the periphery. You don't need all of it on day one, but you do need to
ramp up fast
Your profile
• 3+ years of professional software development (5+ for the senior track).
• Strong Python - real production code, async.
• Hands-on web scraping at scale, including firsthand experience with anti-bot
defenses and the failure modes of large-scale collection.
• A data-correctness mindset - you care that extracted data is right, not just that the job finished.
• Docker + at least one major cloud (GCP, Azure, or AWS), Git, comfortable on the CLI.
• Clear communicator who works well in a small, fast-moving team.
Nice to have
• LLM-assisted extraction / working with LLMs, ML pipelines, or data labeling workflows.
• Go or Java/Spring Boot.
• Frontend (React) — or eagerness to pick it up.
• Terraform, Kubernetes, modern DevOps tooling.
Why us?
- A vibrant in-office culture in Munich with the option for up to 60 % work from home.
- Flexible working hours.
- 30 vacation days per year (including 4 “company rest days” over christmas).
- 30 days of "workation" per year, within the EU and selected countries.
- High autonomy and flat hierarchies.
- EGYM Wellpass for unlimited access to fitness courses and gyms.
- Udemy access for educational videos.
Closing
Certivity is an equal opportunities employer. We are committed to equal employment opportunities regardless of race, religion, sexual orientation, age, marital status, disability, or gender identity. Please do not submit personal data revealing racial or ethnic origin, political opinions, religious or philosophical beliefs, trade union membership, data concerning your health, or data concerning your sexual orientation.
Skills
Explore related jobs
More jobs at Certivity GmbH
Similar Async Python jobs
- B
Senior Software Developer - Cloud PlatformBlueCat · Toronto Office - C
Senior Software Engineer: Integrations LeadCobalt AI, LLC · Denver, Colorado - S
Mid-Level Python Developer (Backend)Sopra Steria · Sofia, Bulgaria - V
Senior Full-Stack Software Engineer (Python + React + AWS)Vairix · Buenos Aires, Argentina - N
Senior Backend EngineerNewfold Digital Philippines Inc. · United States - Remote - S
Sr Backend Engineer - AISigNoz · India
Jobs in Munich
- H
Technical AnimatorHOLOGATE · München - O
Developer AI first - Fullstack React &.NETOrca Group GmbH · München oder Großraum Rosenheim - D
Spezialist Bankberatung, Filiale München 21Deutsche Knowledge Services Pte. Ltd., Manila Branch · München, Gotthardstr. 46 (PB) - PPraktikum Creator & Social ImpactProSiebenSat.1 Media SE · München, Germany
Browse these categories
Market data for full-stack engineer roles
All reports →- SeriesRole reportsOne role family at a time: how many openings, what changed this week, who is hiring, what it pays.
- SeriesSalary reportsWhat employers publish in job postings, by level and workplace. Not self-reported pay.
- Market overviewState of tech hiring, September 2026: up 4.8%Tech hiring rose 4.8% month over month in September 2026, with 411,122 new listings. Customer support and account executive roles led the growth.