Posted 2 months ago
Scraping Team Lead (Web scraping & Anti-bot)
AI Summary
Team Lead for a high-load web scraping platform, overseeing architecture, development, and anti-bot research. Leads backend engineers, drives technical decisions, and ensures scalable, robust scraping infrastructure.
About this role
Infatica.io is a global provider of proxy and DaaS solutions. We're building our own high-load web scraping platform: an API where you can submit any URL and receive clean HTML or structured JSON output, without worrying about proxies, CAPTCHAs, or anti-bot systems.
The platform will support both cloud deployment and on-premises deployment in client infrastructure (on-prem, Kubernetes).
We are now looking for an experienced Team Lead for our web scraping development team who will lead the team, become the technical leader of the platform, drive architectural decisions, and shape the future of our cutting-edge scraping infrastructure.
Key Responsibilities
Architecture Design
- Data-plane: high-parallel crawler, session management, anti-bot bypass, CAPTCHA solver
- Control-plane: API, authorization, billing, quotas, monitoring
- Infrastructure: microservices, Docker/K8s, CI/CD, observability
Development Leadership
- Team building: participate in hiring backend, browser, DevOps, and QA engineers
- Establish development and release processes
- Code quality control and technical decision oversight
Anti-Bot Research & Bypass
- Browser and network-level fingerprinting (JA3, TLS, CDP)
- Protection bypass: Cloudflare, Akamai, Qrator, ServicePipe, Variti, and others
Requirements
Requirements
-
5+ years of engineering experience in high-load backend/data platforms
-
Extensive Scraping experience (mandatory)
-
Excellent understanding of HTTP, TLS, HTTP/2, proxies, browser stack (CDP, WebRTC)
-
Experience with async Python and ** Go (ideally both), Redis, queues, message brokers**
-
Experience analyzing and bypassing bot protection systems — strong plus
-
**Fluent English **(all documentation and part of the team are English-speaking)
-
Decision-making skills, mentoring abilities, and accountability for results
Benefits
What We Offer
- Participate in developing the company's key product from scratch
- High autonomy and influence on architecture and team decisions
- Competitive compensation package
- Remote work flexibility
Join us
This is a unique opportunity to build a world-class product from the ground up and establish yourself as a key technical decision-maker in a rapidly growing company.
Apply now and become the technical leader who shapes our platform's future!
Skills
Explore related jobs
More jobs at Infatica.io
- Head of Architecture & Engineering DeliverySpain
- Senior Scraping Engineer (Web scraping & Anti-bot)Spain
- Senior Scraping Engineer (Web scraping & Anti-bot)Georgia
- Senior Scraping Engineer (Web scraping & Anti-bot)Cyprus
- Senior Scraping Engineer (Web scraping & Anti-bot)Serbia
- Senior Product Marketing ManagerSpain