You'll own crawlers end-to-end: discovery, resilient fetching against real anti-bot defenses, and turning HTML/PDF into trustworthy structured output.
What you will doBuild and scale crawlers that handle dynamic, large-scale sites, and keep them running as those sites change and fight back.
Stay ahead of anti-bot measures: TLS/browser fingerprinting, proxies, session and rate-limit strategy, and change detection.
Turn raw HTML and PDF into clean, correct structured data (including LLM-assisted extraction), where silently wrong output is worse than a crash.
Design and operate pipelines for ingestion, deduplication, versioning and enrichment.
Ship and run containerized apps in the cloud, with CI/CD.
Shape our technical architecture and engineering culture.
Our Tech StackPython, Docker, GCP (Cloud Run jobs), Azure Blob Storage, MongoDB.
Go services and a React frontend on the periphery.
You don't need all of it on day one, but you do need to ramp up fast.
Your profile3+ years of professional software development (5+ for the senior track).
Strong Python: real production code, async.
Hands-on web scraping at scale, including firsthand experience with anti-bot defenses and the failure modes of large-scale collection.
A data-correctness mindset: you care that extracted data is right, not just that the job finished.
Docker, at least one major cloud (GCP, Azure or AWS), Git and comfort on the CLI.
A clear communicator who works well in a small, fast-moving team.
Nice to have:LLM-assisted extraction or other work with LLMs, ML pipelines or data labeling workflows.
Go or Java/Spring Boot.
Frontend (React), or eagerness to pick it up.
Terraform, Kubernetes and modern DevOps tooling.
Why us?A vibrant in-office culture in Munich, with the option to work from home up to 60% of the time.
Flexible working hours.
30 vacation days per year.