Job Description
A data-led digital business is hiring a Web Data Engineer to solve complex challenges around large-scale data collection, website access, and automation. This is a hands-on technical role for someone who can architect stable, scalable systems that extract, process, and enrich web data — and now, help integrate AI-assisted workflows to make those systems even smarter.
Role: Web Data Engineer
Salary: Dependant on Experience
Location: Fully remote (UK-based)
What you’ll be doing:
- Develop and maintain scalable systems for web data extraction and automation
- Integrate AI models and tooling to assist with tasks like data validation, pattern recognition, and content interpretation
- Design reliable frameworks using Playwright, Puppeteer, or Scrapy, incorporating AI where it adds measurable efficiency
- Implement intelligent proxy rotation, session management, and performance monitoring
- Collaborate with data and engineering teams to feed collected and AI-enriched data into analytics pipelines
- Continuously adapt systems to overcome evolving access and security protocols in a compliant, efficient way
What you’ll need:
- Strong programming skills in Python or Node.js
- Proven experience building scalable web data collection or crawling systems
- Familiarity with Scrapy, Puppeteer, Playwright, Selenium, or similar frameworks
- Experience using rotating proxies, headless browsers, and data pipelines at scale
- Understanding of AI tools and APIs (such as OpenAI, LangChain, or similar) and how they can enhance automation workflows
- Solid grasp of HTTP, browser sessions, and access validation
- Pragmatic approach to data compliance, security, and system resilience
What’s on offer:
- Salary depending on experience
- Fully remote role (UK-based)
- Opportunity to own a technically complex, high-impact system from design to deployment
- Freedom to experiment with AI-driven workflow enhancements
- Flexible working hours and autonomy to define how you solve complex data access challenges
If you’re an engineer who loves working with data at scale, experimenting with AI to streamline automation, and solving technical challenges that most people avoid, this role offers the freedom and impact you’re looking for.