Data Engineer

hire top talent • United Kingdom
Visa Sponsorship
Apply
AI Summary

Join a growing data and engineering team to build and scale a modern market intelligence platform. Design, develop, and maintain data pipelines, ETL workflows, web scrapers, and cloud-based data solutions. Collaborate with cross-functional teams to support business intelligence and reporting needs.

Key Highlights
Design, build, and maintain scalable ETL/ELT pipelines
Develop and maintain web scraping solutions
Collaborate with cross-functional teams
Key Responsibilities
Design, build, and maintain scalable ETL/ELT pipelines
Develop and maintain web scraping solutions
Collaborate with cross-functional teams
Technical Skills Required
Python SQL GCP AWS Azure Playwright Scrapy Git Docker Linux CI/CD workflows
Benefits & Perks
Hybrid working model
Opportunity to work on cutting-edge AI, automation, and data engineering projects
Exposure to modern cloud and data technologies
Nice to Have
BigQuery
Dataform
Cloud Run
Firestore
LLM APIs
AI-powered workflows
Data testing frameworks
BI and visualisation platforms

Job Description


Data Engineer

📍 Location: London, UK (Hybrid Working)

đź•’ Job Type: Full-Time

🚀 Visa Sponsorship: Considered for the right candidate

The Role

We are looking for a talented Data Engineer to join a growing data and engineering team, helping to build and scale a modern market intelligence platform.

This is a hands-on role where you will design, develop, and maintain data pipelines, ETL workflows, web scrapers, and cloud-based data solutions, supporting the collection and transformation of millions of data points across multiple markets.

You will work closely with data, engineering, and business stakeholders to deliver reliable, high-quality datasets that drive decision-making and innovation.

Key Responsibilities
  • Design, build, and maintain scalable ETL/ELT pipelines using Python and cloud technologies
  • Develop and maintain web scraping solutions to collect large-scale data efficiently
  • Create and optimise SQL transformation workflows and analytics-ready datasets
  • Build and support LLM-powered workflows within data pipelines
  • Implement data validation, quality control, and monitoring frameworks
  • Collaborate with cross-functional teams to support business intelligence and reporting needs
  • Improve performance, reliability, and scalability of data systems
  • Stay up to date with emerging technologies and best practices in data engineering
Required Skills & Experience
  • 3+ years of experience as a Data Engineer or similar role
  • Strong experience with Python and production-grade data pipelines
  • Advanced SQL skills with experience optimising complex queries
  • Experience working with cloud platforms such as GCP, AWS, or Azure
  • Experience with web scraping technologies (Playwright, Scrapy, or similar)
  • Knowledge of Git, Docker, Linux, and CI/CD workflows
  • Experience integrating APIs and modern data services into pipelines
  • Strong analytical, troubleshooting, and problem-solving skills
  • Excellent communication and collaboration abilities
Desirable Skills
  • Experience with BigQuery, Dataform, Cloud Run, Firestore, or similar cloud services
  • Knowledge of LLM APIs (OpenAI, Gemini, etc.) and AI-powered workflows
  • Experience with data testing frameworks such as Pytest or Great Expectations
  • Familiarity with Terraform or Infrastructure as Code (IaC) tools
  • Experience with BI and visualisation platforms (Power BI, Tableau, Looker)
  • Exposure to machine learning or data science environments
Technical Environment

You will work with modern technologies including:

  • Python, SQL, YAML
  • Cloud Platforms (GCP/AWS/Azure)
  • Docker, GitHub, GitHub Actions, Linux
  • Big Data & ETL Tools
  • LLM & AI Integrations
  • Data Validation & Monitoring Frameworks
What We Offer

âś” Hybrid working model

âś” Opportunity to work on cutting-edge AI, automation, and data engineering projects

âś” Exposure to modern cloud and data technologies

âś” Collaborative and fast-growing environment

âś” Career progression and professional development opportunities

Apply

If you are passionate about data engineering, cloud platforms, automation, and AI-driven solutions, we would love to hear from you.

Apply now with your CV.


Similar Jobs

Explore other opportunities that match your interests

HR Data Analyst

Data Science
•
2h ago
Visa Sponsorship Relocation Remote
Job Type Part-time
Experience Level Not Applicable

kennedys

United Kingdom

Graduate Data Scientist/Analyst - 12-Month Programme

Data Science
•
4d ago

Premium Job

Sign up is free! Login or Sign up to view full details.

•••••• •••••• ••••••
Job Type ••••••
Experience Level ••••••

Revolut

United Kingdom

Senior Product Data Scientist

Data Science
•
4d ago

Premium Job

Sign up is free! Login or Sign up to view full details.

•••••• •••••• ••••••
Job Type ••••••
Experience Level ••••••

monzo

United Kingdom

Subscribe our newsletter

New Things Will Always Update Regularly