Senior Data Engineer

Opus Recruitment Solutions United Kingdom
Visa Sponsorship
Apply
AI Summary

Design and build scalable data systems in a high-throughput IoT environment. Build and optimize data pipelines from IoT sensors into data platforms. Work with large-scale data processing technologies like PySpark and Databricks.

Key Highlights
Design and build scalable data systems
Build and optimize data pipelines
Work with large-scale data processing technologies
Key Responsibilities
Build and optimize scalable data systems in a high-throughput IoT environment
Design and build data pipelines from IoT sensors into data platforms
Work with large-scale data processing technologies like PySpark and Databricks
Technical Skills Required
PySpark Apache Spark Databricks Kafka SQL Snowflake
Benefits & Perks
£71,000 + 10% bonus
38 days holiday
pension
flexible working
learning and development
Nice to Have
Kafka
streaming

Job Description


Data Engineer – Databricks


Location: UK (Hybrid – 3 days onsite)


Salary: £71,000 + 10% bonus, 38 days holiday, pension, flexible working, learning and development


Sponsorship: ✅ Available


An industry-leading organisation in the smart home and IoT space is looking for a Data Engineer to help design and scale high-volume, data-intensive platforms. With billions of sensor readings processed every month, this is a unique opportunity to work on truly large-scale, real-time data challenges.


This role offers the chance to work on greenfield projects, influence architecture, and build modern data solutions using cutting-edge technologies.


The Role:

You’ll play a key role in building and optimising scalable data systems in a high-throughput IoT environment.

  • Design and build scalable data pipelines from IoT sensors into data platforms
  • Work with PySpark and Databricks (Apache Spark) for large-scale data processing
  • Support real-time data ingestion using Kafka or similar technologies
  • Design efficient, scalable data models for analytics and machine learning
  • Improve performance across modern databases and data platforms
  • Contribute to best practices across architecture, CI/CD, and deployment


What We’re Looking For:

  • Strong experience with PySpark / Apache Spark
  • Experience building modern data pipelines (batch or streaming)
  • Strong SQL skills and data modelling expertise
  • Experience with cloud platforms (AWS preferred)
  • Background working with large-scale or high-volume datasets
  • Strong problem-solving skills and engineering mindset


Flexible on tech background:

  • Experience with Kafka, streaming, or Databricks is beneficial but not essential
  • Open to candidates with strong Snowflake experience who are keen to transition into Databricks
  • Also open to engineers looking to develop their experience in streaming technologies


What’s on Offer

  • Salary of £71,000 + 10% bonus
  • Opportunity to work on high-scale, real-time data systems
  • Exposure to modern data tooling and greenfield projects
  • Strong learning and development culture
  • Visa sponsorship available ( Need to have IoT, Kafka & Streaming experience)


If you would like more information on this get in touch with me, kumbirai.mafini@opusrs.com


Similar Jobs

Explore other opportunities that match your interests

Lead Business Analyst - Data & AI

Data Science
15h ago

Premium Job

Sign up is free! Login or Sign up to view full details.

•••••• •••••• ••••••
Job Type ••••••
Experience Level ••••••

qbe europe

United Kingdom

Actuarial Pricing and Data Science Senior Manager

Data Science
2d ago

Premium Job

Sign up is free! Login or Sign up to view full details.

•••••• •••••• ••••••
Job Type ••••••
Experience Level ••••••

hackajob

United Kingdom

Backend Engineer - Display & App Marketing

Data Science
3d ago

Premium Job

Sign up is free! Login or Sign up to view full details.

•••••• •••••• ••••••
Job Type ••••••
Experience Level ••••••

Agoda

United Kingdom

Subscribe our newsletter

New Things Will Always Update Regularly