Data Engineer | Learn Kafka Streaming | £71k + 10% Bonus
Requirements
Candidates should have strong experience with PySpark and Apache Spark, as well as experience building modern data pipelines and strong SQL skills. Familiarity with cloud platforms, particularly AWS, and experience with large-scale datasets are also important.
Job Description
Data Engineer – Databricks
Location: UK (Hybrid – 3 days onsite)
Salary: £71,000 + 10% bonus, 38 days holiday, pension, flexible working, learning and development
Sponsorship: ✅ Available
An industry-leading organisation in the smart home and IoT space is looking for a Data Engineer to help design and scale high-volume, data-intensive platforms. With billions of sensor readings processed every month, this is a unique opportunity to work on truly large-scale, real-time data challenges.
This role offers the chance to work on greenfield projects, influence architecture, and build modern data solutions using cutting-edge technologies.
The Role:
You’ll play a key role in building and optimising scalable data systems in a high-throughput IoT environment.
- Design and build scalable data pipelines from IoT sensors into data platforms
- Work with PySpark and Databricks (Apache Spark) for large-scale data processing
- Support real-time data ingestion using Kafka or similar technologies
- Design efficient, scalable data models for analytics and machine learning
- Improve performance across modern databases and data platforms
- Contribute to best practices across architecture, CI/CD, and deployment
What We’re Looking For:
- Strong experience with PySpark / Apache Spark
- Experience building modern data pipelines (batch or streaming)
- Strong SQL skills and data modelling expertise
- Experience with cloud platforms (AWS preferred)
- Background working with large-scale or high-volume datasets
- Strong problem-solving skills and engineering mindset
Flexible on tech background:
- Experience with Kafka, streaming, or Databricks is beneficial but not essential
- Open to candidates with strong Snowflake experience who are keen to transition into Databricks
- Also open to engineers looking to develop their experience in streaming technologies
What’s on Offer
- Salary of £71,000 + 10% bonus
- Opportunity to work on high-scale, real-time data systems
- Exposure to modern data tooling and greenfield projects
- Strong learning and development culture
- Visa sponsorship available ( Need to have IoT, Kafka & Streaming experience)
If you would like more information on this get in touch with me, kumbirai.mafini@opusrs.com
Skills
About Opus Recruitment Solutions
Opus Recruitment Solutions is a specialist technology talent partner, connecting exceptional people with organisations operating at the forefront of change. We build and deliver agile, scalable talent solutions that help clients shape their workforce strategy and create high-performing teams capable of powering long-term transformation. Founded in 2008 as a UK challenger brand, we were established to offer an alternative to transactional recruitment—focused instead on meaningful partnerships, market expertise, and long-term value creation. Today, we operate globally across the UK, Europe, the US, and Australia, supporting over 2,000 clients and placing more than 20,000 digital and technology professionals across 44 countries. Our clients span the private, public, and third sectors, united by a common goal: building future-ready organisations in rapidly evolving markets. We partner with them to deliver talent solutions that are ethical, commercial, and tailored to their unique transformation needs. We recruit across key technology and engineering disciplines, including software development, infrastructure, cloud, AI, cyber, web3, and digital delivery, as well as senior leadership and engineering appointments. At Opus RS, our mission remains clear: Connecting exceptional talent to power the future.
View company profile →