CV-Library
Lead Data Engineer
Requirements
Requires strong commercial data engineering experience, including leadership or mentoring, and hands-on expertise with AWS, SQL, dbt, Python, data warehouses, orchestration, and infrastructure as code. Candidates should also have experience with production pipelines, batch and streaming data, CI/CD, data quality and observability, and communicating technical concepts to varied audiences.
Job Description
We are in a period of focused internal investment, following a year of key strategic acquisitions and significant investment across all parts of the business from Tech and Data to People and HR, there's never been a more exciting time to join us or a better place to grow your career!
The Role
Hours: Monday-Friday 9:00-17:30
Location: Fleet, Hampshire
Working Pattern: Hybrid - 2 days on site per quarter
The Lead Data Engineer is a critical role in the successful design and implementation of data solutions and projects and the overall platform governance. We are looking for an experienced Data Engineering Lead to lead the development, reliability and evolution of CV-Library's data engineering capability.
This is a hands-on leadership role. You will be responsible for setting the technical direction of the Data Engineering function while remaining close to the engineering work, designing solutions, reviewing architecture and code, improving our data platform, and helping the team deliver reliable, scalable data products.
Responsibilities
- Define and drive the technical strategy for our AWS-based data platform and Data Engineering function
- Lead the design and delivery of scalable, reliable and cost-effective data solutions
- Build and optimise modern batch and real-time data pipelines to support business growth
- Own and evolve our data architecture, ensuring scalability, performance and maintainability
- Champion engineering best practices, including code reviews, technical standards and architectural governance
- Develop robust data models and datasets that power reporting, analytics, product insights and machine learning
- Drive improvements in data quality, observability, monitoring and platform reliability
- Lead the adoption of Infrastructure as Code, CI/CD and automation across the data platform
- Work closely with analysts, data scientists and business stakeholders to turn data requirements into impactful solutions
- Evaluate and implement new technologies, including AWS AI services, to enhance platform capabilities
- Lead incident resolution, root cause analysis and continuous improvement initiatives
- Mentor and develop a team of Data Engineers, fostering a culture of technical excellence, ownership and collaboration
- Strong commercial experience in Data Engineering, with experience leading or mentoring engineers
- Strong experience designing and building cloud-based data platforms, ideally on AWS
- Excellent SQL skills and strong experience with analytical data modelling
- Strong hands-on experience with dbt in a production environment
- Experience building and operating production-grade data pipelines
- Strong Python development skills
- Experience with data warehouses such as Amazon Redshift
- Experience with orchestration technologies such as Apache Airflow
- Experience with infrastructure as code, ideally Terraform
- Good understanding of CI/CD and modern software engineering practices
- Experience working with both batch and event-driven/streaming data
- Strong understanding of data quality, monitoring, observability and operational reliability
- Ability to communicate complex technical concepts clearly to both technical and non-technical stakeholders
- A pragmatic approach to engineering: knowing when to build, when to improve and when to keep things simple
Skills
About CV-Library
CV-Library is an award-winning job site that helps companies of all sizes and industries to hire faster, for less. Offering a wealth of recruitment products, including access to our database of more than 21 million CVs and a range of job-posting options, employers and agencies can find permanent, graduate, contract and freelance candidates on one easy-to-use site. We’re known for great customer service and market-leading innovations, with inspired hiring solutions such as targeted CPM Display Advertising and Pay for Performance recruitment packages. Discover more: www.cv-library.co.uk/products To find out how CV-Library can help you find the best candidates, call 01252 810995 or visit www.cv-library.co.uk/cvdatabase Looking for your next job? Search thousands of vacancies: www.cv-library.co.uk/search-jobs Want to work for a dynamic, award-winning company? View our vacancies: www.cv-library.co.uk/work-for-us Our achievements include: • Winner: 'Personality of the Year' (Lee Biggins), OnRec Awards 2025 • Winner: 'Best Generalist Job Board', IHR Supplier Awards 2025 • Winner: 'Best Customer Success Team (Job Board)', DJAx Awards 2024, 2025 • Winner: 'Creative Offline Marketing Award', OnRec Awards 2024 • Winner: 'Best-Performing Company Overall 2024', Megabuyte50 2024 • Winner: 'One to Watch' & 'CEO of the Year', TV250 Awards 2023 • Winner: 'Tech Company of the Year', South Coast Tech Awards 2023 • Winner: 'Best Generalist Job Board', NORAs (2015, 2016, 2017, 2019, 2022, 2023) • Winner: 'Employer of the Year' & 'Innovator of the Year', Thames Valley Business & Community Awards 2022 • Winner: 'Best Job Board' 5 years running, Global Recruiter Awards 2015-2019 • Winner: 'Technical Innovation' at the OnRec Awards 2019, 2020 & 2022 • Named 'Recruitment Website of the Decade', NORAs 2020 • Named one of the UK's 50 best-performing privately-owned technology companies by Megabuyte50 2016, 2017, 2018, 2022, 2024, 2025 • The highest Trustpilot rating in the industry