Back to jobs
D
Azure Data PlatformDatabricksStructured StreamingDelta Live TablesPySpark
Requirements
Requires extensive experience with Databricks, PySpark, and SQL in large-scale enterprise environments. Financial trading domain knowledge and strong leadership capabilities are essential.
Job Description
Contract Role: Technical Lead – Azure Databricks Data Platform
Contract Location: London Hybrid
Contract Duration: 6 months
Contract Start Date: Immediate
Contract Classification: Inside IR35
Daily Rate breakdown
Traditional Daily Rate: £700
Agreed Contract Rate (ACR): £540.09
Equivalent Annual Salary: £140,424.06
Payroll provider: Rockford Payroll Info for Contingent Workers - Rockford Pay
Overview:
We are seeking a highly experienced Technical Lead with deep expertise in the Azure Data Platform and Databricks ecosystem. The ideal candidate should have strong hands-on experience with Structured Streaming, Delta Live Tables (DLT), PySpark architecture, Python, and SQL, and a proven track record of delivering large-scale enterprise data platforms.
Key Responsibilities
- Leading the design, development, and implementation of scalable, high-performance data solutions on Azure and Databricks.
- Defining and driving data strategy, data governance, data quality, and platform best practices.
- Optimising platform runtime performance and managing overall cloud costs, with a strong focus on Databricks streaming workloads.
- Providing end-to-end technical leadership, from solution architecture through delivery and production support.
- Collaborating with business stakeholders to understand requirements and translate them into robust technical solutions.
- Demonstrating strong ownership, accountability, and stakeholder management skills.
Essential Skills & Experience
- Strong hands-on experience with Structured Streaming, Delta Live Tables (DLT), PySpark architecture, Python, and SQL, and a proven track record of delivering large-scale enterprise data platforms
- Experience within the financial trading domain, including knowledge of trading data models and related business processes
- Ability to drive technical decision-making, mentoring engineering teams, and ensuring successful delivery of business outcomes.
- Excellent communication skills, strong leadership capabilities, and the ability to influence technical direction while delivering complex data solutions from concept to implementation.
Skills
Azure Data PlatformDatabricksStructured StreamingDelta Live TablesPySparkPythonSQLData StrategyData GovernanceData QualityCloud Cost ManagementSolution ArchitectureFinancial TradingStakeholder ManagementTechnical Leadership