Back to jobs
Infosys
Infosys

Senior Technology Architect_ Databricks

London On-site 5-10 yrs exp IT Services and IT Consulting 373,773 employees
DatabricksApache SparkPySparkSQLData Lake Architecture

Requirements

The role requires strong Databricks, Spark, PySpark or SQL, and data lake architecture experience, along with hands-on streaming technology experience, especially Kafka or Confluent Kafka. Candidates should have experience integrating DB2 and SQL Server, working knowledge of AWS services such as S3, and an understanding of data mesh and modern data engineering practices; financial services experience is beneficial.

Job Description

Role –Senior Databricks Architect

Technology – Databricks (Spark, PySpark/SQL) and data lake architectures

Location – London, UK

Compensation – Competitive (including bonus)

Job Description

We are looking for a Data Architect to design, build, and operate scalable data pipelines and data products, enabling a modern data mesh architecture. The role focuses on integrating legacy systems with cloud-native platforms to support analytics, reporting, and domain-owned data products.

Primary Skills

  • Strong experience with Databricks (Spark, PySpark/SQL) and data lake architectures.
  • Hands-on experience with streaming technologies, especially Kafka / Confluent Kafka.
  • Experience integrating legacy data sources such as DB2 (mainframe) and SQL Server.
  • Working knowledge of AWS data services, especially S3.
  • Understanding of data product thinking, data mesh concepts, and modern data engineering best practices.

Key Responsibilities

  • Build and maintain batch and streaming data pipelines from legacy mainframe DB2 and on prem SQL Server systems into an AWS-based data lake.
  • Implement real-time ingestion using Confluent Kafka and land data in Amazon S3.
  • Develop data transformations and analytics pipelines in Databricks using the medallion architecture (Bronze, Silver, Gold).
  • Design and deliver high-quality, reusable data products aligned to data mesh principles.
  • Ensure data quality, reliability, security, and governance across pipelines.
  • Collaborate with domain teams, platform teams, and stakeholders to enable self-serve analytics and consumption.

Good to have

  • Experience in banking or financial services data platforms.
  • Familiarity with data governance, metadata management, and regulatory reporting

Personal

Besides the professional qualifications of the candidates we place great importance in addition to various forms personality profile. These include:

  • High analytical skills
  • A high degree of initiative and flexibility
  • High customer orientation
  • High quality awareness
  • Excellent verbal and written communication skills

Overview

Infosys is a global leader in next-generation digital services and consulting. We enable clients in 59 countries to navigate their digital transformation.

With over four decades of experience in managing the systems and workings of global enterprises, we expertly steer clients, in 59 countries, as they navigate their digital transformation powered by cloud and AI. We enable them with an AI-first core, empower the business with agile digital at scale and drive continuous improvement with always-on learning through the transfer of digital skills, expertise, and ideas from our innovation ecosystem. We are deeply committed to being a well-governed, environmentally sustainable organization where diverse talent thrives in an inclusive workplace.

All aspects of employment at Infosys are based on merit, competence and performance. We are committed to embracing diversity and creating an inclusive environment for all employees. Infosys is proud to be an equal opportunity employer.

Skills

DatabricksApache SparkPySparkSQLData Lake ArchitectureKafkaConfluent KafkaDB2SQL ServerAWSAmazon S3Data MeshData PipelinesStreaming DataData GovernanceData Quality

About Infosys

Infosys is a global leader in next-generation digital services and consulting. We enable clients in more than 50 countries to navigate their digital transformation. With over three decades of experience in managing the systems and workings of global enterprises, we expertly steer our clients through their digital journey. We do it by enabling the enterprise with an AI-powered core that helps prioritize the execution of change. We also empower the business with agile digital at scale to deliver unprecedented levels of performance and customer delight. Our always-on learning agenda drives their continuous improvement through building and transferring digital skills, expertise, and ideas from our innovation ecosystem. Visit www.infosys.com to see how Infosys (NYSE: INFY) can help your enterprise navigate your next.

View company profile →