Senior Data Engineer

Job Role: Senior Data Engineer

Job Location: Sheffield, UK

Experience: Mid-Senior Level

Work Type: Hybrid / Open for full-time & Contract

About Company:

At Synechron, we believe in the power of digital to transform businesses for the better. Our global consulting firm combines creativity and innovative technology to deliver industry-leading digital solutions. Synechron’s progressive technologies and optimization strategies span end-to-end Artificial Intelligence, Consulting, Digital, Cloud & DevOps, Data, and Software Engineering, servicing an array of noteworthy financial services and technology firms. Through research and development initiatives in our FinLabs we develop solutions for modernization, from Artificial Intelligence and Blockchain to Data Science models, Digital Underwriting, mobile-first applications and more. Over the last 20+ years, our company has been honored with multiple employer awards, recognizing our commitment to our talented teams. With top clients to boast about, Synechron has a global workforce of 14,700+ and has 55 offices in 20 countries within key global markets. For more information on the company, please visit our website or LinkedIn community.

Diversity, Equity, and Inclusion

Diversity & Inclusion are fundamental to our culture, and Synechron is proud to be an equal opportunity workplace and an affirmative-action employer. Our Diversity, Equity, and Inclusion (DEI) initiative ‘Same Difference’ is committed to fostering an inclusive culture – promoting equality, diversity and an environment that is respectful to all. We strongly believe that a diverse workforce helps build stronger, successful businesses as a global company. We encourage applicants from across diverse backgrounds, race, ethnicities, religion, age, marital status, gender, sexual orientations, or disabilities to apply. We empower our global workforce by offering flexible workplace arrangements, mentoring, internal mobility, learning and development programs, and more.

All employment decisions at Synechron are based on business needs, job requirements and individual qualifications, without regard to the applicant’s gender, gender identity, sexual orientation, race, ethnicity, disabled or veteran status, or any other characteristic protected by law.

Role Purpose:

Are you looking for an opportunity to advance your tech career? Interested in creating next-generation cybersecurity and analytics capabilities? If you are, then apply to join Client's Cybersecurity Science & Analytics (CSA) team. We use our award-winning advanced analytics platform to develop innovative products for securing one of the largest technology estates in the world.

CSA are a unique and multi-skilled team of cybersecurity scientists, data and analytics professionals, and engineers. Our mission is to harness the power of data, analytics, AI/ML, and cybersecurity science to innovate and advance Client's cybersecurity capabilities.

The Lead Cybersecurity Analytics Engineer will form part of the CSA Platform & Data Engineering Team, joining a global team of data technology professionals to deliver critical analytics engineering requirements for the strategic cybersecurity data lake and analytics platform.

The position is a mid-senior technical, hands-on delivery role, requiring knowledge of data engineering, cloud infrastructure and platform engineering, platform operations and production support.

The Lead Cybersecurity Analytics Engineer role will work closely with Principal engineers within the Platform & Data Engineering Team, contributing to and coordinating data engineering, data acquisition, cloud infrastructure and platform engineering, platform operations, and production support activities using ground-breaking cloud and big data technologies. There is ample room for growth in the role, with opportunities to develop skills across multiple domains, starting from a strong foundation in one or more core technical areas e.g., data engineering or cloud infrastructure engineering. For this role, cybersecurity-specific knowledge is preferred but not essential.

The ideal candidate will possess strong technical skills, an eagerness to learn, a keen interest in Cybersecurity, the ability to work collaboratively in a fast-paced environment, and an aptitude for picking up new tools and techniques on the job, building on existing skillsets as a foundation.

Principal Accountabilities:

Data Engineering & Data Acquisition

• Ingestion and provisioning of raw datasets, enriched tables, and/or curated, re-usable data assets to enable Cybersecurity use cases.
• Driving improvements in the reliability and frequency of data ingestion including increasing real-time coverage.
• Support and enhancement of data ingestion infrastructure and pipelines.
• Designing and implementing data pipelines that will collect data from disparate sources across the enterprise, and from external sources, transport said data, and deliver it to our data platform.
• Extract Translate and Load (ETL) workflows, using both advanced data manipulation tools and programmatically manipulating data throughout our data flows, ensuring data is available at each stage in the data flow, and in the form needed for each system, service, and customer along said data flow.
• Identifying and onboarding data sources using existing schemas and, where required, conducting exploratory data analysis to investigate and determine new schemas.

Required Skills:

The successful candidate will be a student of the Google Site Reliability Engineering (SRE) philosophy as applied to managing large-scale cloud infrastructure, possess skills and experience within one or more of the following areas, and demonstrate a willingness to learn additional skills via certification and/or on-the-job learning where required.

Programming, Software & Network Principles:

• Experience with SRE and Azure DevOps
• Ability to script (Bash/PowerShell, Azure CLI), code (Python, C#, Java), query (SQL, Kusto query language) coupled with experience with software versioning control systems (e.g., GitHub) and CI/CD systems.
• Programming experience in the following languages: PowerShell, Terraform, Python Windows command prompt and object orientated programming languages.
• Demonstrable experience of Linux administration and scripting (preferably Red Hat Systems)
• Understanding of hardware and software principles and storage technologies (SSD, HDD, NVMe), CPU architectures, and Memory & Operating system principles (especially network stack fundamentals)
• Understanding of network protocols and network design.

Data Engineering & Data Acquisition:

• Data Acquisition, Cloud-based Data Pipelines (Azure preferred)
• Data Transport and Data Cleaning
• Data Engineering pipeline automation, productionisation, and optimisation
• Designing, building, and maintaining data pipelines and ETL workflows across disparate datasets
• Cloud Cost optimisation
• Dataset and Data Asset Curation
• Data Modelling and Cataloguing
• Database Architecture and Design
• Data Warehousing and Data Integration
• Real-Time Analytics Deployment for Large-Scale Datasets
• Applying data engineering methods to the cyber security domain.

Technology Stack:

• Technical knowledge and breadth of Azure technology services (Identity, Networking, Compute, Storage, Web, Containers, Databases)
• Cloud & Big Data Technologies such as Azure Cloud, Azure IAM, Azure Active Directory (Azure AD), Azure Data Factory, Azure Databricks, Unity Catalog, Azure Functions, Azure, Kubernetes, Service, Azure Logic App, Azure Monitor, Azure Log Analytics, Azure Compute, Azure Storage, Azure Data Lake Store, S3, Synapse Analytics and/or PowerBI
• Experience with server, operating system, and infrastructure technologies such as Nginx/Apache, CosmosDB, Linux, Bash, PowerShell, Prometheus, Grafana, Elasticsearch)
• Experience with Infrastructure-as-Code and Automation tools such as Terraform, Chef, Ansible, CloudFormation/Azure Resource Manager (ARM)
• Streaming platforms such as Azure Event Hubs or Kafka, and stream processing services such as Spark streaming
• Experience with Security Information & Event Management (SIEM) and Security Orchestration, Automation & Response (SOAR) technologies, especially cloud based, is a significant asset.

Education and Experience:

The successful candidate will possess:

• Positive attitude, strong work ethic and passion for learning.
• Bachelor’s degree in Computer Science, Software Engineering, Data Science, or a related field advantageous.
• Bachelor’s degree in any Science, Technology, Engineering, or Medical (STEM) field accompanied with data, technology and/or programming experience also considered.
• Applicants without a Bachelor’s degree will be considered if they have demonstrable career experience within one or more of the required areas and/or have relevant industry certifications in Cloud, Data, or Cybersecurity.
• CSA are a supportive team who welcome candidates from diverse skills and educational backgrounds. Thus, candidates with transferrable skills gained through software development or any other technology background will also be considered.
• Proficiency in programming languages such as Python, Java, C#, or similar preferred.
• Experience operating in highly regulated industry, e.g., Financial Services advantageous.
• Understanding of cybersecurity principles, global financial services business models, regional compliance regulations and applicable laws advantageous.
• Understanding and knowledge of common industry cybersecurity frameworks, standards, and methodologies, including OWASP, ISO2700x series, PCI DSS, GLBA, Global data security and privacy acts, FFIEC guidelines, CIS, and NIST standards advantageous.