Senior Data Engineer

For nearly 150 years, we've protected the UK economy with deep expertise and rigour, building the confidence that helps businesses access lending, investment and opportunity. We help people deal with personal insolvency. We make statutory redundancy payments when insolvent employers can't. We investigate director conduct and take action where it's needed. And right now, we're changing how we do all of this, becoming faster, more digitally driven, and more focused on stopping problems before they escalate. More than 2,000 of us work in offices across England, Scotland and Wales.

We're looking for a Senior Data Engineer who wants more than a job that ticks boxes. As a Senior Data Engineer, you will lead the development and governance of our enterprise architecture, helping the Insolvency Service align its technology with organisational strategy, digital transformation and secure-by-design principles. Your work will support long-term capability, operational resilience and value for money. This supports creating a modern, sustainable Insolvency Service by aligning technology decisions with our long-term organisational needs.

This is a role for someone who wants to think bigger, challenge the way things have always been done, and take ownership of the outcomes that matter. We offer full-time, part-time, job share, and flexible working. We invest in your development and give our people the space to grow, take ownership and make decisions.

Reporting to the Head of Data & Technology, you will join the team, helping turn organisational data into trusted information. You will work across Microsoft Fabric, OneLake and other organisational systems to develop secure, appropriately governed data solutions. This will include integrating information from sources such as Dynamics 365, Dataverse and Azure services to support analytics, reporting and AI. Working with technical teams, third-party suppliers, data scientists and analysts, you will translate data requirements into robust engineering solutions. You will also provide technical leadership, support other engineers and act as an escalation point for complex data engineering and pipeline issues.

Responsibilities

• Design, develop and maintain complex data ingestion, transformation and integration pipelines using Microsoft Fabric, OneLake and organisational data sources.
• Develop reusable engineering components, trusted datasets and data products to support analytics, reporting, Azure AI and machine-learning workloads.
• Implement validation, reconciliation and quality controls, ensuring that data solutions meet agreed lineage, metadata, governance and security standards.
• Implement CI/CD, automated testing and DataOps practices, optimising pipelines for performance, scalability, resilience and cost.
• Monitor and troubleshoot data pipelines, lead root-cause analysis and work with development security operations (DevSecOps), artificial intelligence operations (AIOps) and Application Support to improve operational reliability.
• Work with data scientists, analysts, delivery teams and suppliers to translate requirements into robust solutions, supported by appropriate documentation and recovery procedures.
• Provide technical leadership and management support to other engineers through mentoring, peer review and technical assurance, contributing to engineering standards and continuous improvement.

Proud member of the Disability Confident employer scheme.