Senior Data Engineer - EXT

Job summary

This is an exciting opportunity to join the Data Engineering team within the Data Linkage and Integration Hub (DLIH) of the Office for National Statistics (ONS). We're looking for a Data Engineer to build cutting edge, AI-augmented data products and pipelines to provide high quality linked data for analysts and data scientists at the ONS in a timely, consistent, auditable and reproducible way.

This role will deliver standardised and engineered external and internal key strategic data sources needed for national statistics as well as responding to requests and enabling further use of these rich and very timely datasets at ONS and across government; for example, having a key role in providing COBR and the Cabinet Office key data insights during COVID and enabling cost of living crisis experimental statistics, and building cross-government data sharing platforms which form a pillar of the current national infrastructure priorities.

This campaign is for external candidates who wish to be based at either our Newport or Titchfield site. Therefore, this campaign has been linked with the internal advert 459886 Senior Data Engineer. If you are an internal candidate to ONS please apply via the other campaign. The selection and interview process will be combined, so you do not need to apply to both campaigns.

Job description

We’re looking for someone with technical skills but also a great attitude, who is proactive, takes pride in the quality of their work and has an eagerness to develop their technical skills to the next level. We welcome applications from varied technical backgrounds including but not limited to: data science, infrastructure engineering, software engineering or related technical disciplines.

As well as day to day processing and delivery we work as a team to develop the capability of the organisation – developing re-usable and increasingly automated code, tools, and best practice so that we and others across the organisation can build the data pipelines needed to support the growing work of a changing organisation. Your work will include data cleansing, validation, and enhancement processes to refine the quality and integrity of the data and prepare this for onward linkage.

We encourage training and development so that we can stay on top of changing technology. We have and continue to invest in the development of our staff with internal and external training opportunities.

Our tech stack is Python, PySpark and SQL using Amazon Web Services (AWS) and Google Cloud Platform (GCP) ecosystem tools. This SEO role expects a high level of technical ability but the successful candidate will receive full training in the aspects of the work they are not familiar with and will be buddied with a peer who is experienced in our ways of working and tech stack.

Responsibilities

• Key responsibilities of a Senior Data Engineers include:
• Lead the design, build, operation and maintenance of a portfolio of repeatable pipelines to prepare and load data into strategic ONS data platforms.
• Work independently and as part of a team to deliver prioritised change projects to deliver efficiencies and improvements.
• Work with users to understand non-technical requirements and translate them into a technical specification.
• Lead migration of legacy code to the strategic platform.
• Identify opportunities for innovation in our Data Engineering workflows and processes.
• Support analytical colleagues to run pipelines and quality assure outputs.
• Develop and maintain technical documentation.

Person specification

Essential Criteria:

• Programming and Build (Data Engineering) - Use agreed standards and tools to design, code, test, correct and document moderate-to-complex programs and scripts from agreed specifications and subsequent iterations. Develop and review specifications where appropriate.
• Data Development Process - Design, build and test data products that are complex or large scale. Build teams to complete data integration services.
• Communicating Between the Technical and Non-Technical - Communicate effectively with technical and non-technical stakeholders. Support and host discussions within a multidisciplinary team. Manage differing stakeholder perspectives. Be an advocate for the team externally.
• Experience and familiarity with using the Google Cloud Platform estate.

Behaviours

We'll assess you against these behaviours during the selection process:

• Changing and Improving
• Working Together
• Making Effective Decisions

Technical skills

We'll assess you against these technical skills during the selection process:

• Data Development Process
• Innovation

Benefits

Alongside your salary of £41,985, Office for National Statistics contributes £12,163 towards you being a member of the Civil Service Defined Benefit Pension scheme. Find out what benefits a Civil Service Pension provides.

The Office for National Statistics is part of the Civil Service, and as such we share a number of key benefits with other departments, whilst also having our own unique offerings to support our valued colleagues across the organisation.

Whether you are hearing about us for the first time or already know a bit about our organisation, we hope that our careers site will give you a great insight into the benefits and facilities available to our colleagues, and our fantastic working culture.

This role is part of the cross-government Government Digital and Data (formerly DDaT) profession framework. As a role within Government Digital and Data (formerly DDaT) at the ONS, we also offer benefits such as:

• Protected Learning Time to spend on your personal development and side-projects.

• A supportive and active Community of Practice which you will be expected to contribute to, helping ensure you and your colleagues get the training, development and opportunities you need to progress your careers.

We are committed to supporting our people’s wellbeing by offering flexible ways of working that support a healthy work life balance. We are happy to explore opportunities with you about working flexibly in line with our hybrid working policies.

Inclusion & Accessibility

At ONS we are always looking to attract the very best people from the widest possible talent pool, and we are proud to be an inclusive, equal opportunities employer. As a Disability Confident Leader we’re committed to ensuring that all candidates are treated fairly throughout the recruitment process.

As part of our application process, you will be prompted to provide details of any reasonable adjustments to our recruitment process that you need. If you would like to discuss any reasonable adjustments before applying, please contact the recruitment team in the first instance.

If you would like an accessible version of any of the attachments or recruitment documents below or linked to in this advert, please contact the recruitment team who will be happy to assist.

Things you need to know

Artificial intelligence

Artificial intelligence can be a useful tool to support your application, however, all examples and statements provided must be truthful, factually accurate and taken directly from your own experience. Where plagiarism has been identified (presenting the ideas and experiences of others, or generated by artificial intelligence, as your own) applications may be withdrawn and internal candidates may be subject to disciplinary action. Please see our candidate guidance (opens in a new window) for more information on appropriate and inappropriate use.

Selection process details

This vacancy is using Success Profiles (opens in a new window), and will assess your Behaviours, Experience and Technical skills.

Security Clearance

For ONS the requirement for SC clearance is to have been present in the UK for 3 consecutive years immediately prior to applying and the department will consider eligibility by exception on a case-by-case basis. You will be asked to provide information regarding your UK residency during your application, and failure to provide this will result in your application being rejected.

If you are unsure that you meet the eligibility above, please read the information available on Gov.uk on this link, or contact the recruitment email on the advert before applying to discuss, as failure to meet the residency requirements will result in your security clearance application being rejected and any offer of employment being withdrawn.

At the point of SC application, you will need to provide or give access to the following evidence:

• Departmental or company records (personnel files, staff reports, sick leave reports and security records)
• UK criminal records covering both spent and unspent criminal records
• Your credit and financial history with a credit reference agency
• Security Services records

For full guidance in relation to the use of AI through the recruitment process, please read A candidate’s guide to artificial intelligence (AI) in recruitment

Please note that all campaigns may be subject to withdrawal at any stage if the internal resource position changes.

Application Process

Number of Stages: 2 stage process

Stage 1: Application

Stage 2: Interview

Stage 1 – Application

The assessment process at the application stage will be based on your work history, skills, experience, CV, and personal statement. It is important that your application is tailored to highlight the skills, knowledge, and experience relevant to the role.

A personal statement is required at application stage, the maximum wordcount allowed is 1250, which should not be exceeded. You should provide evidence for each essential skill criterion listed in the person specification. As these criteria are scored, it is advisable to give clear examples for each one, including the impact of your actions, ideally utilising the STAR technique (Situation, Task, Action, Result).

Please note that Success Profiles Behaviour examples are not required at this stage of the application process.

When a high volume of applications are received, the sift pass mark may be adjusted. Candidates will be invited to interview based on their merit order, with those achieving the highest scores being prioritised. Applicants who score below the adjusted pass mark but still pass will be placed on hold and may be invited to interview at a later date.

Stage 2 – Interview

If invited to interview, you will be assessed using techniques aligned with the Civil Service Success Profiles framework, covering all behaviours listed in the job advert and any required technical skills.

Interviews may be in person or via Microsoft Teams.

A reserve list may be held for a period up to 12 months from which further appointments may be made.

The Sift will be conducted from 02/06/2026

Interviews will be conducted from 10/06/2026

For the full terms and conditions of the post, please see attachment.

Near Misses

We often have similar roles available at different grades. If a candidate is suitable for a similar role or a lower grade than they have applied for, we may offer the candidate that role without the need to go through a further selection process providing the role has the same behaviours and essential skills.

Feedback will only be provided if you attend an interview or assessment.

Security

Successful candidates must undergo a criminal record check.Successful candidates must meet the security requirements before they can be appointed. The level of security needed is security check (opens in a new window).

See our vetting charter (opens in a new window).People working with government assets must complete baseline personnel security standard (opens in new window) checks.

Nationality requirements

This job is broadly open to the following groups:

• UK nationals
• nationals of the Republic of Ireland
• nationals of Commonwealth countries who have the right to work in the UK
• nationals of the EU, Switzerland, Norway, Iceland or Liechtenstein and family members of those nationalities with settled or pre-settled status under the European Union Settlement Scheme (EUSS) (opens in a new window)
• nationals of the EU, Switzerland, Norway, Iceland or Liechtenstein and family members of those nationalities who have made a valid application for settled or pre-settled status under the European Union Settlement Scheme (EUSS)
• individuals with limited leave to remain or indefinite leave to remain who were eligible to apply for EUSS on or before 31 December 2020
• Turkish nationals, and certain family members of Turkish nationals, who have accrued the right to work in the Civil Service

Further information on nationality requirements (opens in a new window)

Working for the Civil Service

The Civil Service Code (opens in a new window) sets out the standards of behaviour expected of civil servants.

We recruit by merit on the basis of fair and open competition, as outlined in the Civil Service Commission's recruitment principles (opens in a new window).The Civil Service embraces diversity and promotes equal opportunities. As such, we run a Disability Confident Scheme (DCS) for candidates with disabilities who meet the minimum selection criteria.The Civil Service also offers a Redeployment Interview Scheme to civil servants who are at risk of redundancy, and who meet the minimum requirements for the advertised vacancy.

Diversity and Inclusion

The Civil Service is committed to attract, retain and invest in talent wherever it is found. To learn more please see theCivil Service People Plan (opens in a new window) and the Civil Service Diversity and Inclusion Strategy (opens in a new window).

Apply and further information

This vacancy is part of the Great Place to Work for Veterans (opens in a new window) initiative.Once this job has closed, the job advert will no longer be available. You may want to save a copy for your records.

Contact point for applicants

Job contact :

• Name : Government-Digital-and-Data-Recruitment@ons.gov.uk
• Email : Government-Digital-and-Data-Recruitment@ons.gov.uk

Recruitment team

• Email : Government-Digital-and-Data-Recruitment@ons.gov.uk

Further information

If you feel your application has not been treated in accordance with the Recruitment Principles and you wish to make a complaint, in the first instance, you should contact recruitment.complaints@ons.gov.uk. If you are not satisfied with the response you receive from the Department, you can contact the Civil Service Commission

Attachments

2721 Advert 1B Permanent - ONS National v1-00 Opens in new window (pdf, 83kB)