Data Engineer (SEO)

Job summary

The Infected Blood Compensation Authority (IBCA) is a new arm’s-length body set up, at unprecedented pace, to administer compensation to people whose lives have been impacted by the infected blood scandal.

IBCA will ensure payment is made in recognition of the wrongs experienced by those who have been infected by HIV, Hepatitis B or C, as well as those who love and care for them. They have been frustrated and distressed by the delays in achieving proper recognition, and we must help put this right.

We are committed to putting the infected and affected blood community at the centre of every decision we make and every step we take to build our organisation to deliver compensation payments.

IBCA employees will be public servants. If successful in this role you will be appointed directly into IBCA, on IBCA terms and conditions as a public servant.

Successful applicants will join the Civil Service Pension Scheme.

Please note that the mission of IBCA means that it is likely to be operational for a period of approximately 5 to 7 years. When IBCA’s work begins to wind down, IBCA employees will receive support and practical guidance to find a new role, whether in the Civil Service, another Arms Length Body (ALB), or an external employer.

Job description

The Infected Blood Compensation Authority (IBCA) is responsible for delivering a compensation scheme that has been long awaited by the infected blood community to provide financial compensation to victims of infected blood on a UK-wide basis. This role will lead our data engineering capability within the engineering team of the Data Operations arm of the IBCA Data Directorate.

The Data Operations team is responsible for developing and running safe and secure data solutions that provide a single source of truth for those going through their compensation journey. We are building a new data platform using Amazon Web Services (AWS) and data management and intelligence products using Databricks, Quantexa and Tableau. We are taking a product-centric approach treating data as a product and are building squads around our products, with a focus on paying compensation to those impacted by the infected blood scandal seamlessly.

You will focus on building robust data pipelines and data management processes (including master data management), ensuring data quality, and driving a culture of data-driven decision-making. Working at IBCA gives you a huge opportunity to make an impact on those who deserve compensation, and this role suits a candidate who can lead a team of data engineers to deliver solutions from the ground up to take from ideation to reality so that data is an enabler to everything IBCA does.

As a Data Engineer, you will join a multidisciplinary team to design, build, and deliver high-impact, scalable AWS-based data solutions using Databricks and Quantexa technologies, while also driving data quality, mentoring junior colleagues, and fostering a strong data engineering community.
You will:

• Provide technical guidance for the development of robust, automated data pipelines and master data management processes for our data platform and products, encompassing DevSecOps best practices
• Ensure tools and techniques are scalable, secure and efficient
• Be responsible for ensuring the right data engineering practices are embedded consistently and to industry standard best practices within the data platform delivery teams
• Further developing your own data engineering and leadership skills
• Work with business stakeholders and across digital service teams, understanding their needs and translating them into data development.

Responsibilities

• Data Solution Delivery: Designing, building, and delivering high-performance, scalable, and secure data solutions in a complex data environment within AWS, Databricks and Quantexa. This includes building robust ETL/ELT pipelines, and ensuring seamless integration between platforms.
  
• Collaboration & Partnership: Work extensively with multidisciplinary teams across product delivery, architecture, engineering security and analytics to understand and meet data needs.
  
• Quality & Operational Excellence: Driving high build and data quality, ensuring stability, robustness, and resilience of products, and embedding Agile, CI/CD, and DevOps practices.
  
• Leadership & Community Building: Mentoring junior team members, fostering professional development, building a data engineering community, reviewing solutions, troubleshooting complex issues and proactively driving innovation and challenging existing methods.
  
• Stakeholder Engagement & Problem Solving: Communicating complex data solutions and championing innovative approaches to diverse stakeholders, while also anticipating and resolving intricate data engineering challenges and building consensus to align data designs with organizational goals.

Person specification

• Strong experience of cloud-native data engineering in AWS and building and maintaining complex data pipelines (both ETL and ELT) in a rapid delivery setting that covers data quality & transformation processes, data matching and master data management.
• Experience working with structured and unstructured data, and data lakes to service operational and analytical business needs.
• Proficiency in writing clear parameterised code in two or more of the following – Python, Databricks, Apache Spark (Pyspark, Spark SQL), NoSQL, Scala.
• Experience of delivering through Agile/DevOps working practices in multi-disciplinary teams – CI/CD, Scrum, Automation.
• Strong problem-solving skills, including assessing and mitigating risks while identifying opportunities for innovation.
• Experience in the full end to end data lifecycle for design, build and test, with knowledge of the interactions and dependencies with data architecture, data modelling and testing engineering.
• Demonstrable experience of setting up data engineering processes from scratch or of implementing large changes to existing processes within an organisation that operate in a cloud DevSecOps environment.

Additional information:

A minimum 60% of your working time should be spent at your principal workplace. Although requirements to attend other locations for official business will also count towards this level of attendance.

Behaviours

We'll assess you against these behaviours during the selection process:

• Changing and Improving
• Communicating and Influencing

Technical skills

We'll assess you against these technical skills during the selection process:

• Data analysis and synthesis
• Data development process

Benefits

Alongside your salary of £47,258, Infected Blood Compensation Authority contributes £13,690 towards you being a member of the Civil Service Defined Benefit Pension scheme. Find out what benefits a Civil Service Pension provides.

• Premium allowance paid monthly after probation
• Learning and development tailored to your role
• An environment with flexible working options
• A culture encouraging inclusion and diversity
• A Civil Service Pension which provides an attractive pension, benefits for dependants and employer contributions of 28.97%
• 32.5 days of paid annual leave plus 8 bank holidays
• Family friendly policies to support you and your everyday responsibilities
• Enhanced maternity and paternity leave, up to 12 months shared parental leave

Recent changes in skilled worker visa eligibility mean that a Skilled Worker must have a job offer in an eligible skilled occupation from a Home Office-approved sponsor. From 22 July 2025, the job must normally be skilled to level 6 (graduate level) on the Regulated Qualifications Framework for England and Northern Ireland, or the equivalent level in Wales or Scotland, or be included on either the Immigration Salary List or the Temporary Shortage List. Please be aware that if the role is not eligible for a skilled worker visa that we will be unable to provide sponsorship.

Things you need to know

Artificial intelligence

Artificial intelligence can be a useful tool to support your application, however, all examples and statements provided must be truthful, factually accurate and taken directly from your own experience. Where plagiarism has been identified (presenting the ideas and experiences of others, or generated by artificial intelligence, as your own) applications may be withdrawn and internal candidates may be subject to disciplinary action. Please see our candidate guidance (opens in a new window) for more information on appropriate and inappropriate use.

Selection process details

This vacancy is using Success Profiles (opens in a new window), and will assess your Behaviours, Experience and Technical skills.

As part of the application process you will be asked to complete a CV and a statement of Suitability. Further details around what this will entail are listed on the application form.

Please use your statement of suitability to (in no more than 500 words) to explain how you consider your personal skills, qualities and experience provide evidence of your suitability for the role, with particular reference to the essential criteria in the person specification section of the job advert.

Selection process

Candidates who are successful at sift will then be invited for an interview.

At interview, you will be assessed against Behaviours and Technical skills.

Expected timeline (subject to change)

Expected sift date – Week Commencing 19/01/2026
Expected interview date/s – Week Commencing 02/02/2026
Interview location - Your interview will either be conducted face to face or by video. You will be notified of the location if you are selected for interview.

Reasonable Adjustment

If a person with disabilities is put at a substantial disadvantage compared to a non-disabled person, we have a duty to make reasonable changes to our processes.

If you need a change to be made so that you can make your application, you should:

Contact Government Recruitment Service via IBCA.grs@cabinetoffice.gov.uk as soon as possible before the closing date to discuss your needs.

Complete the ‘Assistance required’ section in the ‘Additional requirements’ page of your application form to tell us what changes or help you might need further on in the recruitment process. For instance, you may need wheelchair access at interview, or if you’re deaf, a Language Service Professional.

Further Information

A reserve list may be held for a period of 12 months from which further appointments can be made.

Any move to IBCA from another employer will mean you can no longer access childcare vouchers. You may however be eligible for other government schemes, including Tax Free Childcare; for further information visit the Childcare Choices website)

In order to process applications without delay, we will be sending a Criminal Record Check to Disclosure and Barring Service and or Disclosure Scotland on your behalf.

However, we recognise in exceptional circumstances some candidates will want to send their completed forms direct. If you will be doing this, please advise Government Recruitment Service of your intention by emailing Pre-EmploymentChecks.grs@cabinetoffice.gov.uk stating the job reference number in the subject heading.

For further information on the Disclosure Scotland confidential checking service telephone: the Disclosure Scotland Helpline on 0870 609 6006 and ask to speak to
the operations manager in confidence, or email Info@disclosurescotland.co.uk

Please note that this role requires SC clearance, which would normally need 5 years UK residency in the past 5 years. This is not an absolute requirement, but supplementary checks may be needed where individuals have not lived in the UK for that period. This may mean your security clearance (and therefore your appointment) will take longer or, in some cases, not be possible.

Applicants who are successful at interview will be, as part of pre-employment screening, subject to a check on the Internal Fraud Database (IFD). This check will provide information about employees who have been dismissed for fraud or dishonesty offences. This check also applies to employees who resign or otherwise leave before being dismissed for fraud or dishonesty had their employment continued. Any applicant’s details held on the IFD will be refused employment.

A candidate is not eligible to apply for a role within the IBCA if the application is made within a 5 year period following a dismissal for carrying out internal fraud against government.

If you are experiencing accessibility problems with any attachments on this advert, please contact the email address in the 'Contact point for applicants' section.

PLEASE NOTE: IBCA employees are public servants, therefore the Civil Service Nationality Rules (CSNR) do not apply. Candidates who do not meet the CSNR are welcome to apply and applications will not be rejected: successful candidates however will be subject to a Right to Work check to work within the UK.

Feedback will only be provided if you attend an interview or assessment.

Security

Successful candidates must undergo a criminal record check.Successful candidates must meet the security requirements before they can be appointed. The level of security needed is security check (opens in a new window).

See our vetting charter (opens in a new window).People working with government assets must complete baseline personnel security standard (opens in new window) checks.

Nationality requirements

This job is broadly open to the following groups:

• UK nationals
• nationals of the Republic of Ireland
• nationals of Commonwealth countries who have the right to work in the UK
• nationals of the EU, Switzerland, Norway, Iceland or Liechtenstein and family members of those nationalities with settled or pre-settled status under the European Union Settlement Scheme (EUSS) (opens in a new window)
• nationals of the EU, Switzerland, Norway, Iceland or Liechtenstein and family members of those nationalities who have made a valid application for settled or pre-settled status under the European Union Settlement Scheme (EUSS)
• individuals with limited leave to remain or indefinite leave to remain who were eligible to apply for EUSS on or before 31 December 2020
• Turkish nationals, and certain family members of Turkish nationals, who have accrued the right to work in the Civil Service

Further information on nationality requirements (opens in a new window)

Working for the Civil Service

Please note this Post is NOT regulated by the Civil Service Commission.The Civil Service embraces diversity and promotes equal opportunities. As such, we run a Disability Confident Scheme (DCS) for candidates with disabilities who meet the minimum selection criteria.

Diversity and Inclusion

The Civil Service is committed to attract, retain and invest in talent wherever it is found. To learn more please see theCivil Service People Plan (opens in a new window) and the Civil Service Diversity and Inclusion Strategy (opens in a new window).

Apply and further information

Once this job has closed, the job advert will no longer be available. You may want to save a copy for your records.

Contact point for applicants

Job contact :

• Name : IBCA Recruitment Team
• Email : IBCA.Recruitment@cabinetoffice.gov.uk

Recruitment team

• Email : IBCA.grs@cabinetoffice.gov.uk

Further information

Our recruitment and selection processes are underpinned by the requirement of selection for appointment on the basis of merit by a fair and open competition. If you feel your application has not been treated in accordance with these principles and you wish to make a complaint, you should contact the Resourcing Team at IBCA.grs@cabinetoffice.gov.uk

Attachments

Employee Offer Opens in new window (pdf, 1851kB)