Senior Test Engineer (AI)

Job summary

Across government, the successful adoption of artificial intelligence depends not only on innovation, but on the ability to assure quality, reliability and ethical use at scale. As AI systems become embedded in critical services, robust testing and validation practices are essential to ensure that models perform as expected, outputs are trustworthy and risks are effectively managed. Ofgem plays a vital role in the UK’s energy system, protecting consumers and enabling a more secure, fair and sustainable energy future, and strong assurance of AI-enabled services is critical to delivering this mission.

Ofgem is on an ambitious transformation journey. Within the Digital, Data and Security Services (DDSS) directorate, we are building advanced data and AI capabilities to support innovation, improve efficiency and enhance decision-making. As part of this, we are embedding modern testing practices across digital, data and AI services, ensuring that quality is built into every stage of delivery.

As the Senior Test Engineer for AI, you will play a key role in ensuring the quality and reliability of AI and data-driven solutions. You will lead the design and implementation of testing strategies for complex systems, including AI models, data pipelines and digital services. You will work across multidisciplinary teams, embedding test-driven and behaviour-driven development practices and promoting a culture of quality and continuous improvement.

This is a senior, hands-on technical role requiring strong expertise in testing, automation and AI systems, alongside the ability to influence and mentor across delivery teams.

Job description

You will be responsible for:

• Leading the design and execution of test strategies across AI, data and digital services, ensuring alignment with organisational standards and delivery objectives.

• Designing and implementing testing approaches for AI systems, including model validation, data quality assurance and pipeline testing.

• Embedding quality practices such as TDD and BDD across delivery teams, ensuring early and continuous testing throughout the lifecycle.

• Developing and maintaining automated test frameworks and integrating testing into CI/CD pipelines.

• Identifying risks and issues from test results, providing clear insight and recommendations to stakeholders.

• Collaborating with engineers, data scientists and product teams to ensure quality is embedded from design through to deployment.

• Leading defect management processes, analysing trends and supporting continuous improvement in quality and testing practices.

• Championing new testing approaches and tools, including AI-driven testing and predictive analytics.

• Coaching and mentoring team members, contributing to capability development and knowledge sharing across the organisation.

• Ensuring compliance with accessibility, security and governance standards within testing practices.

We are looking for:

A technically strong and forward-thinking testing professional who can lead quality assurance for AI and data-driven systems. You will bring experience in modern testing practices, alongside an understanding of AI and data platforms.

You may come from a testing, QA, data or engineering background, but you will demonstrate:

• Extensive experience managing testing across complex systems, including AI and data platforms

• Strong knowledge of automated testing frameworks and tools within Microsoft-based environments

• Experience with programming or scripting languages (e.g. Python, Java, SQL or JavaScript)

• A solid understanding of CI/CD, DevOps and cloud-based testing integration

• The ability to analyse risks, manage defects and drive continuous improvement in quality

An ISTQB Advanced certification (or equivalent) is expected (or willingness to obtain).

Experience working in agile delivery environments, and exposure to AI model validation or data pipeline testing, would be beneficial.

This is an opportunity to play a key role in ensuring that Ofgem’s AI and data-driven services are reliable, ethical and high quality. You will help embed robust assurance practices across the organisation, supporting innovation while maintaining trust and performance in critical systems.

Person specification

Essential Criteria

• Extensive expertise in managing quality across the AI solution development lifecycle in a Microsoft AI environment using testing platforms and tools, including Azure Test Plan, Co-pilot Studio, Co-pilot studio CLI and PowerShell tools, AI foundry and AI foundry Agent evaluation SDK (Lead Criteria)
• Proficiency in one or more coding languages (e.g. Python, Java, R, SQL, or JavaScript). (Lead Criteria)
• Strong understanding of AI CI/CD, DevOps and cloud-based test integration practices.

Holds or can obtain the following certifications or equivalent:

• ISTQB Certified (Advanced Level)

Desirable Criteria

• Experience working within agile delivery environments.

#LI-DNI

Behaviours

We'll assess you against these behaviours during the selection process:

• Making Effective Decisions
• Communicating and Influencing
• Delivering at Pace

Technical skills

We'll assess you against these technical skills during the selection process:

• You will also be invited to complete a technical test. Full details will be included in the invitation to interview.

Benefits

Alongside your salary of £49,452, OFGEM contributes £14,326 towards you being a member of the Civil Service Defined Benefit Pension scheme. Find out what benefits a Civil Service Pension provides (opens in a new window).Ofgem can offer you a comprehensive and competitive benefits package which includes; 30 days annual leave after 2 years; Excellent training and development opportunities; The opportunity to join the generous Civil Service pension which also includes a valuable range of benefits; hybrid working (currently 1 day a week in the office but this is kept under review), flexible working hours and family friendly policies. Plus lots of other benefits including clean and bright offices based centrally, engaged networks and teams and an opportunity to contribute to our ambitious and important targets of establishing a Net Zero energy system by 2050. This exciting blend of professional challenge and personal reward identifies career opportunities at Ofgem as something to get excited about.

Things you need to know

Artificial intelligence

Artificial intelligence can be a useful tool to support your application, however, all examples and statements provided must be truthful, factually accurate and taken directly from your own experience. Where plagiarism has been identified (presenting the ideas and experiences of others, or generated by artificial intelligence, as your own) applications may be withdrawn and internal candidates may be subject to disciplinary action. Please see our candidate guidance (opens in a new window) for more information on appropriate and inappropriate use.

Selection process details

This vacancy is using Success Profiles (opens in a new window), and will assess your Behaviours, Experience and Technical skills.

When you press the ‘Apply now’ button, you will be asked to complete personal details (not seen by the sift panel), your career history and qualifications.

You will then be asked to provide a 1250 word ‘personal statement’ evidencing how you meet the essential and desirable skills and capabilities listed in the role profile. Please ensure you demonstrate clearly, within your supporting statement, how you meet each of the criteria listed in the role profile. In the event of receiving a large number of applications, an initial sift may take place on just the lead criteria indicated in the essential criteria.

The personal information we have collected from you will be shared with Cifas who will use it to prevent fraud, other unlawful or dishonest conduct, malpractice, and other seriously improper conduct. If any of these are detected, you could be refused certain services or employment. Your personal information will also be used to verify your identity. Further details of how your information will be used by us and Cifas, and your data protection rights, can be found by [https://www.cifas.org.uk/fpn].

At Ofgem, we expect our staff to carry out their roles with honesty, fairness and openness. They should follow the Civil Service code and be free from any influence or bias. We are committed to making sure interests are recognised, declared and managed appropriately so that we can fulfil our duties as an energy regulator. Our Conflicts of Interest policy outlines the types of interests Ofgem staff must declare before onboarding, and the rules they must follow throughout employment so that we can clearly demonstrate that our decisions are not influenced by private interests.

Feedback will only be provided if you attend an interview or assessment.

Security

Successful candidates must undergo a basic (or equivalent) criminal record check.Successful candidates must meet the security requirements before they can be appointed. The level of security needed is security check (opens in a new window).

See our vetting charter (opens in a new window).People working with government assets must complete baseline personnel security standard (opens in new window) checks.

Nationality requirements

This job is broadly open to the following groups:

• UK nationals
• nationals of the Republic of Ireland
• nationals of Commonwealth countries who have the right to work in the UK
• nationals of the EU, Switzerland, Norway, Iceland or Liechtenstein and family members of those nationalities with settled or pre-settled status under the European Union Settlement Scheme (EUSS) (opens in a new window)
• nationals of the EU, Switzerland, Norway, Iceland or Liechtenstein and family members of those nationalities who have made a valid application for settled or pre-settled status under the European Union Settlement Scheme (EUSS)
• individuals with limited leave to remain or indefinite leave to remain who were eligible to apply for EUSS on or before 31 December 2020
• Turkish nationals, and certain family members of Turkish nationals, who have accrued the right to work in the Civil Service

Further information on nationality requirements (opens in a new window)

Working for the Civil Service

Please note this Post is NOT regulated by the Civil Service Commission.The Civil Service embraces diversity and promotes equal opportunities. As such, we run a Disability Confident Scheme (DCS) for candidates with disabilities who meet the minimum selection criteria.The Civil Service also offers a Redeployment Interview Scheme to civil servants who are at risk of redundancy, and who meet the minimum requirements for the advertised vacancy.

Diversity and Inclusion

The Civil Service is committed to attract, retain and invest in talent wherever it is found. To learn more please see theCivil Service People Plan (opens in a new window) and the Civil Service Diversity and Inclusion Strategy (opens in a new window).

Apply and further information

This vacancy is part of the Great Place to Work for Veterans (opens in a new window) initiative.The Civil Service welcomes applications from people who have recently left prison or have an unspent conviction. Read more about prison leaver recruitment (opens in new window).Once this job has closed, the job advert will no longer be available. You may want to save a copy for your records.

Contact point for applicants

Job contact :

• Name : Amber Shankland
• Email : amber.shankland@ofgem.gov.uk

Recruitment team

• Email : recruitment@ofgem.gov.uk

Further information

Appointment to the Civil Service is governed by the Civil Service Commission’s Recruitment Principles. You have the right to complain if you feel there has been a breach of these Recruitment Principles.

In the first instance, you should raise the matter directly via recruitment@ofgem.gov.uk. If you are not satisfied with the response, you may bring your complaint to the Commission. For further information on bringing a complaint to the Civil Service Commission, please visit their website.

Attachments

DDSS Role Profile Senior Test Engineer (AI) (2b) Opens in new window (pdf, 119kB)DDSS Candidate Pack, Senior Test Engineer (AI) Opens in new window (pdf, 3443kB)Terms and Conditions Opens in new window (pdf, 335kB)