Senior Market Intelligence Analytics Engineer

Job summary

Ofgem is working at the forefront of the fight to protect consumers and combat unfair practices in Britain’s energy markets, using data, technology and intelligence to strengthen oversight of a rapidly evolving sector. We’re looking for a Senior Market Intelligence Analytics Engineer to join us and help deliver the technical foundations that support smarter decision-making, stronger market insight and a fairer energy system.Ofgem is Great Britain’s independent energy regulator. We’re at the forefront of change across the energy sector, driving toward Net Zero whilst protecting energy consumers, especially vulnerable people.

We’re offering a permanent opportunity with the chance to work on high-profile and business-critical data initiatives that directly support our consumer protection, Net Zero and economic growth objectives. This is an exciting role for someone who enjoys solving complex data challenges and transforming large volumes of information into valuable intelligence that informs regulatory decisions.

Working within a specialist area of Ofgem, you’ll contribute to the development of reliable, high-quality data products, analytical tools and technical capabilities that support market monitoring and surveillance activities. The role offers significant scope to influence how data is managed, transformed and used, while helping drive improvements in efficiency, consistency and insight across a wide range of analytical outputs.

We’re looking for someone with strong technical expertise in data engineering and analytics, with experience developing reliable, scalable data solutions and transforming complex data into meaningful insights. You’ll be confident translating business needs into practical technical outcomes, working with large and varied datasets, and improving tools, processes and reporting capabilities to support informed decision-making.

Alongside meaningful and impactful work, you’ll benefit from flexible working arrangements, including full-time, part-time and flexible working options. You’ll join a collaborative environment where knowledge sharing, innovation and continuous improvement are valued, giving you the opportunity to shape technical approaches, influence best practice and contribute to the development of wider team capability.

We have a critical purpose to strengthen market intelligence and data-driven oversight of wholesale energy markets. Join us in helping combat market risks, improve transparency and ensure the energy market functions fairly for consumers as Great Britain progresses towards a cleaner, more secure energy future.

Read on and find out more.

Job description

Key Responsibilities

• Develop, test and maintain Python and SQL data products, data-quality processes and market monitoring tools.
• Proactively gather and fulfil requirements for improved data products and tools
• Oversee the preparation of data for dashboards and build Power BI outputs to support monitoring and analysis.
• Improve data pipelines, data tools, frameworks and processes to increase reliability, performance, features and capabilities.
• Drive good testing, validation and documentation practices.
• Share knowledge with colleagues, provide informal mentoring and contribute to team capability building.
• Proactively drive the adoption of Databricks for our data needs.

Key Outputs and Deliverables

• High quality SQL and Python code for data pipelines, data analysis and data-quality to support market monitoring and market surveillance.
• Well-defined requirements translated into deliverable technical work with clear assumptions and outputs.
• Dashboards and prepared datasets that support colleagues to interpret and act on data.
• Evidence of capability building through mentoring, knowledge sharing or improved team documentation.

Person specification

Essential Criteria

• Strong experience implementing performant and maintainable Python and SQL solutions to clean, validate, transform and analyse data held in a range of formats (Lead Criteria).
• Experience translating business requirements into technical solutions and reproducible outputs (Lead Criteria).
• Experience working with large datasets to automate the production of accurate, robust outputs.
• Experience improving technical processes, frameworks or tools, including testing and validation approaches.
• Experience building and maintaining dashboards in Power BI.
• Ability to define and follow requirements and deliver to agreed frameworks, standards and deadlines.

Desirable Criteria

• Knowledge of wholesale energy markets or other regulated markets.
• Strong communication skills with the ability to refine requirements, explain technical issues clearly and work with a range of stakeholders.

Behaviours

We'll assess you against these behaviours during the selection process:

• Changing and Improving
• Making Effective Decisions
• Communicating and Influencing

Benefits

Alongside your salary of £49,452, OFGEM contributes £14,326 towards you being a member of the Civil Service Defined Benefit Pension scheme. Find out what benefits a Civil Service Pension provides.Ofgem can offer you a comprehensive and competitive benefits package which includes; 30 days annual leave after 2 years; Excellent training and development opportunities; The opportunity to join the generous Civil Service pension which also includes a valuable range of benefits; hybrid working (currently 1 day a week in the office but this is kept under review), flexible working hours and family friendly policies. Plus lots of other benefits including clean and bright offices based centrally, engaged networks and teams and an opportunity to contribute to our ambitious and important targets of establishing a Net Zero energy system by 2050. This exciting blend of professional challenge and personal reward identifies career opportunities at Ofgem as something to get excited about.

Things you need to know

Artificial intelligence

Artificial intelligence can be a useful tool to support your application, however, all examples and statements provided must be truthful, factually accurate and taken directly from your own experience. Where plagiarism has been identified (presenting the ideas and experiences of others, or generated by artificial intelligence, as your own) applications may be withdrawn and internal candidates may be subject to disciplinary action. Please see our candidate guidance (opens in a new window) for more information on appropriate and inappropriate use.

Selection process details

This vacancy is using Success Profiles (opens in a new window), and will assess your Behaviours and Experience.

When you press the ‘Apply now’ button, you will be asked to complete personal details (not seen by the sift panel), your career history and qualifications.

You will then be asked to provide a 1250 word ‘personal statement’ evidencing how you meet the essential and desirable criteria listed in the role profile. Please ensure you demonstrate clearly, within your supporting statement, how you meet each of the criteria listed in the role profile. In the event of receiving a large number of applications, an initial sift may take place on just the lead criteria indicated in the essential criteria.

The personal information we have collected from you will be shared with Cifas who will use it to prevent fraud, other unlawful or dishonest conduct, malpractice, and other seriously improper conduct. If any of these are detected, you could be refused certain services or employment. Your personal information will also be used to verify your identity. Further details of how your information will be used by us and Cifas, and your data protection rights, can be found by [https://www.cifas.org.uk/fpn].

At Ofgem, we expect our staff to carry out their roles with honesty, fairness and openness. They should follow the Civil Service code and be free from any influence or bias. We are committed to making sure interests are recognised, declared and managed appropriately so that we can fulfil our duties as an energy regulator. Our Conflicts of Interest policy outlines the types of interests Ofgem staff must declare before onboarding, and the rules they must follow throughout employment so that we can clearly demonstrate that our decisions are not influenced by private interests.

Feedback will only be provided if you attend an interview or assessment.

Security

Successful candidates must undergo a criminal record check.People working with government assets must complete baseline personnel security standard (opens in new window) checks.

Nationality requirements

This job is broadly open to the following groups:

• UK nationals
• nationals of the Republic of Ireland
• nationals of Commonwealth countries who have the right to work in the UK
• nationals of the EU, Switzerland, Norway, Iceland or Liechtenstein and family members of those nationalities with settled or pre-settled status under the European Union Settlement Scheme (EUSS) (opens in a new window)
• nationals of the EU, Switzerland, Norway, Iceland or Liechtenstein and family members of those nationalities who have made a valid application for settled or pre-settled status under the European Union Settlement Scheme (EUSS)
• individuals with limited leave to remain or indefinite leave to remain who were eligible to apply for EUSS on or before 31 December 2020
• Turkish nationals, and certain family members of Turkish nationals, who have accrued the right to work in the Civil Service

Further information on nationality requirements (opens in a new window)

Working for the Civil Service

The Civil Service Code (opens in a new window) sets out the standards of behaviour expected of civil servants.

We recruit by merit on the basis of fair and open competition, as outlined in the Civil Service Commission's recruitment principles (opens in a new window).The Civil Service embraces diversity and promotes equal opportunities. As such, we run a Disability Confident Scheme (DCS) for candidates with disabilities who meet the minimum selection criteria.The Civil Service also offers a Redeployment Interview Scheme to civil servants who are at risk of redundancy, and who meet the minimum requirements for the advertised vacancy.

Diversity and Inclusion

The Civil Service is committed to attract, retain and invest in talent wherever it is found. To learn more please see theCivil Service People Plan (opens in a new window) and the Civil Service Diversity and Inclusion Strategy (opens in a new window).

Apply and further information

This vacancy is part of the Great Place to Work for Veterans (opens in a new window) initiative.The Civil Service welcomes applications from people who have recently left prison or have an unspent conviction. Read more about prison leaver recruitment (opens in new window).Once this job has closed, the job advert will no longer be available. You may want to save a copy for your records.

Contact point for applicants

Job contact :

• Name : Lewis Buckley
• Email : recruitment@ofgem.gov.uk

Recruitment team

• Email : recruitment@ofgem.gov.uk

Further information

Appointment to the Civil Service is governed by the Civil Service Commission’s Recruitment Principles. You have the right to complain if you feel there has been a breach of these Recruitment Principles.

In the first instance, you should raise the matter directly via recruitment@ofgem.gov.uk. If you are not satisfied with the response, you may bring your complaint to the Commission. For further information on bringing a complaint to the Civil Service Commission, please visit their website.

Attachments

Senior Market Intelligence Analytics Engineer, Role Profile Opens in new window (pdf, 172kB)Senior Market Intelligence Analytics Engineer, Candidate Pack Opens in new window (pdf, 727kB)Terms and Conditions Apr25 Opens in new window (pdf, 335kB)