Change text size:

Choose Style:

Data Engineer

  • Public sector
  • Cardiff
  • 06/05/2025
  • £34,815.00 - £41,355.00 /yearly
  • Permanent
Job expired!

Job Overview

Location

Cardiff

Job Type

Permanent

Salary

£34,815 - £41,355 yearly

Date Posted:

06/05/2025

Expiration date:

19/05/2025

Additional Detail

Job ID

26010

Work Location

Remote and/or Onsite

Job Description

Locations: Birmingham, Cardiff, Darlington, Edinburgh, London, Salford.
 
The Integrated Corporate Services (ICS) is a new shared corporate service, launched in July 2023. It provides corporate services (HR, Finance, Digital, Commercial, Security and Estates) across the Department for Energy Security & Net Zero (DESNZ) and the Department for Science, Innovation & Technology (DSIT). 
 
Our team of just over 300 professionals will be leading the way in how these functions will be delivered in the future. Our ambition is to be the leading provider of integrated corporate services for government and set the standard for quality, efficiency, and innovation in our field.
 
We offer great working benefits including a world-class pension, flexible working options and a career where your learning and development is taken seriously. We are enormously proud to be a Disability Confident Leader employer. We support candidates with adjustments throughout our recruitment process. Information about disability confidence and just some examples of the adjustments that you can request can be found in the reasonable adjustment section below.
 
The Civil Service is committed to attract, retain and invest in talent wherever it is found. To learn more please see the Civil Service People Plan and the Civil Service D&I Strategy. 

Job overview

Join ICS Digital, where innovation meets expertise to create digital solutions. We are a cohesive digital community who work in the open, solving problems together and fostering a culture of transparency and collaboration. Our commitment to user-focused design and data-driven decision-making ensures that we deliver accessible services tailored to the needs of our customers.

Data is at the core of our work here; we use it to deliver high-quality services and insight for our colleagues across DESNZ and DSIT. We care deeply about what we do and enabling policies that make a difference in the real world! 

We are looking for a Data Engineer to join the team developing the Data Management System, which provides end to end data ingestion, processing and storage capabilities. Delivering insights and decision-making inputs that are core to the challenges that face the Departments today. We have recently worked on projects that have enabled grants to be paid out to citizens and businesses as part of the Energy Affordability programme. Additionally, we have provided insights into key Energy Efficiency projects that have been at the heart of key Department delivery commitments. 

Visit our blog to learn more about us and our work: https://icsdigital.blog.gov.uk/ 

Key responsibilities

Data Ingestion and Orchestration:

  • Designing and implementing data pipelines for efficient data ingestion from various sources with Azure Databricks.
  • Utilising orchestration tools (e.g., Azure Data Factory) to automate data workflows.

Data Processing and Transformation (Extract, Transform, Load) (ETL): 

  • Developing and maintaining ETL processes to clean, transform, and load data into appropriate storage systems.
  • Using Python to manipulate and process data for analytical purposes.

 Developing and Maintaining the Data Management System: 

  • Contributing to the development and maintenance of the end-to-end data management system.
  • Ensuring the system's reliability, scalability, and performance.

 Data Visualisation and Reporting: 

  • Supporting the creation of reports and dashboards using tools like Power BI.

Cloud Infrastructure Management (Azure): 

  • Working with Microsoft Azure cloud services to deploy and manage data infrastructure.
  • Maintaining infrastructure as code (Terraform) for automated provisioning.

Collaboration and Stakeholder Engagement: 

  • Working closely with stakeholders (technical and non-technical) to understand data requirements and deliver solutions.
  • Communicating effectively with team members and other departments.

Testing and Quality Assurance: 

  • Implementing and performing various testing methods (e.g., unit testing, end-to-end testing, user acceptance testing) to ensure data quality and system reliability.
  • Contributing to Quality Assurance practices.

CI/CD and Version Control: 

  • Using CI/CD pipelines to automate the deployment of data solutions.
  • Utilising Git for version control and collaborative development.

Problem Solving and Continuous Learning: 

  • Researching, learning, and applying new technologies and techniques to improve data solutions.
  • Troubleshooting data-related issues and providing effective solutions.

Essential Criteria

We are looking for a problem solver who enjoys researching, learning, testing, and deploying new code solutions.   

Essential skills: 

  • Experience in one or both of Python and R.
  • Knowledge and experience of data modelling, analytical technologies, data visualisation.
  • Experience of working with stakeholders at all levels, including technical and non-technical. 
  • Testing experience - one or more of the following or similar methods: User Acceptance Testing / Automated Testing / Unit testing / End-to-end testing / Quality Assurance.

Desirable Criteria

  • Cloud Computing - preferably familiar with Microsoft Azure.
  • Knowledge of Data ingestion and orchestration (e.g. Azure Data-Factory) and Data Processing (ETL) .
  • Infrastructure-as-code (Terraform).
  • Familiarity with supporting customers with Reports and dashboard connections e.g. PowerBI, RShiny.
  • Familiarity or knowledge of Web Full-Stack Development (AngularJS / .Net).
  • Knowledge of: CI/CD Pipelines; Git.

It is unusual that all candidates will meet all the desirable criteria. If your skills and experience look slightly different from what we have identified and you think you can bring value to the Data Engineer role and the team, we strongly encourage you to apply. We'd love to hear from you!

Behaviours

We'll assess you against these behaviours during the selection process:

  • Developing Self and Others
  • Working Together

Technical skills

We'll assess you against these technical skills during the selection process:

  • Communicating between the technical and non-technical. (Level: Awareness)
  • Programming and build (data engineering) (Level: Working)
  • Data development process (Level: Working) - Assessed via presentation

Alongside your salary of £34,815, Department for Energy Security & Net Zero contributes £10,085 towards you being a member of the Civil Service Defined Benefit Pension scheme. Find out what benefits a Civil Service Pension provides.

The Department for Energy Security and Net Zero offers a competitive mix of benefits including:

  • A culture of flexible working, such as job sharing, homeworking and compressed hours.
  • Automatic enrolment into the Civil Service Pension Scheme, with an employer contribution of 28.97%.
  • A minimum of 25 days of paid annual leave, increasing by 1 day per year up to a maximum of 30.
  • An extensive range of learning & professional development opportunities, which all staff are actively encouraged to pursue.
  • Access to a range of retail, travel and lifestyle employee discounts.

Office attendance

The Department operates a discretionary hybrid working policy, which provides for a combination of working hours from your place of work and from your home in the UK. The current expectation for staff is to attend the office or non-home based location for 40-60% of the time over the accounting period.

Selection process details

This vacancy is using Success Profiles (opens in a new window), and will assess your Behaviours, Experience and Technical skills.

After submission of the first stage of your application you will be invited to complete a Civil Service Numerical Test. If you successfully pass the test, you will be invited to complete the final stage of the application. 

Please complete the online tests as soon as possible (within 24-48 hours is recommended), the closing date for the tests is 23:55 on 19/05/2025. If you fail to complete the online test before the deadline your application will be withdrawn. Guidance for the test will be available when you are invited to take the test. The tests are administered online and accessed via the CS Jobs website.

As part of the application process you will be asked to complete a CV and personal statement.

Further details around what this will entail are listed on the application form.

Please use your personal statement (in no more than 500 words) to describe how you address the skills and experience outlined in the job advert.

Applications will be sifted on CV and Personal Statement.

In the event of a large number of applicants, applications will be sifted on the personal statement. 

Candidates who pass the initial sift may be progressed to a full sift, or progressed straight to assessment/interview.

The interview will consist of behaviour and technical questions. 

Interviewees will be asked to deliver a presentation; further details will be provided nearer the time. 

Sift and interview dates

Sift and interview dates to be confirmed.

Further Information

For further information on National Security Vetting please visit the Demystifying Vetting website.

Reasonable Adjustments

We are proud to be a disability confident leader and we welcome applications from disabled candidates and candidates with long-term conditions. 

Information about the Disability Confident Scheme (DCS) and some examples of adjustments that we offer to disabled candidates and candidates with long-term health conditions during our recruitment process can be found in our DESNZ Candidate Guidance. A DESNZ Plain Text Version of the guidance is also available. 

We encourage candidates to discuss their adjustment needs by emailing the job contact which can be found under the contact point for applicants section. 

If you are experiencing accessibility problems with any attachments on this advert, please contact the email address in the 'Contact point for applicants' section. 

If successful and transferring from another Government Department a criminal record check may be carried out.

New entrants are expected to join on the minimum of the pay band.

A location based reserve list of successful candidates will be kept for 12 months. Should another role become available within that period you may be offered this position.

Please note terms and conditions are attached. Please take time to read the document to determine how these may affect you.

Any move to the Department for Energy, Security and Net Zero  from another employer will mean you can no longer access childcare vouchers. This includes moves between government departments. You may however be eligible for other government schemes, including Tax Free Childcare; for further information visit the Childcare Choices website.

DESNZ does not normally offer full home working (i.e. working at home); but we do offer a variety of flexible working options (including occasionally working from home). 

DESNZ cannot offer Visa sponsorship to candidates through this campaign.

DESNZ holds a Visa sponsorship licence but this can only be used for certain roles and this campaign does not qualify.

In order to process applications without delay, we will be sending a Criminal Record Check to Disclosure and Barring Service /Disclosure Scotland on your behalf.

However, we recognise in exceptional circumstances some candidates will want to send their completed forms direct. If you will be doing this, please advise Government Recruitment Service of your intention by emailing [email protected] stating the job reference number in the subject heading. 

For further information on the Disclosure Scotland confidential checking service telephone: the Disclosure Scotland Helpline on 0870 609 6006 and ask to speak to the operations manager in confidence, or email [email protected] 

Applicants who are successful at interview will be, as part of pre-employment screening, subject to a check on the Internal Fraud Database (IFD). This check will provide information about employees who have been dismissed for fraud or dishonesty offences. This check also applies to employees who resign or otherwise leave before being dismissed for fraud or dishonesty had their employment continued. Any applicant's details held on the IFD will be refused employment. 

A candidate is not eligible to apply for a role within the Civil Service if the application is made within a 5 year period following a dismissal for carrying out internal fraud against government.

Feedback

Feedback will only be provided if you attend an interview or assessment.

Security

Successful candidates must undergo a criminal record check.
 
Successful candidates must meet the security requirements before they can be appointed. The level of security needed is security check (opens in a new window).

See our vetting charter (opens in a new window).
 
People working with government assets must complete baseline personnel security standard (opens in new window) checks.

Nationality requirements

This job is broadly open to the following groups:

  • UK nationals
  • nationals of the Republic of Ireland
  • nationals of Commonwealth countries who have the right to work in the UK
  • nationals of the EU, Switzerland, Norway, Iceland or Liechtenstein and family members of those nationalities with settled or pre-settled status under the European Union Settlement Scheme (EUSS) (opens in a new window)
  • nationals of the EU, Switzerland, Norway, Iceland or Liechtenstein and family members of those nationalities who have made a valid application for settled or pre-settled status under the European Union Settlement Scheme (EUSS)
  • individuals with limited leave to remain or indefinite leave to remain who were eligible to apply for EUSS on or before 31 December 2020
  • Turkish nationals, and certain family members of Turkish nationals, who have accrued the right to work in the Civil Service
Further information on nationality requirements (opens in a new window)

Working for the Civil Service

The Civil Service Code (opens in a new window) sets out the standards of behaviour expected of civil servants.

We recruit by merit on the basis of fair and open competition, as outlined in the Civil Service Commission's recruitment principles (opens in a new window).
 
The Civil Service embraces diversity and promotes equal opportunities. As such, we run a Disability Confident Scheme (DCS) for candidates with disabilities who meet the minimum selection criteria.
The Civil Service also offers a Redeployment Interview Scheme to civil servants who are at risk of redundancy, and who meet the minimum requirements for the advertised vacancy.

Diversity and Inclusion

The Civil Service is committed to attract, retain and invest in talent wherever it is found. To learn more please see the Civil Service People Plan (opens in a new window) and the Civil Service Diversity and Inclusion Strategy (opens in a new window).
 
This vacancy is part of the Great Place to Work for Veterans (opens in a new window) initiative.
 
The Civil Service welcomes applications from people who have recently left prison or have an unspent conviction. Read more about prison leaver recruitment (opens in new window).
 
Once this job has closed, the job advert will no longer be available. You may want to save a copy for your records.

Contact point for applicants

Job contact

Recruitment team

Further information

Appointment to the Civil Service is governed by the Civil Service Commission's Recruitment Principles. If you feel that your application has not been treated in accordance with the recruitment principles, and wish to make a complaint, then you should contact in the first instance [email protected].
 
If you are not satisfied with the response that you receive, then you can contact the Civil Service Commission. For further information on bringing a complaint to the Civil Service Commission please visit their web pages: Click here to visit Civil Service Commission/Complaints

Attachments

DESNZ TCs v1.2 Opens in new window (doc, 174kB)

REPORT JOB

Our use of cookies

We use necessary cookies to help our site function. We’d also like to use analytics cookies that help us make improvements by measuring how you use our website.

For more detailed information about the cookies we use, see our Cookies page.


Necessary cookies

Necessary cookies enable core website functionality such as network management, security and accessibility. You may disable these by changing your browser settings, but this may impact how the website functions.


Analytics cookies

 

We’d like to collect website analytics cookies information using Google Analytics to help us improve our website. We collect this data by running Google Analytics JavaScript on your device, which collects data about how you interact with our site. The data is collected in a way that does not directly identify anyone. For more information please see our Cookies page.