Data Engineer

Job description

Job responsibilities

Main duties and responsibilities

• Programming and build - You can design, write and iterate code from prototype to production-ready. You understand security, accessibility and version control. You can use a range of coding tools and languages. You can develop code that self-generates documentation that supports Data Scientists and Data Analysts.
• Technical understanding - You know about the specific technologies that underpin your ability to deliver the responsibilities and tasks of the role. You can apply the required breadth and depth of technical knowledge.
• Testing - You can plan, design, manage, execute and report tests, using appropriate tools and techniques, and work within regulations. You know how to ensure that risks associated with deployment are adequately understood and documented
• Problem resolution - You know how to log, analyse and manage problems in order to identify and implement the appropriate solution. You can ensure that the problem is fixed.

You will work in the Data Engineering and Enablement Division that reports into the Data Operations Directorate. Its an exciting time to join as we seek to create leading Health Protection data capabilities that enable data scientists and data analysts to develop insights that inform public health decisions with resilience platforms and curated data assets.

The role requires the ingestion of a wide range of data assets, building acquisition, orchestration, data pipelines and curated data marts and data egresses. We are seeking to mature our advanced capabilities with standardised practices, machine learning and agility needed to pro-active detect and respond to new public health issues.

You will be involved in the delivery lifecycle from engaging with stakeholders on new initiatives, analysing use cases, developing optimal designs that where possible re-use and extend capabilities, and implement and operate the design. Our teams work collaboratively in an agile multi-disciplinary team mode and we are looking for engineers who have the ability to operate in feature teams, data operations and DevSecOps models. We are developing our engineering community of practice to share knowledge, enhance our standards and processes to provide a strong foundation to develop individuals, teams and innovation.

Essential Criteria

• Strong at python, unit testing (pytest) and pep8 standards
• Writing robust data pipeline code that can run unattended
• Pandas data validation, manipulation, merging, joining and at times visualisation
• Unix environment, server health and management of ongoing running processes
• Github, git, pull requests, CI and code review
• Logging and reporting pragmatically
• Ability to troubleshoot and solve numerical and technical problems
• High attention to detail
• Excellent communication and facilitation skills evidenced through verbal and written means to a wide range of stakeholders
• Experience with Agile delivery
• Data engineering experience using Python, SQL, Spark and AWS
• Hands on ETL development experience utilizing Microsoft enterprise stack / Azure and AWS Glue
• Knowledge of data management platforms and development with SQLServer
• Experience with publishing data sets for visualisation and analysis
• Experience with supporting design of data models / data flows
• Ability to work as part of a team to develop and deliver end-to-end data warehouse solutions
• Analytical skill set with an ability to understand data requirements and support the development of data solutions

Desirable Criteria

• Machine learning for engineering practices, such as meta driven intelligent ETL and pipeline processes
• Experience of working with JIRA (or Azure DevOps or similar tools) within an Agile/Scrum environment
• Experience/understanding of software and data lifecycle management
• Educated to degree level (not essential, experience is key). Relevant numerate, technical or computer science discipline would be an advantage

We pride ourselves as being an employer of choice, where Everyone Matters promoting equality of opportunity to actively encourage applications from everyone, including groups currently underrepresented in our workforce.

UKHSA ethos is to be an inclusive organisation for all our staff and stakeholders. To create, nurture and sustain an inclusive culture, where differences drive innovative solutions to meet the needs of our workforce and wider communities. We do this through celebrating and protecting differences by removing barriers and promoting equity and equality of opportunity for all.

Selection Process

This vacancy is using Success Profiles, and will assess your Behaviours, Experience and Strengths

This part of the selection process should outline how you consider your skills, experience and achievements, and provide evidence of your suitability for the role, with particular reference to the essential criteria outlined.

You will also be asked to provide information within the Employer/ Activity history section of the application form. This is equivalent to the information you would provide on a CV, setting out your career history. This will be used in sifting process and will be scored.

Stage 1: Application & SiftAs part of the application process, you will be asked to provide a Statement of Suitability in no more than 750 words regarding the following behaviours:

• Changing and Improving
• Making Effective Decisions
• Communicating and Influencing
• Delivering At Pace
• Managing a quality Service

providing examples of how you meet the essential criteria. It should also detail what you and your experience can bring to the role. We suggest using the STAR (situation, task, action, result) method to demonstrate real-life examples for the specified essential criteria. Please note, only information provided within the stated word count will be considered.

If you are successful at this stage, you will progress to interview

Stage 2: Panel Interview

All candidates who are successful at the sift stage will undertake a single video interview AND a written technical skills test

The Behaviours tested during the interview stage will be:

• Changing and Improving
• Making Effective Decisions
• Communicating and Influencing
• Delivering at Pace
• Managing a quality service

Reserve List:

Candidates who pass the interview criteria but are not offered a post will be kept on a reserve list for 12 months and may be contacted if similar roles become available.

If you are interviewed for the post and do not meet the required threshold for the specified grade, your application may be assessed against a similar, lower grade role and you may be offered the post should one be available.

Benefits

• Alongside your salary of £49,592, UK Health Security Agency contributes £13,390 towards you being a member of the Civil Service Defined Benefit Pension scheme. Find out what benefits a Civil Service Pension provides.
• A Civil Service pension with an average employer contribution of 27%
• Learning and development tailored to your role
• An environment with flexible working options
• A culture encouraging inclusion and diversity
• Range of health and wellbeing support

Any move to UKHSA from another employer will mean you can no longer access childcare vouchers. This includes moves between government departments. You may however be eligible for other government schemes, including Tax Free Childcare.

DBS - People working with government systems must complete Basic Personnel Security Standard (BPSS) checks which includes a disclosure and barring security check. Successful candidates must meet the security requirements before they can be appointed. The level of security needed for this role is BPSS however there may be a requirement for this role to be SC cleared and you should familiarise yourself with the criteria of security clearance.

This role is Open to all external applicants (anyone) from outside the Civil Service (including by definition internal applicants. Appointments to roles within UKHSA will be made in accordance with the Civil Service nationality rules. These can be found athttps://www.gov.uk/government/publications/nationality-rulesThis job is broadly open to the following groups:

• UK nationals
• Nationals of Commonwealth countries who have the right to work in the UK
• Nationals of the Republic of Ireland
• Nationals from the EU, EEA or Switzerland with settled or pre-settled status or who apply for either status by the deadline of theEuropean Union Settlement Scheme (EUSS)
• Relevant EU, EEA, Swiss or Turkish nationals working in the Civil Service
• Relevant EU, EEA, Swiss or Turkish nationals who have built up the right to work in the Civil Service
• Certain family members of the relevant EU, EEA, Swiss or Turkish nationals

We recruit by merit on the basis of fair and open competition, as outlined in the Civil Service Commission's Recruitment Principles.

The Civil Service embraces diversity and promotes equal opportunities. As such, we run a Disability Confident Scheme (DCS) for candidates with disabilities who meet the minimum selection criteria.

The Civil Service welcomes applications from people who have recently left prison or have an unspent conviction. Read more about prison leaver recruitment.

Once this job has closed, the job advert will no longer be available. You may want to save a copy for your records.

Government baseline personnel security standard

Its important to note that there are currently exceptions to applications being considered if your conviction relates to any of the following:

• life sentences
• arson
• sexual offences
• hate and terror offences

Some departments will also consider the specific offence against the nature of the business, i.e., a conviction for fraud may rule you out for a finance role

Contact Details Sophie.Rigney@reed.com

Person Specification

Experience

Essential

• oStrong at python, unit testing (pytest) and pep8 standards

Disclosure and Barring Service Check

This post is subject to the Rehabilitation of Offenders Act (Exceptions Order) 1975 and as such it will be necessary for a submission for Disclosure to be made to the Disclosure and Barring Service (formerly known as CRB) to check for any previous criminal convictions.

Certificate of Sponsorship

Applications from job seekers who require current Skilled worker sponsorship to work in the UK are welcome and will be considered alongside all other applications. For further information visit the UK Visas and Immigration website (Opens in a new tab).

From 6 April 2017, skilled worker applicants, applying for entry clearance into the UK, have had to present a criminal record certificate from each country they have resided continuously or cumulatively for 12 months or more in the past 10 years. Adult dependants (over 18 years old) are also subject to this requirement. Guidance can be found here Criminal records checks for overseas applicants (Opens in a new tab).

Employer details

Employer name

UK Health Security Agency

Address

Colindale

London

NW9 5EQ

Employer's website

https://www.gov.uk/government/organisations/uk-health-security-agency (Opens in a new tab)