Job summary
A
vacancy has arisen for a full time, permanent Associate Data Engineer to
support the development and ongoing function of our Data Centre within the
Software team at NHS South Yorkshire.
The
position is to assist in the maintenance and expansion of the Integrated Care
Boards database repositories. This role requires excellent SQL skills and
experience of database management of a large data warehouse.
If you have used any Artificial Intelligence (AI) programmes, such as ChatGPT, to support your application, please declare this at the start of your supporting statement.
Interview date: 15/11/2024
Main duties of the job
This role will:
-
Provide day-to-day maintenance of our Azure SQL and Azure SQL
Managed Instance Databases
-
Build, monitor and maintain Azure Data Factory (ADF) Pipelines
-
Understand and utilise other Microsoft Fabric and Azure services
like Storage, Events, Alerts, Power BI, and Analysis Services Understand and
implement appropriate security and compliance measures based on NHS policies
and industry best-practice.
-
Document sources and logic used to build Data Centre structures.
-
Communicate complex analytical matters to others and advise
accordingly.
-
Maintain and monitor the Data Centre to ensure high availability
for end users and analysts and continue development.
-
Working with the external organisations and key ICB contacts
The
ideal candidate will:
-
Have experience of NHS systems
-
Have experience of working with cloud-based data platform
solutions
-
Have experience of working in a multi-disciplinary team
About us
NHS South Yorkshire Integrated Care Board oversees health
and social care for a population of 1.4m people. Working through our 4 places, Barnsley, Doncaster, Rotherham, and Sheffield, we are building on the
strengths, capacity and knowledge of all those directly involved with our local
communities to deliver our four key aims of Improving outcomes in
population health and healthcare; Tackling inequalities in outcomes, experience
and access; Enhancing productivity and value for money; and Helping the NHS
support broader social and economic development.
Our near 1,000 staff are committed to addressing the broader
health, public health, and social care needs of the population across South
Yorkshire through our values of One Team, Empowered and Innovative. We work as a key partner with the
Integrated Care Partnership (ICP) of health and care providers within the South
Yorkshire Integrated Care System (ICS) to collectively deliver health and care
services that meet the needs of the local population. In total there are 186 GP
practices in the region, 72,000 health and social care professionals working
across seven NHS trusts and four local authorities, and a further 6,000
voluntary, community and social enterprise sector (VCSE) organisations. We work
alongside all these colleagues through local councils, our VCSE
partners and other partners to address health inequalities and wider
determinants of health in South Yorkshire.
South Yorkshire ICB is a Disability Confident Employer
Job description
Job responsibilities
The post holder supports
the management of data across its full lifecycle, from data extraction,
through transformation and loading into a curated asset and data products for
onward use in the production of analytical insights. Working as part of
multi-disciplinary teams alongside colleagues from across Data &
Insights, the role holder will ensure that data are handled in an efficient
and secure way in line with information governance legislation.
The role holder will
apply skills across a range of data management and analysis areas
including:
Supporting
Requirements gathering and build of specifications across a wide array of
stakeholders, both internal and external
- implement data flows to connect operational
systems, data for analytics and business intelligence (BI) systems
- document source-to-target mappings
- re-engineer manual data flows to enable
scaling and repeatable use
- support the build of data streaming systems
and automated reports
- write ETL (extract, transform, load) scripts
and code to ensure the ETL process performs optimally
- develop business intelligence reports that
can be reused and build accessible data for analysis
- Cloud and
on-premise database and data pipeline management
The
post holder can work under direction to identify and use the most appropriate
techniques, and you have an understanding of data engineering tools. You can
demonstrate numeracy. You can show an awareness of advances in digital
analytics tools and data manipulation products and can keep up to date with
them. You can collect, collate, cleanse, synthesise and interpret data to
derive meaningful and actionable insights.
This post will comply with all regulatory
requirements in such areas as data quality and data security, within an
environment that is committed to the proper governance and secure use of
data.
Job description
Job responsibilities
The post holder supports
the management of data across its full lifecycle, from data extraction,
through transformation and loading into a curated asset and data products for
onward use in the production of analytical insights. Working as part of
multi-disciplinary teams alongside colleagues from across Data &
Insights, the role holder will ensure that data are handled in an efficient
and secure way in line with information governance legislation.
The role holder will
apply skills across a range of data management and analysis areas
including:
Supporting
Requirements gathering and build of specifications across a wide array of
stakeholders, both internal and external
- implement data flows to connect operational
systems, data for analytics and business intelligence (BI) systems
- document source-to-target mappings
- re-engineer manual data flows to enable
scaling and repeatable use
- support the build of data streaming systems
and automated reports
- write ETL (extract, transform, load) scripts
and code to ensure the ETL process performs optimally
- develop business intelligence reports that
can be reused and build accessible data for analysis
- Cloud and
on-premise database and data pipeline management
The
post holder can work under direction to identify and use the most appropriate
techniques, and you have an understanding of data engineering tools. You can
demonstrate numeracy. You can show an awareness of advances in digital
analytics tools and data manipulation products and can keep up to date with
them. You can collect, collate, cleanse, synthesise and interpret data to
derive meaningful and actionable insights.
This post will comply with all regulatory
requirements in such areas as data quality and data security, within an
environment that is committed to the proper governance and secure use of
data.
Person Specification
Attributes
Essential
- Able to work flexibly within situations of ambiguity.
- Is self motivated, self aware and proactive.
- Commitment to and focus on quality and meeting standards.
- Fosters good working relationships and embraces diversity & inclusion.
- Committed to professional development.
Experience
Essential
- Experience of presenting and explaining through written and verbal communication in a style that translates technical detail into user friendly, accessible plain English that can be understood by all audiences.
- Experience of having discussions with stakeholders (internal and external) to clarify or define specifications.
- Experience of database configuration, performance tuning and administration.
- Significant experience of ETL and data warehouse schemas, and relational database systems.
Desirable
- Experience in NHS information flows, hospital systems and applications.
- Experience of working with cloud-based data platform solutions.
Knowledge and Understanding
Essential
- Good working knowledge and experience in the effective use of spreadsheets and databases including use of data interrogation tools and wider functionality such as formulae.
- Knowledge of how to interpret data.
- Significant experience and knowledge of database structures and how to interrogate and maintain databases.
- Knowledge of process design and code development acquired through degree level or equivalent qualification/experience.
- Able to exhibit knowledge of relevant legislation when working with public data such as the Data Protection Act and GDPRR.
- Advanced knowledge of industry-standard data management tools, such as MS SQL, Python, Oracle.
- Working knowledge of agile methodologies or relevant experience or training.
- Awareness of configuration of cloud-based data platforms and build of data pipelines across multiple data assets.
Desirable
- Knowledge of testing and assurance processes; including, development of test plans; an understanding of reference data management and its application.
- Knowledge of health and care information flows, hospital systems and applications.
Qualifications
Essential
- Degree level qualification in an IT or numerate related subject or equivalent qualification/experience.
Skills and Competencies
Essential
- Excellent written, documentation and oral communication skills and abilities.
- Can easily interpret the quality of data through proactive identification of poor data quality and propose appropriate solutions.
- Experience of curating data and building data assets to meet a business need.
- Experience of creating automated extract, transform and load processes to optimize insight delivery.
- Ability to use initiative to decide relevant actions, make recommendations and make decisions autonomously, when required, on difficult issues, working to tight and often changing timescales.
Person Specification
Attributes
Essential
- Able to work flexibly within situations of ambiguity.
- Is self motivated, self aware and proactive.
- Commitment to and focus on quality and meeting standards.
- Fosters good working relationships and embraces diversity & inclusion.
- Committed to professional development.
Experience
Essential
- Experience of presenting and explaining through written and verbal communication in a style that translates technical detail into user friendly, accessible plain English that can be understood by all audiences.
- Experience of having discussions with stakeholders (internal and external) to clarify or define specifications.
- Experience of database configuration, performance tuning and administration.
- Significant experience of ETL and data warehouse schemas, and relational database systems.
Desirable
- Experience in NHS information flows, hospital systems and applications.
- Experience of working with cloud-based data platform solutions.
Knowledge and Understanding
Essential
- Good working knowledge and experience in the effective use of spreadsheets and databases including use of data interrogation tools and wider functionality such as formulae.
- Knowledge of how to interpret data.
- Significant experience and knowledge of database structures and how to interrogate and maintain databases.
- Knowledge of process design and code development acquired through degree level or equivalent qualification/experience.
- Able to exhibit knowledge of relevant legislation when working with public data such as the Data Protection Act and GDPRR.
- Advanced knowledge of industry-standard data management tools, such as MS SQL, Python, Oracle.
- Working knowledge of agile methodologies or relevant experience or training.
- Awareness of configuration of cloud-based data platforms and build of data pipelines across multiple data assets.
Desirable
- Knowledge of testing and assurance processes; including, development of test plans; an understanding of reference data management and its application.
- Knowledge of health and care information flows, hospital systems and applications.
Qualifications
Essential
- Degree level qualification in an IT or numerate related subject or equivalent qualification/experience.
Skills and Competencies
Essential
- Excellent written, documentation and oral communication skills and abilities.
- Can easily interpret the quality of data through proactive identification of poor data quality and propose appropriate solutions.
- Experience of curating data and building data assets to meet a business need.
- Experience of creating automated extract, transform and load processes to optimize insight delivery.
- Ability to use initiative to decide relevant actions, make recommendations and make decisions autonomously, when required, on difficult issues, working to tight and often changing timescales.
Additional information
Applications from job seekers who require current Skilled worker sponsorship to work in the UK are welcome and will be considered alongside all other applications. For further information visit the UK Visas and Immigration website (Opens in a new tab).
From 6 April 2017, skilled worker applicants, applying for entry clearance into the UK, have had to present a criminal record certificate from each country they have resided continuously or cumulatively for 12 months or more in the past 10 years. Adult dependants (over 18 years old) are also subject to this requirement. Guidance can be found here Criminal records checks for overseas applicants (Opens in a new tab).