Lead Data Engineer

The Mid Yorkshire Teaching NHS Trust

Information:

This job is now closed

Job summary

The Office of Data & Analytics mission is to deliver insight through innovation in data and analytics services and its key function is to provide reporting and analytics to support patient care, quality, performance, financial flows and service development.

To underpin these objectives, the Data Engineering Teams purpose is to firstly build, develop and assure the Trusts Data Platform and secondly to use modern technologies, tools & techniques to leverage this asset for the organisation.

The Lead Data Engineer will contribute to the development and delivery of Data Warehousing, Reporting and Analytics output. They will enable data (from NHS data sets e.g. relating to acute activity) to be appropriately shared and disseminated within operational reports, published Management Information or Official Statistics.

Main duties of the job

The Lead Data Engineer will work closely with colleagues to develop robust processes for managing and automating regular outputs. The Lead Data Engineer must communicate plans and timescales to enable onward management of key stakeholders and should provide regular updates.

The Lead Data Engineer will feed into development priorities to understand potential efficiencies and savings in automated processes, to deploy and manage resources appropriately as the organisation progresses towards its strategic data solution.

The Lead Data Engineer will develop and implement new technologies to support robust and accurate data management and must ensure documentation (such as data dictionaries and data lineage information) is readily available across a range of stakeholders.

The Lead Data Engineer will grow Mid Yorkshire's data engineering capability and reporting mechanisms whilst ensuring data processes are efficient and reliable. This will include ensuring accuracy of data by implementing a robust quality assurance framework to guarantee decisions and actions are based upon reliable and accurate data.

About us

We provide care and support to over a million people in Wakefield and Kirklees in their homes, community settings and across our three hospital sites at Pontefract, Dewsbury and Pinderfields (Wakefield).

Always striving for excellence, we are at the forefront of innovation and research, and we invest in teaching and the development of our workforce.

We live by our values of caring, improving, being respectful and maintaining high standards. We listen and learn because we aim to make Mid Yorkshire the best place to work and receive care.

We value diversity and welcome talent and enthusiasm irrespective of age, disability, neurodivergence, sex, gender identity and gender expression, race or ethnicity, religion or belief, sexual orientation, or other personal circumstances including providing unpaid carers support to someone with a health and care need. As ethnic minority groups, members of the LGBTQ+ community, and people with a disability/neurodivergence are currently under-represented across the organisation, we encourage applications from members of these groups. We have policies and procedures to ensure all applicants are treated fairly and consistently.

We are proud of our staff networks - who offer valuable guidance and feedback from those with lived experience.

We have a clear vision and you could be part of this! If you share our values and you want to make a difference to the lives of our patients and their families and carers, we would love to hear from you.

Date posted

30 September 2024

Pay scheme

Agenda for change

Band

Band 8a

Salary

£53,755 to £60,504 a year

Contract

Permanent

Working pattern

Full-time, Flexible working

Reference number

C9377-CORP0417

Job locations

Dewsbury Hospital

Halifax Road

Dewsbury

West Yorkshire

WF13 4HS


Job description

Job responsibilities

  • Lead on the delivery of physical data models and views required for data exploiters to enable visualisation of metrics and the provision of insightful analysis for data projects.
  • Technical lead for departmental work area, and overall data management framework.
  • Embed improved ways of working with data across the wider team, including automation of manual tasks and data assurance.
  • Strong skills in analysing, defining, sourcing and capturing data across strategic business systems, processes and areas of an organisation
  • Strong experience of working with data and databases, ideally involving the development of new and existing data sources in a Data Warehouse environment.
  • Good understanding of Data Warehouse techniques, including dimensional data modelling and relational database design and concepts (e.g. Kimball).
  • Exceptional SQL experience and technical database expertise using relational databases such as Oracle Database & PL/SQL or Microsoft T-SQL.
  • Excellent knowledge and experience of R and Python programming
  • Experience of code reviews and ensuring coding standards are applied and met.
  • Experience of defining and documenting data workflows across systems and operations, including capturing and documenting complex data definitions and business rules.
  • Provide expert advice to the Directorate on matters of data platforms, data integration and visualisation tools.
  • Directly and through partners develop widely accessible data for analysis by data scientists & analysts in the organisation, customers and partners
  • Identify and lead on re-engineering manual data flows to enable scaling and repeatability.
  • Directly and through partners develop ETL layers and optimise them.
  • Knowledge of work management/collaboration tools such as MS Teams, Trello and Miro etc.

Job description

Job responsibilities

  • Lead on the delivery of physical data models and views required for data exploiters to enable visualisation of metrics and the provision of insightful analysis for data projects.
  • Technical lead for departmental work area, and overall data management framework.
  • Embed improved ways of working with data across the wider team, including automation of manual tasks and data assurance.
  • Strong skills in analysing, defining, sourcing and capturing data across strategic business systems, processes and areas of an organisation
  • Strong experience of working with data and databases, ideally involving the development of new and existing data sources in a Data Warehouse environment.
  • Good understanding of Data Warehouse techniques, including dimensional data modelling and relational database design and concepts (e.g. Kimball).
  • Exceptional SQL experience and technical database expertise using relational databases such as Oracle Database & PL/SQL or Microsoft T-SQL.
  • Excellent knowledge and experience of R and Python programming
  • Experience of code reviews and ensuring coding standards are applied and met.
  • Experience of defining and documenting data workflows across systems and operations, including capturing and documenting complex data definitions and business rules.
  • Provide expert advice to the Directorate on matters of data platforms, data integration and visualisation tools.
  • Directly and through partners develop widely accessible data for analysis by data scientists & analysts in the organisation, customers and partners
  • Identify and lead on re-engineering manual data flows to enable scaling and repeatability.
  • Directly and through partners develop ETL layers and optimise them.
  • Knowledge of work management/collaboration tools such as MS Teams, Trello and Miro etc.

Person Specification

Skills, Abilities & Personal Attributes

Essential

  • Excellent analytical, IT Keyboard and numerical skills - confident with statistics and their presentation.
  • Excellent verbal and written communication (including presentation) skills.
  • Ability to analyse highly complex issues where material is conflicting and drawn from multiple sources (verbal, written and numerical).
  • Significant ability to analyse numerical and written data, assess options and draw appropriate initiatives.
  • Demonstrable ability to plan over short, medium and long-term timeframes and adjust plans and resource requirements accordingly.
  • Demonstrable ability to work effectively between competing activities where required.
  • Demonstrable ability to manage own workload and make informed decisions in the absence of required information, working to tight and often changing.
  • Adheres to the Trust values and behaviours.
  • Is a role model for openness and inclusion.
  • Able to make a connection between their work and the benefit to patients and the public.
  • Demonstrate the ability to work under pressure.
  • Works well with others, is positive and helpful, listens, involves, respects and learns from the contribution of others.
  • Ability and commitment to work constructively with internal and external partners to create the conditions for successful collaborations.
  • High level of Organisation, self- motivation and flexibility in approach and attitude.
  • Strong sense of commitment to openness, honesty and integrity.
  • A strong sense of accountability.
  • Consistently looks to improve what they do.
  • Values diversity and difference operates with integrity and openness.
  • Self-awareness in terms of emotional intelligence, biases and personal triggers with cultural sensitivity and awareness.

Qualifications

Essential

  • Educated to Masters level or equivalent level or equivalent experience of working at a senior level in specialist area plus Postgraduate management diploma qualification.

Desirable

  • Knowledge of NHS, Government and strategies policies and plans.

Experience

Essential

  • Experience of exporting data from various source data systems, transforming data against required business rules and data models, or data storage and analysis requirements, and loading data in various storage platforms.
  • Excellent communication and collaboration skills to determine data requirements.
  • Experience of implementing digital/information/data change programmes.
  • Experience of developing delivery plans, establishing work priorities, delegating effectively, ensuring a capability to deliver, monitoring performance and giving feedback.
  • Good understanding of Data Warehouse techniques, including dimensional data modelling and relational database design and concepts (e.g. Kimball).
  • Exceptional SQL experience and technical database expertise using relational databases such as Oracle Database & PL/SQL or Microsoft T-SQL.
  • Able to develop partnerships across Organisations and drive collaboration between people to achieve desired outcomes.

Desirable

  • Experience of writing parameterised code in either a programming or scripting language such as SQL/PL-SQL and/or Python/Spark.
  • Experienced in delivering metadata driven development processes.
  • Experience of building pipelines in cloud technologies such as Azure Data Factory/Databricks.
  • Experience of using CI/CD techniques and processes DevOps/Git repository code promotion and change management experience.
Person Specification

Skills, Abilities & Personal Attributes

Essential

  • Excellent analytical, IT Keyboard and numerical skills - confident with statistics and their presentation.
  • Excellent verbal and written communication (including presentation) skills.
  • Ability to analyse highly complex issues where material is conflicting and drawn from multiple sources (verbal, written and numerical).
  • Significant ability to analyse numerical and written data, assess options and draw appropriate initiatives.
  • Demonstrable ability to plan over short, medium and long-term timeframes and adjust plans and resource requirements accordingly.
  • Demonstrable ability to work effectively between competing activities where required.
  • Demonstrable ability to manage own workload and make informed decisions in the absence of required information, working to tight and often changing.
  • Adheres to the Trust values and behaviours.
  • Is a role model for openness and inclusion.
  • Able to make a connection between their work and the benefit to patients and the public.
  • Demonstrate the ability to work under pressure.
  • Works well with others, is positive and helpful, listens, involves, respects and learns from the contribution of others.
  • Ability and commitment to work constructively with internal and external partners to create the conditions for successful collaborations.
  • High level of Organisation, self- motivation and flexibility in approach and attitude.
  • Strong sense of commitment to openness, honesty and integrity.
  • A strong sense of accountability.
  • Consistently looks to improve what they do.
  • Values diversity and difference operates with integrity and openness.
  • Self-awareness in terms of emotional intelligence, biases and personal triggers with cultural sensitivity and awareness.

Qualifications

Essential

  • Educated to Masters level or equivalent level or equivalent experience of working at a senior level in specialist area plus Postgraduate management diploma qualification.

Desirable

  • Knowledge of NHS, Government and strategies policies and plans.

Experience

Essential

  • Experience of exporting data from various source data systems, transforming data against required business rules and data models, or data storage and analysis requirements, and loading data in various storage platforms.
  • Excellent communication and collaboration skills to determine data requirements.
  • Experience of implementing digital/information/data change programmes.
  • Experience of developing delivery plans, establishing work priorities, delegating effectively, ensuring a capability to deliver, monitoring performance and giving feedback.
  • Good understanding of Data Warehouse techniques, including dimensional data modelling and relational database design and concepts (e.g. Kimball).
  • Exceptional SQL experience and technical database expertise using relational databases such as Oracle Database & PL/SQL or Microsoft T-SQL.
  • Able to develop partnerships across Organisations and drive collaboration between people to achieve desired outcomes.

Desirable

  • Experience of writing parameterised code in either a programming or scripting language such as SQL/PL-SQL and/or Python/Spark.
  • Experienced in delivering metadata driven development processes.
  • Experience of building pipelines in cloud technologies such as Azure Data Factory/Databricks.
  • Experience of using CI/CD techniques and processes DevOps/Git repository code promotion and change management experience.

Certificate of Sponsorship

Applications from job seekers who require current Skilled worker sponsorship to work in the UK are welcome and will be considered alongside all other applications. For further information visit the UK Visas and Immigration website (Opens in a new tab).

From 6 April 2017, skilled worker applicants, applying for entry clearance into the UK, have had to present a criminal record certificate from each country they have resided continuously or cumulatively for 12 months or more in the past 10 years. Adult dependants (over 18 years old) are also subject to this requirement. Guidance can be found here Criminal records checks for overseas applicants (Opens in a new tab).

Additional information

Certificate of Sponsorship

Applications from job seekers who require current Skilled worker sponsorship to work in the UK are welcome and will be considered alongside all other applications. For further information visit the UK Visas and Immigration website (Opens in a new tab).

From 6 April 2017, skilled worker applicants, applying for entry clearance into the UK, have had to present a criminal record certificate from each country they have resided continuously or cumulatively for 12 months or more in the past 10 years. Adult dependants (over 18 years old) are also subject to this requirement. Guidance can be found here Criminal records checks for overseas applicants (Opens in a new tab).

Employer details

Employer name

The Mid Yorkshire Teaching NHS Trust

Address

Dewsbury Hospital

Halifax Road

Dewsbury

West Yorkshire

WF13 4HS


Employer's website

https://www.midyorks.nhs.uk/ (Opens in a new tab)


Employer details

Employer name

The Mid Yorkshire Teaching NHS Trust

Address

Dewsbury Hospital

Halifax Road

Dewsbury

West Yorkshire

WF13 4HS


Employer's website

https://www.midyorks.nhs.uk/ (Opens in a new tab)


For questions about the job, contact:

Head of Data & AI

Jonathan Gee

jonathan.gee@nhs.net

Date posted

30 September 2024

Pay scheme

Agenda for change

Band

Band 8a

Salary

£53,755 to £60,504 a year

Contract

Permanent

Working pattern

Full-time, Flexible working

Reference number

C9377-CORP0417

Job locations

Dewsbury Hospital

Halifax Road

Dewsbury

West Yorkshire

WF13 4HS


Supporting documents

Privacy notice

The Mid Yorkshire Teaching NHS Trust's privacy notice (opens in a new tab)