Job summary
The post holder will lead the Trust on a smooth transition of the onsite data warehouse solutions into a more efficient, scalable and secure cloud infrastructure, whilst managing a team of Data Engineers and developers. The Data Engineering Manager plays a pivotal role in ensuring that data flows smoothly, remains consistent, and is available for decision-making, insights and analytics. The post holder will also be responsible for maintaining the current data warehouse solutions by ensuring operational efficiency, routine maintenance, issue resolution, monitoring and reporting
Main duties of the job
Lead and mentor the trust data engineering team and act as an architectural and strategic lead in the development and maintenance of data warehouse and associated solutions and systems.
Deliver the trust's future data landscape by designing scalable and reliable data platforms on cloud infrastructure, ensuring data integrity and supporting continuous delivery of data solutions.
Lead the design, development, and implementation of scalable and efficient data pipelines and workflows using Azure Data Factory and other ETL tools.
Build and manage data lakes, warehouse and databases on Azure including Synapse Analytics, Azure Data Lake and Azure SQL Database and develop our future data processing solutions in Microsoft Fabric.
Take ownership of the data engineering function, including advisory, implementation, and review phases, with interactions ranging from technical teams to senior leadership.
Act as an internal technical leader and innovator, contributing to the development of advanced and tailored technical solutions for the trust while championing engineering excellence.
Collaborate with senior management, analysts and other stakeholders to understand requirements and translate them into effective solutions.
Provide technical support for the existing set of database applications.
Lead in design, development and implementation of new information feeds, ETL processes and data marts.
About us
St George's, Epsom and St Helier University Hospitals and Health Group cares for a population of four million people in South West London and North East Surrey.Our sites include St George's Hospital, one of 11 major trauma centres in the UK and the largest healthcare provider and major teaching hospital in the area; St Helier Hospital, home to the South West Thames Renal and Transplantation Unit and Queen Mary's Hospital for Children; and Epsom Hospital, home to the South West London Elective Orthopaedic Centre (SWLEOC).
After years of collaboration, our two Trusts became a hospitals group in 2021. While remaining as two separate Trusts, being a hospitals group will help us to collaborate more closely on research, and the development, education, and training of our 17,000-strong workforce.
Job description
Job responsibilities
1. Lead and mentor the trust data engineering team and act as an architectural and strategic lead in the development and maintenance of data warehouse and associated solutions and systems.
2. Deliver the trusts future data landscape by designing scalable and reliable data platforms on cloud infrastructure, ensuring data integrity and supporting continuous delivery of data solutions.
3. Lead the design, development, and implementation of scalable and efficient data pipelines and workflows using Azure Data Factory and other ETL tools.
4. Build and manage data lakes, warehouse and databases on Azure including Synapse Analytics, Azure Data Lake and Azure SQL Database and develop our future data processing solutions in Microsoft Fabric.
5. Take ownership of the data engineering function, including advisory, implementation, and review phases, with interactions ranging from technical teams to senior leadership.
6. Act as an internal technical leader and innovator, contributing to the development of advanced and tailored technical solutions for the trust while championing engineering excellence.
7. Collaborate with senior management, analysts and other stakeholders to understand requirements and translate them into effective solutions.
8. Provide technical support for the existing set of database applications.
9. Lead in design, development and implementation of new information feeds, ETL processes and data marts.
10. Proactively review new and emerging technologies and their potential benefit to the Trust, fostering a culture of innovation and continuous improvement.
11. Develop solutions and provide management for the implementation of NHS Information Standards, mapping data standards and implementation of common data models.
12. Maintain robust data modelling practices, collaborate with other senior team members for best practices.
13. Ensure compliance with NHS Information Standard Notices (ISNs) and data standards.
14. Develop algorithms to transform data into usable models and ensure data quality and integrity
15. Manage and support the current data warehousing infrastructure to support the reporting needs of the Trust by managing various extraction, transformation, and load (ETL) processes.
16. Provide advanced technical knowledge and skills to support the information needs of the Trust.
17. Ensure accuracy and timeliness of data and adhere to security and Information Governance policies and procedures.
18. Manage and support recruitment into your team and give support outside of your teams if required.
19. Manage your teams development through accurate PDRs, regular 1:1s and offering pastoral support.
20. To diagnose complex problems, situations and/or information and make informed judgements to formulate solutions and recommend/decide on best course of action.
21. Ensure all technical processes, current and future are documented.
Job description
Job responsibilities
1. Lead and mentor the trust data engineering team and act as an architectural and strategic lead in the development and maintenance of data warehouse and associated solutions and systems.
2. Deliver the trusts future data landscape by designing scalable and reliable data platforms on cloud infrastructure, ensuring data integrity and supporting continuous delivery of data solutions.
3. Lead the design, development, and implementation of scalable and efficient data pipelines and workflows using Azure Data Factory and other ETL tools.
4. Build and manage data lakes, warehouse and databases on Azure including Synapse Analytics, Azure Data Lake and Azure SQL Database and develop our future data processing solutions in Microsoft Fabric.
5. Take ownership of the data engineering function, including advisory, implementation, and review phases, with interactions ranging from technical teams to senior leadership.
6. Act as an internal technical leader and innovator, contributing to the development of advanced and tailored technical solutions for the trust while championing engineering excellence.
7. Collaborate with senior management, analysts and other stakeholders to understand requirements and translate them into effective solutions.
8. Provide technical support for the existing set of database applications.
9. Lead in design, development and implementation of new information feeds, ETL processes and data marts.
10. Proactively review new and emerging technologies and their potential benefit to the Trust, fostering a culture of innovation and continuous improvement.
11. Develop solutions and provide management for the implementation of NHS Information Standards, mapping data standards and implementation of common data models.
12. Maintain robust data modelling practices, collaborate with other senior team members for best practices.
13. Ensure compliance with NHS Information Standard Notices (ISNs) and data standards.
14. Develop algorithms to transform data into usable models and ensure data quality and integrity
15. Manage and support the current data warehousing infrastructure to support the reporting needs of the Trust by managing various extraction, transformation, and load (ETL) processes.
16. Provide advanced technical knowledge and skills to support the information needs of the Trust.
17. Ensure accuracy and timeliness of data and adhere to security and Information Governance policies and procedures.
18. Manage and support recruitment into your team and give support outside of your teams if required.
19. Manage your teams development through accurate PDRs, regular 1:1s and offering pastoral support.
20. To diagnose complex problems, situations and/or information and make informed judgements to formulate solutions and recommend/decide on best course of action.
21. Ensure all technical processes, current and future are documented.
Person Specification
Knowledge
Essential
- In depth knowledge of data warehouse and underlying technologies
- Knowledge of data modelling and big data tools
- Solid understanding of latest developments in data warehouse technology, reporting solutions and data feed technology
Desirable
- NHS data sets
- SUS Reporting and CAM Rules
- NHS national returns
Skills
Essential
- MS SQL Server tools
- Advanced SQL Skills
- MS Azure Technologies
- Data Warehousing Methodologies and approaches
- Data Processing and Transformations using automation
- Team Management Skills
- Analytical and problem-solving abilities
- Ability to diagnose complex problems, situations and or information and make informed judgement to formulate solutions
Desirable
- Microsoft Fabric
- DevOps or any Project Management methodologies
- BI Tools (Tableau, PowerBI etc.)
- Proficiency in scripting languages such as PowerShell or Python for automation.
- Artificial intelligence techniques (e.g., Machine learning)
Qualifications
Essential
- Degree level education in a numerate subject plus at least significant post-degree experience
Desirable
- Masters in a computer based or numerate subject.
- Certifications such as Azure Developer Associate or Azure Solutions Architect.
Experience
Essential
- Extensive experience in Data Engineering
- Experience of developing and maintaining data warehouse solutions using MS SQL toolset
- Experience in setting up large-scale processing systems or data infrastructure on a cloud platform
- NHS/Health Information Management experience
- Experience of developing and implementing large and complex information management and reporting systems
- Experience of monitoring, identifying and escalating data quality issues
Desirable
- Experience with Cerner Application and its data model
- Data Warehousing experience in an NHS setting
Person Specification
Knowledge
Essential
- In depth knowledge of data warehouse and underlying technologies
- Knowledge of data modelling and big data tools
- Solid understanding of latest developments in data warehouse technology, reporting solutions and data feed technology
Desirable
- NHS data sets
- SUS Reporting and CAM Rules
- NHS national returns
Skills
Essential
- MS SQL Server tools
- Advanced SQL Skills
- MS Azure Technologies
- Data Warehousing Methodologies and approaches
- Data Processing and Transformations using automation
- Team Management Skills
- Analytical and problem-solving abilities
- Ability to diagnose complex problems, situations and or information and make informed judgement to formulate solutions
Desirable
- Microsoft Fabric
- DevOps or any Project Management methodologies
- BI Tools (Tableau, PowerBI etc.)
- Proficiency in scripting languages such as PowerShell or Python for automation.
- Artificial intelligence techniques (e.g., Machine learning)
Qualifications
Essential
- Degree level education in a numerate subject plus at least significant post-degree experience
Desirable
- Masters in a computer based or numerate subject.
- Certifications such as Azure Developer Associate or Azure Solutions Architect.
Experience
Essential
- Extensive experience in Data Engineering
- Experience of developing and maintaining data warehouse solutions using MS SQL toolset
- Experience in setting up large-scale processing systems or data infrastructure on a cloud platform
- NHS/Health Information Management experience
- Experience of developing and implementing large and complex information management and reporting systems
- Experience of monitoring, identifying and escalating data quality issues
Desirable
- Experience with Cerner Application and its data model
- Data Warehousing experience in an NHS setting
Disclosure and Barring Service Check
This post is subject to the Rehabilitation of Offenders Act (Exceptions Order) 1975 and as such it will be necessary for a submission for Disclosure to be made to the Disclosure and Barring Service (formerly known as CRB) to check for any previous criminal convictions.
Applications from job seekers who require current Skilled worker sponsorship to work in the UK are welcome and will be considered alongside all other applications. For further information visit the UK Visas and Immigration website (Opens in a new tab).
From 6 April 2017, skilled worker applicants, applying for entry clearance into the UK, have had to present a criminal record certificate from each country they have resided continuously or cumulatively for 12 months or more in the past 10 years. Adult dependants (over 18 years old) are also subject to this requirement. Guidance can be found here Criminal records checks for overseas applicants (Opens in a new tab).
Additional information
Disclosure and Barring Service Check
This post is subject to the Rehabilitation of Offenders Act (Exceptions Order) 1975 and as such it will be necessary for a submission for Disclosure to be made to the Disclosure and Barring Service (formerly known as CRB) to check for any previous criminal convictions.
Applications from job seekers who require current Skilled worker sponsorship to work in the UK are welcome and will be considered alongside all other applications. For further information visit the UK Visas and Immigration website (Opens in a new tab).
From 6 April 2017, skilled worker applicants, applying for entry clearance into the UK, have had to present a criminal record certificate from each country they have resided continuously or cumulatively for 12 months or more in the past 10 years. Adult dependants (over 18 years old) are also subject to this requirement. Guidance can be found here Criminal records checks for overseas applicants (Opens in a new tab).
