Job summary
The Lead Clinical Data Analytics Engineer is a crucial role within the London SDE programme. You will be responsible for leading the development of data and analytics pipelines across some of the most complete primary and secondary care data in the NHS, including using technologies such as language AI for curating unstructured data. You will be responsible for independently implementing analytics (including predictive analytics using machine learning) that will inform population health and clinical decision-making, as well as extending data pipelines to measure real-world impacts on outcomes and health equity.
As a senior technical lead, you will report to the Head of Data Science for the programme, and you will co-design the technical roadmap and deliverables. Our mode of working is focused on product design and delivery (rather than providing an on-demand/ticketed service to stakeholders). You will be responsible for supervising, coordinating, and upskilling more junior technical staff across multiple NHS organisations, including Integrated Care Boards. You will help to produce compelling reports, visualisations, and academic publications, that will have national and international reach.
The candidate should either have a background as a clinician or health informatician, or substantial experience of analysing and interpreting structured healthcare data, to enable the delivery of impactful analytics with understanding of healthcare pathway implications.
Main duties of the job
The Lead Clinical Data Analytics Engineer is a senior technical role that will:
- Design and lead on technical objectives for the SDE programme.
- Lead development of ELT/ETL and cohort creation pipelines for primary and secondary care data across London.
- Work with a dedicated London AI Centre team to deploy language AI technologies for extracting and standardising unstructured clinical records.
- Provide expert technical support to the London Data Service for the standardisation of London data into the OMOP common data model.
- Lead collaborations with NHS teams from Integrated Care Boards and Hospital Trusts to produce pan-London data analytics and visualisations.
- Co-ordinate, support, and upskill local analysts in cross-London collaborations to ensure alignment on projects and timelines.
- Lead collaborations with NHS teams to develop and deploy machine learning models, in areas such as risk stratification, case-finding, anticipatory care, decision support, and forecasting.
- Build responsible technical solutions for creation of decision intelligence from both descriptive and predictive analytics, including systems for monitoring, and for impact evaluation.
- Produce striking and visual reports that will influence regional healthcare policy and guide population health programmes.
About us
The AI, Data & Digital Innovation team is made up of data science, technology and digital transformation experts, operating as part of the wider King Health partner's (KHP) group - based in GSTT but working closely as a team with KCH and KCL.
The team regularly contributes to externally funded programmes - including development and implementation of data platforms and AI technologies, aiming to achieve better outcomes for patients' diagnosis and treatment, improve clinical and operational workflows, and drive innovative healthcare research. This includes the London Artificial Intelligence Centre for Value-Based Healthcare (London AI Centre): a consortium of NHS, academic and industry partners led by Guy's & St Thomas', King's College London and KCH, in partnership with 10 NHS Trusts and 4 universities.
Job description
Job responsibilities
The Lead Clinical Data Analytics Engineer will be responsible for:
- Owning the building of SQL/Python pipelines (primarily in Snowflake and DBT) to extract data from different databases and raw sources, ending in generation of cohorts for analysis and machine learning.
- Designing and leading programmes related to standardisation of unstructured and structured data within the London SDE programme.
- Designing and leading observational analytics projects for regional and cross-London priorities.
- Designing and leading predictive analytics projects, that include robust training, validation, and testing of machine learning models for performance and fairness.
- Ensuring technical outputs of such projects meet deliverables of the SDE programme.
- Leading engagement with technical teams in NHS Integrated Care Boards and NHS Hospital Trusts, to build consensus on analytics and drive collaboration.
- Chairing meetings and technical workshops to update work packages across a complex multi-stakeholder and multi-institution environment across London.
- Supporting, supervising, and upskilling more junior team members, either within the SDE programme, or within other NHS analytics teams, through oversight of per-project technical work and outputs.
- Owning the design and development of data outputs, visualisations (both dashboards and static), and reports, that can consolidate complex work and analysis into compelling stories.
- Maintaining a central repository of reproducible code and machine learning models, based on a common data model shared across London regions.
- Leading and/or contributing to academic publications and talks.
Job description
Job responsibilities
The Lead Clinical Data Analytics Engineer will be responsible for:
- Owning the building of SQL/Python pipelines (primarily in Snowflake and DBT) to extract data from different databases and raw sources, ending in generation of cohorts for analysis and machine learning.
- Designing and leading programmes related to standardisation of unstructured and structured data within the London SDE programme.
- Designing and leading observational analytics projects for regional and cross-London priorities.
- Designing and leading predictive analytics projects, that include robust training, validation, and testing of machine learning models for performance and fairness.
- Ensuring technical outputs of such projects meet deliverables of the SDE programme.
- Leading engagement with technical teams in NHS Integrated Care Boards and NHS Hospital Trusts, to build consensus on analytics and drive collaboration.
- Chairing meetings and technical workshops to update work packages across a complex multi-stakeholder and multi-institution environment across London.
- Supporting, supervising, and upskilling more junior team members, either within the SDE programme, or within other NHS analytics teams, through oversight of per-project technical work and outputs.
- Owning the design and development of data outputs, visualisations (both dashboards and static), and reports, that can consolidate complex work and analysis into compelling stories.
- Maintaining a central repository of reproducible code and machine learning models, based on a common data model shared across London regions.
- Leading and/or contributing to academic publications and talks.
Person Specification
Qualifications / Education
Essential
- Degree qualification in health informatics / health data science / health AI, or medical degree with equivalent experience
Desirable
- Medical degree or clinical experience
Knowledge & experience
Essential
- Experience in technical roles in health data engineering and health data analytics
- Extensive technical understanding of NHS data, including from structured and multi-modal sources.
- Strong background in health informatics, including design of information solutions and data models
- Experience in data science and machine learning projects in the healthcare sector.
- Highly developed understanding of clinical care pathways and clinical pain-points. Able to communicate effectively with clinical teams.
- Experience of working in a product delivery setting, including ability to conduct end user-research, and set performance targets for evaluation.
- Strong track record of effective written and spoken communication, including in presentations, across all levels of seniority and technical ability.
- Experience working in large complex organisations, including in a health data or health technology environment.
- Proven track record and demonstrated ability of working collaboratively with a variety of organisational levels to deliver programme goals.
- Knowledge and understanding of risk management and mitigation strategies in technical projects.
- Knowledge of clinical and administrative IT systems and processes, as well as of administrative roles and processes within healthcare
Desirable
- Previous experience working in, or collaborating with, academia, in high impact and multi-institutional settings.
- Previous experience of working in, or collaborating with, commercial organisations, including in health-tech or life sciences.
- Previous experience or building or working with OMOP Common Data Model
Knowledge & experience Skills & Ability
Essential
- Proficiency in SQL
- Proficiency in Python
- Ability to work in secure research environments for NHS data
- Exceptional analytical, problem-solving, and judgement skills.
- Understanding of reproducible code and CI/CD practices
- Advanced understanding and application of data science and statistical techniques to healthcare data.
- Strong leadership skills, with ability to manage and develop a diverse team
- Ability to manage a technical team using project methodologies such as agile
- Ability to work under pressure and to specified deadlines
- Ability to manage people and lead a number of work streams within the team
- Ability to manage a technical product lifecycle, including through end-user feedback and testing
- Applies excellent communication skills, both written and verbal, including advanced formal presentation skills, to audiences that may be highly specialist professionals, or non-technical, or may be hostile.
- In line with above, is able to demonstrate the ability to communicate the most complex information, or sensitive / contentious information, clearly, confidently, and concisely.
- Credibility to get others on board with the proposed approach, to engage different staff groups so that they are motivated and clear on what they need to do, and to maintain confidence through delivery challenges
- Gathers and incorporates the views of service users and carers into service change, including in circumstances where such change is likely to be unpopular or challenged by senior scrutiny or regulatory bodies.
- Ability to make clear rational decisions, exercising independent judgement in a professional and competent manner.
- Works flexibly, prioritises workload and resources in response to changing demands and requirements.
- Ability to plan, organise and present workshops to NHS staff across different organisations
- Knowledge & awareness of diversity and human rights as appropriate to role
- Ability to plan and organise own workload without direct supervision but to seek guidance as appropriate
- Ability to assimilate new information quickly and adapt to a flexible and rapidly changing work environment
Desirable
- Experience in R
- Skills in advanced data visualisation, presentation, frontend tools
- Proficiency using DBT +/- Snowflake +/- Azure
Person Specification
Qualifications / Education
Essential
- Degree qualification in health informatics / health data science / health AI, or medical degree with equivalent experience
Desirable
- Medical degree or clinical experience
Knowledge & experience
Essential
- Experience in technical roles in health data engineering and health data analytics
- Extensive technical understanding of NHS data, including from structured and multi-modal sources.
- Strong background in health informatics, including design of information solutions and data models
- Experience in data science and machine learning projects in the healthcare sector.
- Highly developed understanding of clinical care pathways and clinical pain-points. Able to communicate effectively with clinical teams.
- Experience of working in a product delivery setting, including ability to conduct end user-research, and set performance targets for evaluation.
- Strong track record of effective written and spoken communication, including in presentations, across all levels of seniority and technical ability.
- Experience working in large complex organisations, including in a health data or health technology environment.
- Proven track record and demonstrated ability of working collaboratively with a variety of organisational levels to deliver programme goals.
- Knowledge and understanding of risk management and mitigation strategies in technical projects.
- Knowledge of clinical and administrative IT systems and processes, as well as of administrative roles and processes within healthcare
Desirable
- Previous experience working in, or collaborating with, academia, in high impact and multi-institutional settings.
- Previous experience of working in, or collaborating with, commercial organisations, including in health-tech or life sciences.
- Previous experience or building or working with OMOP Common Data Model
Knowledge & experience Skills & Ability
Essential
- Proficiency in SQL
- Proficiency in Python
- Ability to work in secure research environments for NHS data
- Exceptional analytical, problem-solving, and judgement skills.
- Understanding of reproducible code and CI/CD practices
- Advanced understanding and application of data science and statistical techniques to healthcare data.
- Strong leadership skills, with ability to manage and develop a diverse team
- Ability to manage a technical team using project methodologies such as agile
- Ability to work under pressure and to specified deadlines
- Ability to manage people and lead a number of work streams within the team
- Ability to manage a technical product lifecycle, including through end-user feedback and testing
- Applies excellent communication skills, both written and verbal, including advanced formal presentation skills, to audiences that may be highly specialist professionals, or non-technical, or may be hostile.
- In line with above, is able to demonstrate the ability to communicate the most complex information, or sensitive / contentious information, clearly, confidently, and concisely.
- Credibility to get others on board with the proposed approach, to engage different staff groups so that they are motivated and clear on what they need to do, and to maintain confidence through delivery challenges
- Gathers and incorporates the views of service users and carers into service change, including in circumstances where such change is likely to be unpopular or challenged by senior scrutiny or regulatory bodies.
- Ability to make clear rational decisions, exercising independent judgement in a professional and competent manner.
- Works flexibly, prioritises workload and resources in response to changing demands and requirements.
- Ability to plan, organise and present workshops to NHS staff across different organisations
- Knowledge & awareness of diversity and human rights as appropriate to role
- Ability to plan and organise own workload without direct supervision but to seek guidance as appropriate
- Ability to assimilate new information quickly and adapt to a flexible and rapidly changing work environment
Desirable
- Experience in R
- Skills in advanced data visualisation, presentation, frontend tools
- Proficiency using DBT +/- Snowflake +/- Azure
Disclosure and Barring Service Check
This post is subject to the Rehabilitation of Offenders Act (Exceptions Order) 1975 and as such it will be necessary for a submission for Disclosure to be made to the Disclosure and Barring Service (formerly known as CRB) to check for any previous criminal convictions.
Applications from job seekers who require current Skilled worker sponsorship to work in the UK are welcome and will be considered alongside all other applications. For further information visit the UK Visas and Immigration website (Opens in a new tab).
From 6 April 2017, skilled worker applicants, applying for entry clearance into the UK, have had to present a criminal record certificate from each country they have resided continuously or cumulatively for 12 months or more in the past 10 years. Adult dependants (over 18 years old) are also subject to this requirement. Guidance can be found here Criminal records checks for overseas applicants (Opens in a new tab).
Additional information
Applications from job seekers who require current Skilled worker sponsorship to work in the UK are welcome and will be considered alongside all other applications. For further information visit the UK Visas and Immigration website (Opens in a new tab).
From 6 April 2017, skilled worker applicants, applying for entry clearance into the UK, have had to present a criminal record certificate from each country they have resided continuously or cumulatively for 12 months or more in the past 10 years. Adult dependants (over 18 years old) are also subject to this requirement. Guidance can be found here Criminal records checks for overseas applicants (Opens in a new tab).
