Job summary
Data Engineer
Data, Knowledge and Research Directorate - Public Health Wales.
Band: 8a x 1 post - Full time, Permanent
Close: 07/01/2024
Interview: The interview will take place virtually. W/C 15/01/2024
Do you have a passion for using your data skills for public good? Are you excited about innovation, and the opportunity to explore tools, techniques, and data sources to solve interesting challenges with data? Do you thrive in a multi-disciplinary, collaborative environment? Are you curious about the world, and looking for ways to improve it using data? If so, this may be the job for you!
We are looking for a skilled and enthusiastic data engineer to join our Public Health Data Team. If you'd like to discuss the role further please contact Fliss Bennee, Head of Data, fliss.bennee@wales.nhs.uk .
Main duties of the job
You'll apply your data wrangling and problem-solving skills to exploit novel and traditional data sources and support PHW in its mission: To protect and improve health and well-being and reduce health inequalities for the people of Wales.
Working in multi-disciplinary, cross-organisational Agile teams, you'll work alongside data scientists, researchers and public heath consultants to scope, design and deliver data-driven solutions to some of Public Health's wickedest problems. You'll be adept at working with users to understand their needs and interpret these to deliver data products with impact.
In addition to strong Python skills, you'll have experience in at least one, but probably not all of: manipulation of complex, high volume, high dimensionality data; relational and non-relational databases; SQL / NoSQL databases; cloud storage and data management (Azure/GCP/AWS); data linkage; experience with unstructured data; defining and implementing data and document workflows and pipelines; automating simple cleaning and anonymisation/pseudonymisation. You may also have some experience of data analysis, including natural language processing, supervised and unsupervised machine learning, building dashboards and visualisations, building reproducible analytical pipelines.
You'll write and publish high-quality code, following good practice. You'll have good verbal and written communication skills and be able to tailor reports and analyses to your audience.
About us
Public Health Wales is the National Public Health Institute in Wales. Our vision is 'Working to achieve a healthier future for Wales' where we play a pivotal role in driving improvements in population health and well-being, reducing health inequalities, improving healthcare outcomes, protecting the public and supporting the development of health in all policies across Wales.Our organisation is guided by our Values, 'Working together, with trust and respect, to make a difference'. We are committed to creating an inclusive workplace that values equality, diversity and inclusion. We welcome applications which represent the rich diversity of the communities we serve and from those wishing to work part time or on a job share basis.To find out more about working for us, the benefits we offer and guidance on the application process, please visithttps://phw.nhs.wales/working-for-us/applicant-information-and-guidance/
Job description
Job responsibilities
You will lead on the delivery of physical data models and views required for data exploiters to enable visualisation of metrics and the provision of insightful analysis for data science projects.
You will be the technical lead for departmental work area and overall data management framework.
You will embed improved ways of working with data across the team and organisation, including automation of manual tasks and data assurance.
You will utilise your strong experience of working with data and databases, including the development of new and existing data sources in a Data Warehouse environment. Your understanding of Data Warehouse techniques, including dimensional data modelling and relational database design and concepts (e.g., Kimball), will be used extensively.
You will regularly demonstrate your expertise in SQL and relational databases such as Oracle Database & PL/SQL or Microsoft T-SQL.
You will utilise your knowledge and experience of R and Python programming and undertake code reviews and ensuring coding standards are applied and met.
You will define and document data workflows across systems and operations, including capturing and documenting complex data definitions and business rules.
You will collaborate directly and through partners to develop data systems, lead on developments as maybe required.
You will provide expert advice to the directorate and organisation on matters of data platforms, data integration and visualisation tools.
You will use your extensive connection skills to communicate to and between technical and non-technical stakeholders, and facilitate discussions within a multidisciplinary team, including data scientist/analysts.
You will help to develop and implement a successful Data Strategy for the organisation.
You will drive your own performance to ensure delivery against key projects and objectives.
Duties/Responsibilities
- Lead on the delivery of physical data models and views required for data exploiters to enable visualisation of metrics and the provision of insightful analysis for data science projects.
- Technical lead for departmental work area, and overall data management framework.
- Embed improved ways of working with data across the wider team, including automation of manual tasks and data assurance.
- Strong skills in analysing, defining, sourcing and capturing data across strategic business systems, processes and areas of an organisation
- Strong experience of working with data and databases, ideally involving the development of new and existing data sources in a Data Warehouse environment.
- Good understanding of Data Warehouse techniques, including dimensional data modelling and relational database design and concepts (e.g. Kimball).
- Exceptional SQL experience and technical database expertise using relational databases such as Oracle Database & PL/SQL or Microsoft T-SQL.
- Excellent knowledge and experience of R and Python programming
- Experience of code reviews and ensuring coding standards are applied and met.
- Experience of defining and documenting data workflows across systems and operations, including capturing and documenting complex data definitions and business rules.
- Provide expert advice to the Directorate on matters of data platforms, data integration and visualisation tools.
- Directly and through partners develop widely accessible data for analysis by data scientists & analysts in the organisation, customers and partners
- Identify and lead on re-engineering manual data flows to enable scaling and repeatability.
- Directly and through partners develop ETL layers and optimise them.
- Knowledge of work management/collaboration tools such as MS Teams, Trello and Miro etc.
You will be able to find a full Job description and Person Specification attached within the supporting documents or please click Apply now to view in Trac.
The ability to speak Welsh is desirable for this post; English and/or Welsh speakers are equally welcome to apply.
Job description
Job responsibilities
You will lead on the delivery of physical data models and views required for data exploiters to enable visualisation of metrics and the provision of insightful analysis for data science projects.
You will be the technical lead for departmental work area and overall data management framework.
You will embed improved ways of working with data across the team and organisation, including automation of manual tasks and data assurance.
You will utilise your strong experience of working with data and databases, including the development of new and existing data sources in a Data Warehouse environment. Your understanding of Data Warehouse techniques, including dimensional data modelling and relational database design and concepts (e.g., Kimball), will be used extensively.
You will regularly demonstrate your expertise in SQL and relational databases such as Oracle Database & PL/SQL or Microsoft T-SQL.
You will utilise your knowledge and experience of R and Python programming and undertake code reviews and ensuring coding standards are applied and met.
You will define and document data workflows across systems and operations, including capturing and documenting complex data definitions and business rules.
You will collaborate directly and through partners to develop data systems, lead on developments as maybe required.
You will provide expert advice to the directorate and organisation on matters of data platforms, data integration and visualisation tools.
You will use your extensive connection skills to communicate to and between technical and non-technical stakeholders, and facilitate discussions within a multidisciplinary team, including data scientist/analysts.
You will help to develop and implement a successful Data Strategy for the organisation.
You will drive your own performance to ensure delivery against key projects and objectives.
Duties/Responsibilities
- Lead on the delivery of physical data models and views required for data exploiters to enable visualisation of metrics and the provision of insightful analysis for data science projects.
- Technical lead for departmental work area, and overall data management framework.
- Embed improved ways of working with data across the wider team, including automation of manual tasks and data assurance.
- Strong skills in analysing, defining, sourcing and capturing data across strategic business systems, processes and areas of an organisation
- Strong experience of working with data and databases, ideally involving the development of new and existing data sources in a Data Warehouse environment.
- Good understanding of Data Warehouse techniques, including dimensional data modelling and relational database design and concepts (e.g. Kimball).
- Exceptional SQL experience and technical database expertise using relational databases such as Oracle Database & PL/SQL or Microsoft T-SQL.
- Excellent knowledge and experience of R and Python programming
- Experience of code reviews and ensuring coding standards are applied and met.
- Experience of defining and documenting data workflows across systems and operations, including capturing and documenting complex data definitions and business rules.
- Provide expert advice to the Directorate on matters of data platforms, data integration and visualisation tools.
- Directly and through partners develop widely accessible data for analysis by data scientists & analysts in the organisation, customers and partners
- Identify and lead on re-engineering manual data flows to enable scaling and repeatability.
- Directly and through partners develop ETL layers and optimise them.
- Knowledge of work management/collaboration tools such as MS Teams, Trello and Miro etc.
You will be able to find a full Job description and Person Specification attached within the supporting documents or please click Apply now to view in Trac.
The ability to speak Welsh is desirable for this post; English and/or Welsh speakers are equally welcome to apply.
Person Specification
QUALIFICATIONS & KNOWLEDGE
Essential
- Educated to Masters level or equivalent level or equivalent experience of working at a senior level in specialist area, plus Postgraduate management diploma qualification.
- Extensive working knowledge and experience with ETL and data integration.
- Evidence of continued professional development.
- Knowledge and expertise of IT architecture and infrastructure.
- Knowledge and expertise of health intelligence (including systems and application).
- Current knowledge of the public sector/NHS.
- Knowledge of work management/collaboration tools such as MS Teams, Trello and Miro etc.
Desirable
- Knowledge of NHS, Welsh Government and strategies, policies and plans
Experience
Essential
- Experience of exporting data from various source data systems, transforming data against required business rules and data models, or data storage and analysis requirements, and loading data in various storage platforms.
- Excellent communication and collaboration skills to determine data requirements.
- Experience of implementing digital/information/data change programmes.
- Experience of developing delivery plans, establishing work priorities, delegating effectively, ensuring a capability to deliver, monitoring performance and giving feedback
- Good understanding of Data Warehouse techniques, including dimensional data modelling and relational database design and concepts (e.g. Kimball). Exceptional SQL experience and technical database expertise using relational databases such as Oracle Database & PL/SQL or Microsoft T-SQL. Able to develop partnerships across Organisations and drive collaboration between people to achieve desired outcomes.
- Exceptional SQL experience and technical database expertise using relational databases such as Oracle Database & PL/SQL or Microsoft T-SQL.
- Able to develop partnerships across Organisations and drive collaboration between people to achieve desired outcomes.
Desirable
- Experience of writing parameterised code in either a programming or scripting language such as SQL/PL-SQL and/or Python/Spark.
- Experienced in delivering metadata driven development processes.
- Experience of building pipelines in cloud technologies such as Azure Data Factory/Databricks.
- Experience of using CI/CD techniques and processes DevOps/Git repository code promotion and change management experience.
Aptitude & Abilities (SKILLS)
Essential
- Excellent analytical, IT Keyboard and numerical skills - confident with statistics and their presentation.
- Excellent verbal and written communication (including presentation) skills.
- Ability to analyse highly complex issues where material is conflicting and drawn from multiple sources (verbal, written and numerical).
- Significant ability to analyse numerical and written data, assess options and draw appropriate initiatives
- Demonstrable ability to plan over short, medium and long-term timeframes and adjust plans and resource requirements accordingly
- Demonstrable ability to work effectively between competing activities where required.
- Demonstrable ability to manage own workload and make informed decisions in the absence of required information, working to tight and often changing timescales.
- Excellent inter- personal skills and ability to build and maintain successful working relationships.
- Time management skills and reliability in consistently delivering against deadlines.
Desirable
- Ability to speak Welsh or willingness to learn
PERSONAL ATTRIBUTES & VALUES
Essential
- Able to make a connection between their work and the benefit to patients and the public.
- Demonstrate the ability to work under pressure.
- Works well with others, is positive and helpful, listens, involves, respects and learns from the contribution of others.
- Ability and commitment to work constructively with internal and external partners to create the conditions for successful collaborations.
- High level of Organisation, self- motivation and flexibility in approach and attitude.
- Strong sense of commitment to openness, honesty and integrity. .
- A strong sense of accountability.
- Consistently looks to improve what they do.
- Values diversity and difference operates with integrity and openness
- Self-awareness in terms of emotional intelligence, biases and personal triggers with cultural sensitivity and awareness
Desirable
- Continued Personal Development
Other
Essential
- Willingness and ability to travel between sites.
Person Specification
QUALIFICATIONS & KNOWLEDGE
Essential
- Educated to Masters level or equivalent level or equivalent experience of working at a senior level in specialist area, plus Postgraduate management diploma qualification.
- Extensive working knowledge and experience with ETL and data integration.
- Evidence of continued professional development.
- Knowledge and expertise of IT architecture and infrastructure.
- Knowledge and expertise of health intelligence (including systems and application).
- Current knowledge of the public sector/NHS.
- Knowledge of work management/collaboration tools such as MS Teams, Trello and Miro etc.
Desirable
- Knowledge of NHS, Welsh Government and strategies, policies and plans
Experience
Essential
- Experience of exporting data from various source data systems, transforming data against required business rules and data models, or data storage and analysis requirements, and loading data in various storage platforms.
- Excellent communication and collaboration skills to determine data requirements.
- Experience of implementing digital/information/data change programmes.
- Experience of developing delivery plans, establishing work priorities, delegating effectively, ensuring a capability to deliver, monitoring performance and giving feedback
- Good understanding of Data Warehouse techniques, including dimensional data modelling and relational database design and concepts (e.g. Kimball). Exceptional SQL experience and technical database expertise using relational databases such as Oracle Database & PL/SQL or Microsoft T-SQL. Able to develop partnerships across Organisations and drive collaboration between people to achieve desired outcomes.
- Exceptional SQL experience and technical database expertise using relational databases such as Oracle Database & PL/SQL or Microsoft T-SQL.
- Able to develop partnerships across Organisations and drive collaboration between people to achieve desired outcomes.
Desirable
- Experience of writing parameterised code in either a programming or scripting language such as SQL/PL-SQL and/or Python/Spark.
- Experienced in delivering metadata driven development processes.
- Experience of building pipelines in cloud technologies such as Azure Data Factory/Databricks.
- Experience of using CI/CD techniques and processes DevOps/Git repository code promotion and change management experience.
Aptitude & Abilities (SKILLS)
Essential
- Excellent analytical, IT Keyboard and numerical skills - confident with statistics and their presentation.
- Excellent verbal and written communication (including presentation) skills.
- Ability to analyse highly complex issues where material is conflicting and drawn from multiple sources (verbal, written and numerical).
- Significant ability to analyse numerical and written data, assess options and draw appropriate initiatives
- Demonstrable ability to plan over short, medium and long-term timeframes and adjust plans and resource requirements accordingly
- Demonstrable ability to work effectively between competing activities where required.
- Demonstrable ability to manage own workload and make informed decisions in the absence of required information, working to tight and often changing timescales.
- Excellent inter- personal skills and ability to build and maintain successful working relationships.
- Time management skills and reliability in consistently delivering against deadlines.
Desirable
- Ability to speak Welsh or willingness to learn
PERSONAL ATTRIBUTES & VALUES
Essential
- Able to make a connection between their work and the benefit to patients and the public.
- Demonstrate the ability to work under pressure.
- Works well with others, is positive and helpful, listens, involves, respects and learns from the contribution of others.
- Ability and commitment to work constructively with internal and external partners to create the conditions for successful collaborations.
- High level of Organisation, self- motivation and flexibility in approach and attitude.
- Strong sense of commitment to openness, honesty and integrity. .
- A strong sense of accountability.
- Consistently looks to improve what they do.
- Values diversity and difference operates with integrity and openness
- Self-awareness in terms of emotional intelligence, biases and personal triggers with cultural sensitivity and awareness
Desirable
- Continued Personal Development
Other
Essential
- Willingness and ability to travel between sites.
Disclosure and Barring Service Check
This post is subject to the Rehabilitation of Offenders Act (Exceptions Order) 1975 and as such it will be necessary for a submission for Disclosure to be made to the Disclosure and Barring Service (formerly known as CRB) to check for any previous criminal convictions.
Applications from job seekers who require current Skilled worker sponsorship to work in the UK are welcome and will be considered alongside all other applications. For further information visit the UK Visas and Immigration website (Opens in a new tab).
From 6 April 2017, skilled worker applicants, applying for entry clearance into the UK, have had to present a criminal record certificate from each country they have resided continuously or cumulatively for 12 months or more in the past 10 years. Adult dependants (over 18 years old) are also subject to this requirement. Guidance can be found here Criminal records checks for overseas applicants (Opens in a new tab).
Additional information
Disclosure and Barring Service Check
This post is subject to the Rehabilitation of Offenders Act (Exceptions Order) 1975 and as such it will be necessary for a submission for Disclosure to be made to the Disclosure and Barring Service (formerly known as CRB) to check for any previous criminal convictions.
Applications from job seekers who require current Skilled worker sponsorship to work in the UK are welcome and will be considered alongside all other applications. For further information visit the UK Visas and Immigration website (Opens in a new tab).
From 6 April 2017, skilled worker applicants, applying for entry clearance into the UK, have had to present a criminal record certificate from each country they have resided continuously or cumulatively for 12 months or more in the past 10 years. Adult dependants (over 18 years old) are also subject to this requirement. Guidance can be found here Criminal records checks for overseas applicants (Opens in a new tab).
