Introducing Data and Measurement
Outcome Measure:
Are we achieving our aim?
How will we know we’re having an impact?
Process Measure(s):
Is the process working the way it needs to?
Are we making primary / secondary drivers happen?
Balancing Measure(s)
Are we having a knock-on impact anywhere else?
Are there any risks we need to monitor?
Listen to the sceptics and use their concerns to form measures.
Authors Note: Further reading/information can be found: making-data-count-getting-started-2019.pdf ¦ How to Improve: Model for Improvement: Establishing Measures | Institute for Healthcare Improvement
A Hub Metrics Table is a simple tool used to track and present key measures of activity, performance, or impact for a service hub. It helps teams monitor progress against agreed goals, identify trends, and guide service improvements over time.
Click image to download accessible version.
% Deprivation Decile Map from the Borough of Brent & Willesden from Children aged 0-4yrs
The Willesden neighbourhood consists of three geographical wards in Brent: Dollis Hill; Cricklewood & Mapesbury; Willesden Green.
This data only includes patients who are registered with a GP Practice in North West London (NWL).
Some patients who live in Brent or live in Willesden will be missing from the data because they are registered with a GP practice outside NWL, or because they are not registered with a GP practice at all.
Deprivation deciles are derived from the 2011 Index of Multiple Deprivation (IMD), based on the patient's Lower Level Super Output Area (LSOA) of residence.
LSOAs are small geographical areas which usually group together between 400 and 1,200 households, usually containing between 1,000 and 3,000 residents. The patient is assigned the average level of deprivation within their LSOA.
Deprivation deciles will not always be accurate. It is possible for an affluent person to live in a deprived area, and it is possible for a deprived person to live in an affluent area.
The governance of DPIAs is essential for ensuring the protection of individuals' personal data and complying with data protection regulations.
By implementing a standardised process, involving key stakeholders, and maintaining comprehensive documentation, we should be able to effectively assess and mitigate privacy risks associated with data processing activities.
This, in turn, enhances data protection, legal compliance, stakeholder confidence, and enables continuous improvement in privacy practice.
Why do you want to process personal data?
Is there any legitimate interest for processing?
What will the result of the processing be?
What will you achieve with the processing?
Identify what you want
What is the source of the data which you will process?
How does your relationship with data subjects look?
Identify the platform(s) for data
Who are the people with access to the data?
Who do you share the data with?
How is the data collected and stored?
What are the defined retention periods?
What security measure have you undertaken to protect the data?
How do you use the data?
Who? / How long? / Process / Security
Duration of the processing
Sensitivity of the personal data
Frequency and extent of the processing
The number of data subjects whose personal data are involved in the personal data
Frequency, Number of subjects and Time Period
Peer review is one way to evaluate work or change by one or more people involved in a service or system.
It is vital when making improvements to capture the impact of the change as an individual, team and service user. Peer reviews are a form of self-regulation by qualified members of a profession within the relevant service or field.
Peer review methods are used to maintain quality standards, improve performance, and provide credibility. Peer review can be categorised by the type of activity and by the field or profession in which the activity occurs, e.g., medical peer review. It can also be used as a tool to teach others, provide updates on how the change has positively or negatively impacted colleagues, patients and families. By which, then, helping to identify further improvements to modify the service or offer to meet the need.
An example of using peer reviews to offer insights into a children's health hub's impact and approach to supporting children and families when accessing healthcare:
Reviewed 9 peer reflections
4 London boroughs represented
Ward leadership trios identified
Regular weekly ward-level improvement measures
GPs
School nurses
Paediatricians
Health visitors
Nurses
AHPs
Social workers
Learning
Collaborative and immediate decisions marking
Efficiency of resources
Relationship building
Structured
Use of IT to share information
Confirmation of key next steps
Patient-centred using stories
Increase attendance
Increase the number of cases
Sharing of information post-meeting
Process review
Included discussions on the reasons cases were declined or redirected
Observations
Active engagement of everyone in the MDT
Collaborative decision making and learning
All attendees had a voice
Use of tech, i.e. photos and chat function in teams to ensure all involved & strengthening discussion
A variety of cases and people were prepared to present, and had helpful videos
Clear agenda
Well chaired - great leadership and focus
Spontaneous sharing of learning
Interesting questions to clarify clinical decision
Summary to confirm decisions before moving on to the next case
Good use of integration between services
Rationale for why cases have been referred to the hub
Shared learning on clinical conditions
Non-medical colleagues attending
Impact of changes and improvements made
Put everyone’s introductions in the chat to improve efficiency
Highlight anything outstanding or any changes from the previous MDT session
Earlier interventions and next steps confirmed
Patient-centred approach
More efficient use of resources
The importance of advocacy
Team coaching across attendees
Clarification on the referral process and criteria
Learning points shared post meeting to enable others not in attendance to have access to information
Changed the invitation to an open invite to encourage others to join and be curious
Suggestions and recommendations (areas for improvement)
Start discussing cases, and if time, at the end, do the team teach then
Include a reminder in the invite to the MDT that you should be prepared to present a case/have someone covering for you if you have booked one
Clinicians to submit patient details and reason for referral prior to MDT
More diversity of professional groups attending
Chase MDT that did not attend
Utilise the rationale for referral to increase the diversity of cases and provide guidance for colleagues
Discuss cases and investigations which have been declined/rejected to understand the reason and support learning
Discuss the aspiration of the number of cases being discussed from 3 to 8
Collecting and correlating patient/family experience feedback can shape services to better meet need. It can result in patients using services efficiently and being more able to use clinical advice (Doyle et al, 2013). Good patient experience is, therefore, seen as a central outcome for the NHS, but there are different ideas about what constitutes patient experience, and feedback is collected in different ways. Both patients/families and staff want feedback to be heard and acted on.
The different purposes of patient experience data direct the type of information collected, the way it is analysed and how it is subsequently utilised. Feedback can help assess service performance against expectations; for others, its primary purpose is to understand and respect individual experiences, while for others still, it is to improve services.
From an improvement lens, this can be to:
Improvement and redesign of services
Reflection on staff behaviours
Framing care as person-centred, rather than task or outcome-centred
Staff and patients involved in the co-design of services
2 month review and thematic analysis of parent feedback attending the child health hub
All parents were asked to respond to the following questions:
Do you prefer having this appointment at the GP surgery rather than the hospital
Has seeing a hospital paediatrician in the GP surgery changed the way you feel about your child's future care at the GP
How likely are you to recommend this service to family & friends
9 responses received
100% of families felt more comfortable seeing a paediatrician in a GP setting
100% expressed this approach would benefit the child’s care with the GP in the future
88% of parents would recommend the service to friends and family
Detailed explanation of the problem
I like that we don't have to go hospital
Very good
They talk about what will happen rather than what is normally said
More feedback than other appointments
This way of appointment is easiest
It was all good, we went through important stuff regarding his health
No concerns, it was perfect
Doctors showed interest in solving my situation
The whole experience was very comforting, as my daughter has a fear of hospitals
Triaging the referrals urgently (within 1-2 days of receipt)
Booking in patients usually within 1 month (ranges from 1-6 weeks).
Requested the admin team to nudge parents about the appointment, potentially helping reduce DNA rates.
Overall improvement in parent and patient satisfaction.
Under 5 with respiratory symptoms and environmental challenges i.e. mould, with multiple episodes of respiratory infection and wheezing
ADHD/Neurodiversity child
Click image or title to see case studies
Anxiety and Stress in Children Case Study Example
12 year old presenting with physical symptoms, poor attendance to school, which was then diagnosed as anxiety/low mood
Click image or title to see case study
Combining data to support babies, children and young people to thrive in Harrow
Proposal for a live dashboard to identify risks, support families, reduce inequalities, and improve early years outcomes in Harrow, building on Harrow’s early years expertise.
Click image or title to see case study
Antenatal - 8 Weeks
They want to access support in one place
Some working parents want to attend evening and weekend antenatal classes
They want one seamless health service antenatally and postnatally
They can be confused about the role of the health visitor antenatally
They want to meet other expectant parents
8 Weeks - 9 Months
Gaps in contacts leave families wanting more support and feeling socially isolated post-birth
Advice is not always consistent across health professionals
They want a strong support network of other families with new babies
They want to meet other parents whilst their children play
They want a wider variety of children's centre groups
1 - 2.5 years (Development Reviews)
The process and rationale for the ASQ wasn't clear
The ASQ felt like a test, one that their child was going to fail at
The review is not tailored towards children who have developmental delays
The letter was in English, and they couldn't read it
Children's Centre 'Stay and Plays' are natural settings to review a child's development
Targeted Offer
Some parents feel hesitant talking about complex issues
The language used to talk about families in need can be stigmatising
It isn't always clear what specialist services are available
Hiring practitioners who speak community languages is highly valuable
It can be frustrating to complete multiple assessments
Earlier support is needed for children with disabilities
Speech and Language (SAL)
To advise them on speech and language tips earlier
To provide them with everyday tools/activities to improve their child's development
Children can support each other's speech and language development
Comparison:
Bar / Column Chart
Table
Data over time:
Run Chart
SPC Chart
Ranking:
Bar / Column Chart
Table
Proportions:
Pareto Chart
Table
Common Cause Variation
Day in, day out, variation in a process
Indicates stability and predictability
If something falls under common cause variation, it is important not to overreact
Special Cause Variation
Indicates something different happened
Not part of a stable process
Always has a specific cause
Should lead to appropriate action
High impact or low impact?
Easy or hard to implement?
POSSIBLE - Easy to do, low impact
IMPLEMENT - High impact, easy to do
CHALLENGE - High Impact, hard to do
KIBOSH - Low impact, hard to do
Click image to download PICK Chart
The Plan-Do-Study-Act (PDSA) cycle is shorthand for testing a change on a small scale (e.g., one patient, one day) in the real-world setting — by planning it, trying it, observing the results, and acting on what is learned. This is the scientific method adapted for action-oriented learning (How to Improve: Model for Improvement: Testing Changes | Institute for Healthcare Improvement).
Identify the change idea to be tested
Predict what will happen
Plan the cycle (who, when, where, how)
Decide what data to gather
Analyse the result
Compare data to prediction
Examine learning
Carry out the plan
Document any problems encountered and observations
Gather data
Adopt, adapt or abandon cycle
If adopting with no change, implement the improvement
If adapting the change, identify modifications for the next cycle
Acknowledgement Note: The above image and statement is referenced from the How to Improve: Model for Improvement: Testing Changes | Institute for Healthcare Improvement