Today we feature a joint-post from one of our established bloggers and a colleague who she has been working with on her local Patient and Public Involvement (PPI) group.
Sarah Knowles is the established blogger; she’s a Research Fellow at the NIHR School for Primary Care Research in Manchester. Ailsa Donnelly is the new addition to our blogging team; she’s the lay Chair of the PRIMER group and a firm believer in active patient/carer/public/lay involvement in health research.
No matter how complicated the research, or how brilliant the researcher, patients and the public always offer unique, invaluable insights. Their advice when designing, implementing and evaluating research invariably makes studies more effective, more credible and often more cost effective as well.
– Dame Sally Davies, Chief Medical Officer
PPI is often now expected in health research, with funding bodies such as the National Institute for Health Research requesting PPI information on grant applications and asking lay reviewers for a patient perspective. (Not all funding bodies require PPI, including, surprisingly, some charities).
In a shocking display of Elvish insolence (not ‘Elvis’ insolence as Ailsa first heard!), we’re going to disagree with Dame Sally, arguing that we still don’t know if PPI makes research ”more effective”, with methods for measuring and reporting PPI relatively new and under-used. The evidence base for PPI is limited, often reported in rose-tinted hindsight, and there are calls for more formal empirical assessment of PPI, especially its impact on research (Petit-Zeman and Locock 2013). The hope is that better measurement of “impact” will tell us whether PPI does actually make research more effective and more credible as claimed.
Brett and colleagues have contributed to the evidence base in their latest paper, taking a slightly different angle. In this sister paper to a review of the impact of involvement on research (Brett et al. 2014) they looked at the effect of participating in PPI on the people doing it. As well as being important in its own right, they suggest that understanding this may explain why some PPI projects work and others don’t. Rather than just questioning what PPI is done and what impact it has, we need to examine how it affects all those involved during the PPI process.
- The team searched the major databases for studies between 1995 and 2012. They also hand searched specialist journals and contacted experts in the field to find any studies overlooked.
- They included all studies, published and unpublished, reporting data on the involvement of adults in health or social care research. They assessed the quality of studies using the CASP checklists, and conducted a narrative synthesis to draw out key themes across all the studies.
- In a nice example of “walking the walk”, 3 service users were involved in designing the study, and the team also held a PPI workshop with 24 PPI partners to discuss the study synthesis.
- 65 papers were included in the review measuring impact on service users, 35 for researchers. The majority were qualitative, including case studies, cross-sectional studies and other reviews. Studies were predominantly from the UK, with others from North America, Australia and some Scandinavian.
- The authors separated their results into “Impact on Service Users”, “Impact on Researchers” and “Impact on the Community under research.” Each situation reported both positive and negative impacts.
- For service users:
- Positive impacts: gaining skills and knowledge, feeling listened to and being part of a team
- Negative impacts: they reported feeling marginalised, ignored and underprepared
- For researchers:
- Positive impacts: gaining insight
- Negative impacts: tension and scepticism over what PPI partners could contribute, with the additional burdens of finding extra funding for PPI or managing new roles and expectations
- “Impact on the community”:
- Positive impacts: reported greater trust that meant research had more credibility (gold star for Dame Sally!). Better dissemination due to community ‘ownership’ or through users becoming advocates was seen as very helpful
- Negative impacts: some communities reported exposure of conflicts and difficulty in ensuring sufficient diversity in involvement
The authors concluded:
The evidence reported highlights that PPI impacts these different groups in different ways, and may be linked to differing motivations and values, less often explored in studies of impact. … A common theme identified in this review is the potential for challenging impacts which can result from colliding worlds, where the values and assumptions researchers have meet with the needs and aspirations of users and the community as a whole, and do not necessarily mesh well.
The issue of culture clashes is one often talked about in PPI but rarely acknowledged formally; it’s good to see this getting attention, and I/we hope it leads to more honest discussion about it, including suggestions to manage and overcome it.
Ailsa in particular noted that impact on service users was reported very much in terms of personal development, for example impact on self esteem (positive or negative!) and discussing feelings about their own roles. Impact on researchers was much less individual and couched more in terms of ‘culture’ and ‘professional development’, with very little about ‘personal journeys’. This would have been interesting to consider, as we can imagine for example that mental health research could have enormous emotional consequences on a researcher. Perhaps acknowledging these ‘personal’ as well as ‘professional’ impacts on researchers could be key to navigating the culture clash?
Finally, it was clear that much ‘positive’ PPI was about managing expectations on both sides right from the start, and then maintaining good two-way communication, which rings true with both of us!
- The paper doesn’t specify search terms and doesn’t define “involvement”. This is crucial as various definitions exist (“involvement” is the preferred term in the UK but other countries may use different terminologies; would they then be excluded from the review?). There are also different levels of involvement for service users, ranging from consultation on an idea to active participation as collaborators or even project leaders. It would be useful to know whether impacts were consistently different between types of involvement or if specific impacts were linked to specific types of involvement.
- It was not explained whether social care involvement and health care involvement were compatible and could be assessed/reported in equivalent ways.
- The synthesis collates the issues into those affecting different groups (service users, researchers, the community), but was quite descriptive. For example there was no attempt to consider whether positive or negative impacts were more often reported in studies with particular groups or methods.
- It was also unclear whether positive and negative impacts were exclusive or could occur in the same study, or whether studies where researchers were more positive meant more positive community impacts and so on. The authors do include some suggestions in their discussion (for example, noting that poor planning and unclear roles seem to contribute to negative impacts). Sarah thought that formally mapping out these potential relationships could have given us a deeper understanding of how these impacts occurred, and some ideas of how do to manage them.
- It’s great to see service users involved in the paper, but we both noticed there were no details of any support offered. For example, did they have previous experience of helping reviews or were they given any training?
- The authors don’t mention if any consistent impact assessment tools were reported in the studies, or if impact tended to be reported ad hoc (and if so, how it was collected in each study). The discussion acknowledges the problem of poor reporting and notes that a better conceptualisation of impact is necessary, but this does perhaps miss an opportunity to examine what the review itself tells us about how this could be conceptualised and what aspects of impact should be regularly assessed.
- Ailsa wanted to know in the qualitative studies who had interviewed whom. Were they all conducted by researchers or did service users do some? Following on from this, it would be interesting to compare reports from studies that included PPI co-authors to those written or completed by researchers alone.
Brett J, Staniszewska S, Mockford C, Herron-Marx S, Hughes J, Tysall C, Suleman R. (2014) Mapping the impact of patient and public involvement on health and social care research: a systematic review. Health Expect. 2014 Oct;17(5):637-50. doi: 10.1111/j.1369-7625.2012.00795.x. Epub 2012 Jul 19. [PubMed abstract]
Petit-Zeman S, Locock L. (2013) “Health Care: Bring on the Evidence.” Nature 501 (7466): 160–61. doi:10.1038/501160a.
RT @Mental_Elf: The impact of PPI on service users, researchers and communities http://t.co/Bv8C9Du2d1
Interesting blog from @Mental_Elf on the positive and negative effects of involving service users in research http://t.co/Us5rRdhCBE“
Lisa Eden liked this on Facebook.
DrWaleed Abdulkarim liked this on Facebook.
‘Sue Mario liked this on Facebook.
Susanne Hart liked this on Facebook.
Today @dr_know @AilsaDon on the impact of patient and public involvement on health and social care research http://t.co/MV874JemwE
#PPI powerhouse @AilsaDon and I cowrote the latest @Mental_Elf blog on impact of patient & public involvement http://t.co/qCKapA7hA8
@dr_know @AilsaDon @Mental_Elf interesting. The roles seem so rigidly structured however…
@dr_know @AilsaDon @Mental_Elf Aren’t service users community members, & do none of researchers have exp as users of mental health services?
@LaurelMildred @AilsaDon @Mental_Elf yes, often a critique of false dichotomies. I think it’s used to show different background/angle >>
@LaurelMildred @AilsaDon @Mental_Elf >> people are coming from.But there’s certainly issue with eg. idea that researchers never use services
@dr_know @AilsaDon @Mental_Elf tricky. You need to categorize to study but categories are stigmatizing & I suspect are part of the grind.
@LaurelMildred @AilsaDon @Mental_Elf some researchers get offended that their experience isn’t acknowledged; others I think hide behind it.
@dr_know @AilsaDon @Mental_Elf yep. It’s a sweet spot though if ppl can be real, and essential for work w/cultural communities. Good luck.
@dr_know @LaurelMildred @Mental_Elf Potentially we’re all SUs, but ‘professional’s’ patient journey may be very different to Joe Public’s..
@AilsaDon @dr_know @Mental_Elf Agree, & worry stigma reduct means private pay/insured gaining accept while pub systems remain poor/despised.
@LaurelMildred @dr_know @Mental_Elf Stigma esp for drs with MH probs who don’t admit/acknowl it because they feel they have to be ‘strong’
Tim Rawcliffe liked this on Facebook.
Ailsa noted impact of #PPI on researchers dressed as professional development, on patients it’s personal development. http://t.co/Rnse0qnQ2j
The impact of PPI on service users, researchers & communities http://t.co/3t9rpKXAgv
The impact of PPI on service users, researchers and communities http://t.co/Mvk5CfE0HV via @sharethis
Do you have first hand experience of PPI work? Please share your story & tell us what you think of our blog http://t.co/MV874JemwE
Interesting article on impact of consumer involvement in research projects RT @Mental_Elf: http://t.co/sLMEz8gjTI”
The Mental Elf liked this on Facebook.
Patient & public involvement feels intuitively right, but where’s the evidence that it makes research more effective? http://t.co/MV874JemwE
Interesting paper/comment @Mental_Elf https://t.co/PvFx6K2RPI Wonder how much research there is on effectiveness of academic researchers?
@Mental_Elf recommended this to some colleagues who are currently researching in the field – worth some thinking about @Improve_Academy
@ReinhardGuss hi! Might find this interesting, a review of some PPI research and benefits (not dementia specific) http://t.co/FTflEaD0aQ
The impact of PPI on service users, researchers and communities http://t.co/4b9ohA5wJq via @sharethis 1/2
Mental Elf: The impact of PPI on service users, researchers and communities http://t.co/WefhZu4n6K
Hi @People_Research Any thoughts on our blog about the impact of PPI on service users, researchers & communities? http://t.co/MV874JemwE
Stephen Gaskell liked this on Facebook.
Welcome to the woodland @AilsaDon It’s great to feature your joint blog with @dr_know on #PPI http://t.co/MV874JemwE
@Mental_Elf @dr_know Thank you. If I learn to tell the wood from the trees do I get a treehouse as a prize? (always wanted one!)
What impact does patient and public involvement have on the people themselves – patients and researchers? http://t.co/Rnse0qnQ2j
Don’t miss: The impact of PPI on service users, researchers and communities http://t.co/MV874JemwE
“@Mental_Elf: Don’t miss: The impact of PPI on service users, researchers and communities http://t.co/XkPlnI1zXR” gr8 blog!
Ali Smith liked this on Facebook.
“The impact of PPI on service users, researchers and communities” good to see some attempts being made at evaluation. http://t.co/OQComMqZD1
nice blog about consumer involvement in research http://t.co/1yEbhyVJpT
Yesterday @AilsaDon and I critiqued a recent review of #ppi impact on those involved. http://t.co/qCKapA7hA8 both +ve and -ve impacts found
The impact of PPI on service users, researchers & communities http://t.co/ZcETL1OY4Y Evidence review #patientinvolvement #NHS #engagement
When the worlds of researchers and patient’s collide…who benefits most? Great blog from @MentalElf http://t.co/cFKyIJAFDj via @sharethis
“patients and the public always offer unique, invaluable insights” @Mental_Elf reports on the impact of PPI: http://t.co/Rg3RTDkq5s