Article Text
PDF
Abstract
Objectives Treatment burden is the workload of healthcare for people with long-term conditions (LTC) and its impact on well-being. A method of measurement is required to identify those experiencing high burden and to measure intervention efficacy. Our aim was to identify, examine and appraise validated patient-reported measures (PRMs) of treatment burden in stroke. Here, stroke serves as an exemplar LTC of older adults.
Design A systematic review of published studies that describe the development and validation of PRMs measuring treatment burden in stroke survivors.
Data sources We searched MEDLINE, Embase, CINAHL and PsycINFO electronic databases.
Eligibility criteria Studies published between January 2000 and 12 April 2019 inclusive, in English language. No restrictions were set based on clinical setting or geographical location.
Data extraction and synthesis Screening, data extraction and quality appraisal were conducted by two independent reviewers. Content of the PRMs was compared with a published taxonomy of treatment burden. Quality appraisal was conducted using International Society for Quality of Life Research standards.
Results From 3993 articles, 6 relevant PRMs were identified: 3 were stroke specific: The Satisfaction with Stroke Care questionnaire; The Stroke Patient-Reported Outcome Measure and The Barriers to Physical Activity after Stroke scale. Three were generic but validated in stroke: The WHO Quality of Life-100; The Patient’s Questionnaire on Participation in Discharge Planning and The Chao Perception of Continuity scale. None comprehensively measured treatment burden. Examples of omitted burdens included developing coping strategies, managing finances and returning to driving. The most notable issue regarding quality appraisal was that three PRMs lacked any underpinning qualitative research relevant to the sample.
Conclusion There is a need to develop a comprehensive PRM of treatment burden for use in stroke, with potential for use in other older populations.
- stroke
- treatment burden
- patient-centred care
- patient-reported measure
- systematic review
This is an open access article distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited, appropriate credit is given, any changes made indicated, and the use is non-commercial. See: http://creativecommons.org/licenses/by-nc/4.0/.
Statistics from Altmetric.com
Strengths and limitations of this study
The first systematic review to examine patient-reported measures of treatment burden in stroke, an important aspect of patient care.
Thorough literature search of four major electronic databases and reporting as per Preferred Reporting Items for Systematic Reviews and Meta-Analysis guidelines.
Exclusion of non-English language papers and publication pre-2000 (the latter due to the rapidly evolving nature of stroke management over recent decades).
Treatment burden is a recently recognised concept influencing quality of care and quality of life, making literature searches challenging.
Introduction
Stroke is a common condition of older adults; in Europe, the incidence of stroke increases by a factor of 100 between the ages of 40 and 80 years.1 Stroke treatments, particularly newer rehabilitative therapies, are often complex with multiple interacting components or people involved in their delivery. Multidisciplinary therapy and early discharge from hospital are now recommended in guidelines, and these are becoming more commonplace in practice.2 3 Engaging with and accessing such treatments, however, can demand considerable time and effort from stroke survivors, and this can be difficult for those who are older or frail.
Our previous qualitative research and systematic review demonstrated that people who have had a stroke can feel overwhelmed by managing their recovery and that this is exacerbated when health services are fragmented and lacking in a person-centred approach.4 5 Treatment burden is defined as the workload of healthcare for people with long-term conditions and its impact on well-being.5 6 It is becoming increasingly recognised by governing bodies and clinical guidelines as an important barometer of quality of care requiring attention.7 Healthcare workload encompasses all tasks relating to health including those recommended by health professionals and those required to maintain or improve health status.8 Through our previous research, we created a taxonomy of treatment burden in stroke and a conceptual model,4 5 the latter is shown in figure 1. Our research showed that treatment burden is not purely dependent on volume of healthcare work; the way that services are planned, delivered and co-ordinated also influences the perceived burden felt by an individual.5 For example, poor co-ordination or communication between healthcare providers can result in duplication or omission of important aspects of care. Capacity to manage healthcare workload will vary greatly between individuals due to personal abilities and circumstances; therefore, two people with the same treatment workload may cope very differently.5 8
Conceptual model of stroke treatment burden. The arrows represent the possible pathways between components that stroke patients may follow. The ‘enacting management strategies’ component has four subcomponents. Reproduced with permission from Plos MED 4 (creative commons Attribution-Non-commercial 4.0 license).
Treatment burden is important because it may reduce quality of life and result in non-adherence to recommended treatments, resulting in suboptimal health-related outcomes and wasted health service resources.9 For example, intentional and non-intentional non-adherence to medications may result because of an excessively complex or poorly planned medication regimen.10 Consideration of treatment burden is particularly important in older people who may have a decreased ability to self-manage health due to physical, cognitive and emotional difficulties. To date, treatment burden has been under-researched4 11 and may not be adequately considered by clinicians involved in the provision of care for older people with long-term conditions.
Stroke can be used as an exemplar long-term condition for describing treatment burden. It is common in older adults,1 often occurs in the context of other comorbidity12 and can result in complex physical and cognitive impairments.13 In previous work, we created a conceptual model of treatment burden in stroke through qualitative systematic review and analysis of interviews with stroke survivors.4 5 This provided important insights into the lived experience of treatment burden in this group and highlighted the need for a method to quantify this burden. There are many potential applications of a tool that measures treatment burden. It could enable clinicians to identify those experiencing high levels of burden who may need additional support with self-management. It could facilitate inclusion of treatment burden as an outcome in clinical trials of stroke therapies alongside measures of efficacy to ascertain if treatments are not only effective, but manageable in older, frailer patients in the ‘real world’. Lastly, measurement of treatment burden would allow analysis of the effectiveness of interventions aimed at decreasing burden.
Treatment burden is experienced on an individual level; therefore, a patient-reported measure (PRM) is the best approach to measurement. A PRM is a report of the patient’s health experience or experience with healthcare that comes directly from the patient, without interpretation of the response by anyone else.14 It is a common and useful way to measure experiences or outcomes that require information directly from the patient, for example, health-related quality of life or satisfaction with health services. To help clinicians and researchers select which PRMs to use in a given setting, The International Society for Quality of Life Research (ISOQOL) has published a set of standards that can be used in the quality appraisal of PRMs.14
The aim of this systematic review is to collate and appraise published, validated PRMs of treatment burden in stroke, including discrete portions of PRMs that measure burden (eg, scales, scorable single items). We were particularly interested in content of the tool, the extent to which the PRMs aligned with our previously developed conceptual model of treatment burden in stroke4 5 and the quality of the supporting research.14
Methods
We followed Preferred Reporting Items for Systematic Reviews and Meta-Analysis (PRISMA)15 guidance in the design, conduct and reporting of our review (online supplementary appendix 1). A protocol was developed and is available at https://www.crd.york.ac.uk/prospero/. All aspects of screening and data extraction were performed by two independent reviewers (KIG, MD, TJQ, LK, JE, NJ, DTE) with recourse to a third arbitrator as necessary (FSM).
Supplemental material
Searching strategy
An initial scoping search was carried out to identify relevant terms and phrases, which would be used in the formal electronic search. This consisted of a preliminary search of personal files; MEDLINE via Ovid and the use of the ‘related articles’ function in PubMed. A formal search strategy was then created with an information scientist (PJE). We used a concept-based approach to design the search syntax, using validated search filters where available. The concepts were stroke, treatment burden and PRM. The full search strategy can be found in online supplementary appendix 2. As ‘patient-reported measure’ is not a recognised subject heading, ‘patient-reported outcome measure’ was used and in addition ‘patient reported’ was entered as a textword or subject heading or author keyword. Databases searched were as follows: MEDLINE (Ovid), Embase (Ovid), CINAHL (EBSCO) and PsycINFO (Ovid) from first January 2000 up to and including 12 April 2019. PRMs predating 2000 were deemed to be irrelevant to the current experiences of stroke survivors due to considerable changes in stroke management over recent decades.
Supplemental material
Screening
Papers found were uploaded to a web-based systematic software programme DistillerSR (Evidence Partners) to facilitate screening and data extraction. Inclusion criteria are shown in online supplementary appendix 3.
Supplemental material
Consistent with a prior systematic review of treatment burden measures,11 potentially relevant scales were assessed at the level of individual items or domains. Items in each measure were scrutinised to ascertain if they were consistent with the definition of treatment burden outlined in the inclusion criteria (which is in line with the taxonomy of treatment burden and conceptual model created in our previous research).4 5 If less than 50% of items in the PRM reflected treatment burden, then it was excluded. An exception to this was the presence of an independently scorable item or subscale that was deemed relevant, regardless of size. If a study had used a potentially relevant PRM but no information on development or validation was given in that paper, then the original development paper was sought and examined. If the original development paper was published pre-2000 but the PRM had been used in a published study after that date, then the PRM was included. References of included papers were scrutinised for relevant articles and the above process repeated until no new titles were found.
Data extraction and evidence synthesis
The data extraction and quality appraisal form is provided in online supplementary appendix 4. Data extracted were as follows: descriptive data about the study (eg, sample size and details of participant characteristics), items relating to treatment burden and information on PRM development or validation including psychometric testing. Content of the items on treatment burden was mapped to the taxonomy of treatment burden created in our previous work.4 5 This was undertaken to ascertain which aspects of treatment burden were included in the PRMs and to scrutinise if any burdens were omitted. Quality appraisal was conducted using ISOQOL standards14 as a reference. ISOQOL standards include whether the PRM was developed from underpinning qualitative research; reliability (how much it is free from measurement error); content validity (whether it measures what is relevant and important to the patient); construct validity (whether it measures what it purports to measure); responsiveness (whether it can detect changes over time); interpretability of scores (whether scores are meaningful to those using it) and patient and investigator burden (how difficult it is to use). We did not create a summative quality score and did not exclude papers due to perceived risk of bias; rather it served as a point of discussion.
Supplemental material
Patient and public involvement
The Research Advisory Group that guides this programme of research includes four stroke survivors or carers of stroke survivors. Their input has helped to guide the aims, objectives and methods of this study. Additionally, the results of this study were presented to three individuals with cardiovascular disease and discussed in a focus-group setting, which informed our discussion in the paper.
Results
Screening
The PRISMA diagram of included studies is shown in figure 2. The database search yielded 3993 articles, of which 184 were retrieved for full-text review. The text of a further 21 papers, which were identified through reference list searching or were the original validation studies of PRMs identified within the full text papers, was also fully reviewed.
Preferred Reporting Items for Systematic Reviews and Meta-Analysis (PRISMA) flow chart. PRM, patient-reported measure.
Identified PRMs
Six papers were identified that each described the development or testing of a relevant PRM16–21 and were included in the review (table 1).
Included Patient Reported Measures
The Satisfaction with Stroke Care (SASC) questionnaire16 was developed to measure stroke survivor’s satisfaction with inpatient and outpatient health and social care services; 12 out of 13 items measure treatment burden. This PRM was originally developed and validated in a sample of stroke survivors. The Stroke Patient Reported Outcome Measure (Stroke-PROM)17 was developed for use as an outcome measure in stroke drug trials and measures the effects of stroke and its treatments on an individual. Only 4 out of 46 items are relevant to treatment burden, but this was an independently scorable domain on satisfaction with treatments. This PRM was developed and validated in a sample of stroke survivors. The Barriers to Physical Activity after Stroke scale (BAPAS)18 was developed to measure the perceived barriers to regular physical exercise after a stroke. It was developed and validated in stroke survivors, and 7 out of 14 items were deemed relevant to treatment burden. The other three measures were originally developed in non-stroke populations and subsequently validated in stroke survivors. The WHO Quality of Life-100 (WHOQOL-100)19 is aimed at measuring quality of life and 4 out of its 100 items are relevant; they measure accessibility and quality of health and social care and constitute an independently scorable domain. The Patient’s Questionnaire on Participation in Discharge Planning (P-QPD)20 measures perceived patient involvement in the discharge planning process, all items are relevant to treatment burden, and all focus on the discharge process. The Chao Perception of Continuity scale (Chao-PC)21 has 23 items; 17 of which measure treatment burden, all items focus on continuity of care.
Details of the participants included in each study are given in online supplementary appendix 5. Five of the studies reported a mean age over 60 years,16 18–21 the other stated that 48% were between 45 and 65 years and that 40% were 65 years or over.17 Two studies were conducted in the UK (SASC and Chao-PC),16 21 both were community based with a majority of white participants. The other studies were conducted in France (BAPAS),18 China (Stroke-PROM),17 Sweden (P-QPD)20 and Turkey19 (WHOQOL-100). All studies included a balanced mix of men and women. Level of participant education varied between studies, the Chinese sample had the highest17 and one of the UK samples had the lowest.21
Supplemental material
Content of the PRMS
Table 2 shows the aspects of treatment burden included in and missing from the PRMs found. All aspects of treatment burden found within the included PRMs fell inside our previously published conceptual framework and taxonomy.
Our taxonomy of treatment burden in stroke
Quality appraisal
A detailed account of quality appraisal is given in table 3. The three PRMs that were developed in stroke populations (SASC, Stroke-PROM and BAPAS)16–18 were developed from qualitative work relevant to the sample, that is, in stroke survivors. The WHOQOL-100 had been originally developed from qualitative work undertaken in non-stroke populations and did not include any qualitative research examining stroke survivors’ experiences. It was unclear if the Chao-PC or the P-QPD had been developed from any underpinning qualitative work with stroke survivors; however, development of the Chao-PC was underpinned by Banahan’s conceptual model of continuity of care.22 23
Quality appraisal of included papers using ISOQOL standards as a reference
Regarding reliability, all PRMs had been tested for internal consistency and all were found to be suitably reliable (Cronbach’s alpha >0.70). Only two studies provided information on test-retest reliability (SASC and BAPAS).16 18 The SASC study assessed this by weighted kappa in a sample of 21 patients who repeated the PRM 2 weeks after the original mailing.16 Eleven out of the 13 items had a weighted kappa ≥0.3 and the authors reported that cut-off as acceptable. The BAPAS study repeated the measure in 21 participants after 4–6 days and found good reproducibility with an intraclass coefficient of 0.9.18 However, authors note the short interval between test and retest, therefore the possibility of recollection bias.
Content validity had been assessed in all studies, although in the case of the WHOQOL-10019 this was not with stroke survivors and the SASC16 had not been tested face-to-face. All studies had assessed construct validity using various methods including factor analysis, correlations with other PRMs and known-group validity. Results are detailed in table 3.
None of the studies had tested for responsiveness to change, but this was deemed appropriate as none were measuring outcomes longitudinally.
Regarding interpretability, all papers described the meaning of high and low scores but only one described a cut-off (SASC).16
Three studies (SASC, Stroke-PROM and Chao-PC)16 17 21 reported that they assessed participant burden by analysing response rates; the two with high response rates were deemed to have low burden (SASC, Stroke-PROM)16 17 and the other with a low response rate (Chao-PC) was deemed not easily transferable to a UK population without further modification due to the structure and content of its items.21 Two studies reported time to complete the measure (Stroke-PROM and BAPAS).17 18 None assessed investigator burden, that is, ease of use for the researcher using the PRM.
Discussion
PRMs found
We found six PRMs that measure treatment burden in stroke. All had been tested in older stroke survivors in a mix of hospital and community settings within developed countries. None of the PRMs found had been developed to comprehensively evaluate treatment burden and none of the included studies were aimed at doing so. Rather, they were aimed at assessing related concepts or narrow aspects of treatment burden. One PRM, which was developed before treatment burden had been conceptualised in the medical literature, was aimed at measuring patient satisfaction (SASC),16 and this covered the most aspects of treatment burden out of the PRMs found, however, many treatment burdens were missing. Three PRMs focused on important but limited aspects of treatment burden: barriers to participation in physical activity (BAPAS),18 continuity of care (Chao-PC)21 and participation in discharge planning (P-QPD).20 The other two (WHOQOL-100 and Stroke-PROM)17 19 are longer measures that included a small minority of items that were relevant to the issue of treatment burden and independently scorable. In summary, none of the published PRMs comprehensively measured treatment burden in stroke.
During quality appraisal, the most notable weakness was that the three studies that involved validation of PRMs originally developed in non-stroke populations (Chao-PC, P-QPD, WHOQOL-100)19–21 did not describe any qualitative work underpinning their use in stroke survivors. Additionally, the lack of assessment of content validity or consideration of feasibility of the WHOQOL-100 results in uncertainty about whether this long 100-item measure is suitable in a stroke population who are typically older and potentially cognitively impaired, frail or easily fatigued. Only one PRM (SASC)16 provided a cut-off score, this was for ‘satisfactory treatment’. None of the studies were longitudinal therefore none assessed responsiveness; however, testing of this would be required if longitudinal measurement was an intended future use of the PRM, such as in a clinical trial. One measure (Chao-PC)21 was deemed by the authors as unsuitable for use in a UK population due to the structure and content of the items. For example, items did not distinguish between primary and secondary care and so could be confusing to a UK patient.
Strengths and limitations
Our search was limited to English-language papers, which could be viewed as a limitation, although there is increasing evidence that this may have little effect.24 Exclusion of papers published pre-2000 could also be viewed as a limitation; however, this was chosen due to the rapidly evolving nature of stroke management over recent decades. One paper published before 2000 was included because the PRM identified had been used in subsequent studies after that date.25 Searching for papers that examine treatment burden is challenging because it is a relatively new concept that is multifaceted. To combat this, we clearly defined treatment burden prior to the start of our review based on our previous qualitative work.4 5
How results fit in with current literature and future research
Treatment burden is a relatively new concept in the medical literature, with robust qualitative work giving us a better understanding of the patient experience of this phenomenon in stroke and other patient groups.4–6 26 27 Aspects of care that stroke survivors describe as particularly burdensome include information provision about stroke treatments, care co-ordination and the process of transitioning from hospital into the community.4 5 These are examples of areas that would benefit from measurement and intervention to lessen treatment burden. Despite this, we still need to understand more about the relationship between treatment burden and health-related outcomes; how burden changes over the patient journey and whether we can lessen treatment burden through altering the way that healthcare is provided. To examine these areas, quantification of treatment burden is required, yet this is not straightforward. Treatment burden is more than simply healthcare workload, it is a complex interplay of healthcare systems, individuals and their social networks that results in a feeling of encumbrance if demand outweighs personal resources.5 8 This has the potential to lead to disengagement from health services, wasted resources and worsening health outcomes, particularly in vulnerable groups such as those who are older, frail, socioeconomically deprived or socially isolated.28
Treatment burden has received attention from researchers interested in individual conditions29–32 and from those interested in studying people with multiple long-term conditions.6 PRMs have recently been developed for use in the latter population.33–35 There is overlap between these generic treatment burden PRMs and our taxonomy of treatment burden in stroke; however, many stroke-specific burdens are not represented in the generic measures, such as robotic upper limb neurorehabilitation, speech and language therapy, management of visual problems and vocational rehabilitation. There is good evidence that stroke survivors obtain better health-related outcomes in treatment pathways designed specifically for stroke survivors,36 and therefore, some of their healthcare experiences are likely to be different. In this systematic review, we chose to exclude PRMs that have not been validated in stroke survivors because current guidance for PRM selection indicates that it is desirable that chosen PRMs be validated in a sample relevant to the population in question.14 This means that PRMs not developed for use in stroke specifically may not fully represent all treatment burdens encountered by stroke survivors. Additionally, stroke survivors are typically older individuals who may have cognitive impairment, visual difficulties or aphasia that can make completion of a PRM challenging. It is vital that when PRMs are developed for use in older populations that careful attention is paid to usability in this group.
In conclusion, we found no comprehensive PRMs of treatment burden that had been validated in a stroke population. Further research to develop and validate a new PRM of treatment burden in stroke would be important to enable new insights into the quality of care and quality of life of stroke survivors. Such a tool could also be of value for use in other older populations with similar healthcare challenges.
Acknowledgments
Research Advisory Group stroke survivors/carers of stroke survivors: Roger Lambert, Tim Morrow, David Jones, Moira Campbell. Focus group members: Roger Lambert, David Jones, David Brooks.
References
Footnotes
Contributors KIG, TJQ, DTE and FSM contributed to the design of the project. PJE created the search strategy and conducted the search. KIG, MD, TJQ, LK, DTE, JE, NJ and FSM screened papers, extracted and analysed data. KIG drafted the paper, and all authors reviewed drafts and approved the final version.
Funding This study was funded by the Stroke Association, Grant number: TSA 2017/01, TSA 2015/05.
Competing interests KIG and TJQ received funding from The Stroke Association to complete this work. TJQ received a grant from BMZ/Pfizer and payment from BMS/Pfizer and Bayer for educational activities outside the submitted work. FSM received payment for educational activities from Janssen outside the submitted work.
Patient consent for publication Not required.
Provenance and peer review Not commissioned; externally peer reviewed.
Data availability statement There are no data in this work.