Article Text

Download PDFPDF

Protocol for a systematic review of preference-based instruments for measuring care-related outcomes and their suitability for the palliative care setting
  1. Nikki McCaffrey1,2,
  2. Hareth Al-Janabi3,
  3. David Currow1,
  4. Renske Hoefman4,
  5. Julie Ratcliffe2
  1. 1Palliative and Supportive Services, Flinders University, Bedford Park, South Australia, Australia
  2. 2Flinders Health Economics Group, Flinders University, Bedford Park, South Australia, Australia
  3. 3Health Economics Unit, School of Health and Population Sciences, University of Birmingham, Birmingham, UK
  4. 4Netherlands Institute for Health Services Research, Utrecht, The Netherlands
  1. Correspondence to Dr Nikki McCaffrey; nicola.mccaffrey{at}flinders.edu.au

Abstract

Introduction Despite informal caregivers' integral role in supporting people affected by disease or disability, economic evaluations often ignore the costs and benefits experienced by this group, especially in the palliative setting. The purpose of this systematic review is to identify preference-based instruments for measuring care-related outcomes and provide guidance on the selection of instrument in palliative care economic evaluations.

Methods and analysis A comprehensive search of the literature will be conducted from database inception (ASSIA; CINAHL; Cochrane library including DARE, NHS EED, HTA; Econlit; Embase; PsychINFO; PubMed). Published peer-reviewed, English-language articles reporting preference-based instruments for measuring care-related outcomes in any clinical area will be included. One researcher will complete the searches and screen the results for potentially eligible studies. A randomly selected subset of 10% citations will be independently screened by two researchers. Any disagreement will be resolved by consensus among the research team. Subsequently, a supplementary search will identify studies detailing the development, valuation, validation and application of the identified instruments. The degree of suitability of the instruments for palliative economic evaluations will be assessed using criteria in the International Society for Quality of Life Research minimum standards for patient-reported outcome measures, the checklist for reporting valuation studies of multiattribute utility-based instruments and information on the development of the instrument in the palliative setting. A narrative summary of the included studies and instruments will be provided; similarities and differences will be described and possible reasons for variations explored. Recommendations for practice on selection of instruments in palliative care economic analyses will be provided.

Ethics and dissemination This is a planned systematic review of published literature. Therefore, ethics approval to conduct this research is not required. Findings will be presented at leading palliative care and health economic conferences and published in a peer-reviewed journal.

Trial registration number CRD42016034188.

  • caregivers
  • family
  • preference-based
  • care-related instruments

This is an Open Access article distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited and the use is non-commercial. See: http://creativecommons.org/licenses/by-nc/4.0/

Statistics from Altmetric.com

Request Permissions

If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.

Strengths and limitations of this study

  • The planned systematic review will inform guidance on the selection of informal caregiver outcome measures for economic evaluations of palliative care, promoting the inclusion of informal caregiver costs and benefits in economic analyses.

  • The systematic review protocol is reported according to the recommendations of the Preferred Reporting Items for Systematic Review and Meta-Analysis Protocols (PRISMA-p) statement and is registered with the International Prospective Register of Systematic Reviews (PROSPERO).

  • The total number of preference-based instruments measuring care-related outcomes may be small, limiting the study findings.

Introduction

Societies increasingly, and implicitly, rely on informal caregivers' willingness to take on, maintain and repeat their caring role.1–3 Hence, informal caregivers are integral to healthcare service provision, particularly in clinical areas such as mental health, disability, dementia, cardiovascular disease, cancer, and palliative and end-of-life care.4–7 In this context, an informal caregiver is a person who provides regular, ongoing assistance to a person with progressive illness usually without receiving payment for the care they provide and could include family members, friends or neighbours.8

The WHO defines palliative care as, ‘an approach that improves the quality of life (QOL) of patients and their families facing the problem associated with life-threatening illness, through the prevention and relief of suffering by means of early identification and impeccable assessment and treatment of pain and other problems, physical, psychosocial and spiritual’.9 At the end of life, annual contributions by informal caregivers have been estimated at $A40 billion (£21 billion, $A1=£0.52, 4 March 2016) in Australia10 and between one-third and one-fifth of overall costs (health, social, informal care and out of pocket) in the UK and Canada, respectively.11 ,12 Further, contributions by informal caregivers in the USA have been estimated at over US$500 billion a year (£367 billion, US$1=£0.71, 4 March 2016).13 Clearly, it is vital to consider the impacts on informal caregivers of different models of service provision and alternative health and social interventions when undertaking health research and formulating health policy in the palliative setting. Otherwise, cost shifting and excessive burden on family and friends could threaten the continued provision of this highly valued care.14

International, consensus-based, best practice guidelines on evaluating palliative and end-of-life care services highlight the need to include informal caregiver costs and benefits in economic evaluations.15 Broadly, economic evaluations systematically compare the relative costs and benefits of competing courses of action, providing information about how best to improve patient and family outcomes within funding constraints. Increasingly, these types of economic analyses are used to inform clinical, funding and policy decisions.16–19 Costs and benefits are considered simultaneously to evaluate how best to achieve value for money from scarce resources.20 The most commonly reported measure of benefit in economic evaluations generally is the quality-adjusted life year (QALY).21 The QALY is the sum of time spent in different quality-weighted health states, where the quality-weights represent values or preferences for alternative health states.22 ,23 Often generic, preference-based measures of health-related quality of life (HrQOL) such as the EQ-5D24 are used to generate these quality weights.23 Preference-based measures allow attributes of health to be valued differently.25 For example, an increase in mobility may be more highly valued by patients than a reduction in pain.

However, such generic measures tend to focus on health alone as the sole indicator of benefit. Other aspects of healthcare such as factors relating to the provision of services or care-specific domains, such as control, may also be valued.26 ,27 Consequently, economic evaluations which use generic, preference-based measures do not enable robust coverage of the impacts of interventions in complex disease areas such as palliative care where multiple, diverse domains of effect are valued.28 ,29 It is vital that instruments used to measure the impact of interventions for economic evaluations are sensitive to things that matter to the patient and family. Otherwise, measures will be unresponsive to change, leading to a suboptimal model of measurement and valuation of the true benefits of palliative strategies and misinformed decisions about where best to invest limited public funds.30

Empirical evidence indicates that conclusions relating to the cost-effectiveness of healthcare interventions can alter substantially when care-related costs and outcomes are included in economic evaluations.31 ,32 Despite this, impacts on informal caregivers have relatively rarely been considered in economic analyses, especially in palliative and end-of-life care.14 ,31 ,33 This is due, in part, to the difficulties associated with conducting research in this context, particularly capturing and valuing caregiving effects.14

The number of economic evaluations in palliative and end-of-life care has recently started to increase.34–39 Despite this, guidance is lacking on which instruments can be used for measuring care-related outcomes in economic analyses, hindering inclusion of informal caregiver costs and benefits. Previous systematic reviews in the palliative setting have yielded many different types of instruments for capturing informal caregiver outcomes in health services research such as bereavement, burden, family functioning, mood, needs, QOL, satisfaction with service delivery and social support.40–42 However, preceding reviews did not consider the specific requirements of outcome measures in economic evaluations and may not have identified all relevant literature. Consequently, the aim of this systematic review is to identify, critically appraise and provide guidance on the selection of preference-based instruments for measuring care-related outcomes in palliative care economic evaluations.

Review questions

This systematic review aims to address three related research questions:

  1. What preference-based instruments are available generally, that is, in any clinical setting, to measure care-related outcomes?

  2. How have preference-based instruments measuring care-related outcomes been developed, valued, validated and applied across clinical, research and policy settings?

  3. Have preference-based instruments measuring care-related outcomes been validated and valued in the palliative setting, that is, have preference weights been obtained from a representative sample of people receiving palliative care?

Methods

A structured, three-step approach will be taken for the systematic review. First, all preference-based instruments measuring care-related outcomes in economic evaluations in any clinical setting will be identified. Based on the reviewers' knowledge of this field, the total number of preference-based instruments specifically developed for palliative and end-of-life care is anticipated to be small. Therefore, no restrictions regarding clinical area will be applied at this stage. Second, a supplementary search will be conducted to identify all studies reporting details on the development and application of the identified instruments, with particular attention paid to psychometric properties and valuation methods. Finally, the degree of suitability of the instruments for economic evaluations in the palliative care setting will be assessed by scoring whether the domains or dimensions were developed using input from informal caregivers of people receiving palliative care and whether items from the International Society for Quality of Life Research (ISOQOL)43 minimum standards for patient-reported outcome measures and the checklist for reporting valuation studies of multiattribute utility-based instruments (CREATE)44 have been evaluated in this population. Any protocol amendments will be documented by the lead author in the systematic review study protocol. The Flinders University Health Sciences Liaison librarian will be available to the team for the conduct of the study and specifically will provide guidance on the search strings for each database.

Eligibility criteria

Published, peer-reviewed, English-language articles reporting preference-based instruments for measuring care-related outcomes in any clinical area will be eligible for inclusion in the first step of the systematic review.

Inclusion criteria:

  • Studies including informal caregivers of adult patients receiving palliative care;

  • Studies reporting the development or application of a preference-based instrument for measuring care-related outcomes;

  • Primary and secondary research directly related to the topic, that is, there will be no restrictions regarding research methods;

  • All geographical, national and social settings;

Exclusion criteria:

  • Studies where the informal caregiver is a child or young adult or a paid caregiver, for example, healthcare professionals or paid in-home care workers;

  • Informal caregivers of people receiving curative or maintenance care;

  • Studies describing non-preference based care-related measures;

  • Studies reporting generic (non-specific) preference-based measures;

  • Studies applying unidimensional measures;

  • Non-English articles and those not peer reviewed, including editorials, comment or discussion papers, conference articles and the grey literature.

Search strategy

A comprehensive search of the literature will be conducted from database inception to the date of the search (ASSIA; CINAHL; Cochrane library including DARE, NHS EED, HTA; Econlit; Embase; PsychINFO; and PubMed) to identify relevant published studies meeting the inclusion criteria. Keywords and MeSH terms, derived from previously conducted systematic reviews of informal caregiver outcome measurement tools and preference-based instruments, include following: caregiver, family, volunteer, instrument, questionnaire, outcome assessment, preference-based, utility and care-related and the search will be adapted for each database (figure 1). The reference lists of the included articles will be reviewed for additional literature unidentified by the search (pearling). Searches will be restricted to English language only. Search results and retrieved references will be deposited into Thomson Reuters EndNote V. X7.1 (2014) libraries and this software will be used to manage records throughout the review.

Figure 1

EMBASE draft search strategy.

Selection process

First, the titles and abstracts will be reviewed by the lead investigator who has over 10 years' experience in conducting systematic reviews to assess eligibility for inclusion in the review. Full text articles will be retrieved when the abstract contains insufficient information. If necessary, corresponding authors will be contacted to ascertain whether studies meet the inclusion criteria. Second, the full text articles of potentially eligible studies will be retrieved and independently assessed from the first selection process, for inclusion in the review. A randomly selected subset of citations (10%) will be independently screened by two other members of the research team. Agreement between the reviewers will be assessed using the Kappa statistic to determine if further duplicate reviewing is required.45 If the inter-rater reliability is <0.8, that is, strong agreement,45 an additional subset of citations (25%) will be independently screened. If the inter-rater reliability is still <0.8, all remaining citations will be independently screened. Any disagreements between reviewers will be resolved by consensus among the research team.

Following identification of preference-based instruments measuring care-related outcomes, a second comprehensive search of the literature using the same databases will be conducted to identify studies reporting details on the development, valuation, measurement properties and application of the identified instruments across clinical, research and policy settings. Keywords and MeSH terms will include following: the name of the instrument, ‘caregiver’, ‘valuation’ and ‘psychometric’. Published, peer-reviewed, English-language articles reporting preference-based, care-related instrument development, valuation, measurement properties and application will be included. The same selection process will be followed as detailed above to identify included articles.

As the total number of preference-based instruments measuring care-related outcomes is anticipated to be small, based on the reviewers' knowledge of this field, there will be no restrictions in terms of setting or study quality assessment during the screening process.

Data collection

A table will be created in Microsoft Office Excel 2010 to extract data from the included studies, summarise the evidence and inform assessment of the suitability of the preference-based instruments for measuring care-related outcomes in palliative care. This software will be used to manage data throughout the review. The form will be piloted with three of the included articles and updated accordingly. Extracted information will include following: study features (publication date, country of origin, sample size, setting (clinical, research, policy), type of study, study population, clinical area); instrument description (name of instrument, information about the instrument including domains or dimensions, number of items, description of the items and response format, administration method, ie, self-report, clinician administered, other or unknown, conceptual and measurement model, translation of the instrument, patient and investigator burden); psychometric properties (content validity, construct validity, reliability, responsiveness, floor or ceiling effects, acceptability and feasibility); and valuation (health states valued, preference elicitation technique, source for preference weights, modelling, interpretability of scores and scoring algorithm). Two reviewers will extract data independently (NM; RH). Where there is ambiguity, input will be sought from a third reviewer. Any disagreements between reviewers will be resolved by consensus among the research team.

Two reviewers will independently assess the suitability of the preference-based instruments for measuring outcomes in palliative care using the ISOQOL, minimum standards for patient-reported outcome measures (conceptual and measurement model, reliability, content validity, construct validity, responsiveness, interpretability of scores, translation of measure, patient and investigator burden),43 and the CREATE checklist (descriptive system, health states values, sampling, preference data collection, study sample, modelling, scoring algorithm).44 The ISOQOL minimum standards were chosen as these standards were developed from a systematic review of published and unpublished guidance on patient-reported outcome measures, including the COnsensus-based Standards for the selection of health Measurement Instruments (COSMIN).46 To the authors' knowledge, the CREATE checklist is the only published guidance on what key components should be reported in a valuation study.44 Information on how the contents of the instruments were developed, psychometric properties and valuation will be used to assess the suitability of the instruments for the palliative setting; instruments will be scored on whether the domains or dimensions were developed using input from informal caregivers of people receiving palliative care (yes/no) and whether each of the reporting checklist items has been evaluated for this population (if yes, then a score of one will be allocated) and a total score calculated. Any discrepancies will be identified and resolved by consensus among the research team.

Data synthesis

A narrative summary of the included studies and instruments will be provided in accordance with recent guidance from the Cochrane Collaboration.47 Four tables summarising the main features of the included studies, instrument descriptions, psychometric properties and valuation will be presented (see ‘Data collection’).48 Using these data, similarities and differences between the instruments will be described, including their suitability for measuring care-related outcomes in palliative care and possible reasons for variations between instruments will be explored, for example, variability in study populations and method of content development. Recommendations for practice on selection of instruments for measuring care-related outcomes in palliative care economic analyses will be provided.

As the total number of preference-based instruments measuring care-related outcomes is anticipated to be small, to minimise reporting bias, the relevant development groups will be contacted to make sure no crucial information or developments have been missed.

Ethics and dissemination

This is a planned systematic review of published literature. Therefore, ethics approval to conduct this research is not required. The systematic review protocol is registered with the PROSPERO, registration number CRD42016034188. Findings will be presented at leading palliative care and health economic conferences and published in a peer-reviewed journal.

Acknowledgments

The coauthors warmly thank members of the Netherlands Institute for Health Services Research Scientific Committee for their constructive feedback on an earlier version of this manuscript.

References

View Abstract

Footnotes

  • Contributors NM led the conception and design of the work with input from all coauthors. NM drafted the work and the coauthors revised the protocol and manuscript critically for important intellectual content. All coauthors approved the final version to be published and are accountable for all aspects of the work. NM is the guarantor for the overall content.

  • Funding Funding for this study is provided by a Flinders University Early Career grant (grant number 01.574.39798) and discretionary research funds held by the respective academic departments. The funders have no role in the study design, data collection and analysis, or decision to publish.

  • Competing interests All members of the review team have been involved to some degree in the development, valuation, validation and application of the Carer Experience Scale (CES) and Care-related Quality of Life instrument (CarerQoL), two preference-based instruments for measuring care-related quality of life.

  • Provenance and peer review Not commissioned; externally peer reviewed.