Article Text

Protocol
Psychometric properties of self-reported measures of active ageing: a systematic review protocol using COSMIN methodology
  1. Shuyu Han1,
  2. Mengmeng Ji1,
  3. Minmin Leng1,
  4. Jia Zhou1,
  5. Zhiwen Wang1,2
  1. 1School of Nursing, Peking University, Beijing, China
  2. 2Peking University Health Science Centre for Evidence-Based Nursing A Joanna Briggs Institute Affiliated Group, Beijing, China
  1. Correspondence to Dr Zhiwen Wang; wzwjing{at}sina.com

Abstract

Introduction Evaluation of active ageing is helpful in making public health policies, improving older adults’ quality of life and confronting global ageing challenges. However, there remains no systematic review to summarise all active ageing assessment tools and report their psychometric properties. This study aims to apply the COSMIN (COnsensus-based Standards for the selection of health Measurement INstruments) methodology to review the psychometric properties of active ageing assessment tools obtained by multiple validation studies.

Methods and analysis Studies that aim to validate patient-reported outcome measures (PROMs) of active ageing in older adults aged 60 and over and report one or more psychometric properties are eligible for this systematic review. We will consider studies conducted in any country or setting published either in English or Chinese. The following databases will be searched: PubMed, EMBASE, CINAHL, Web of Science, Cochrane Library, ProQuest Dissertations and Theses, CNKI, and Wanfang. Data extraction, assessment of methodological quality, summary of the quality of PROMs and grading of quality of evidence will be conducted according to the COSMIN methodology.

Ethics and dissemination This study will not collect individual data. Therefore, obtaining ethical approval is not applicable. The results will be disseminated through peer-reviewed journals and conferences and will help researchers choose active ageing assessment tools.

PROSPERO registration number CRD42021287395.

  • protocols & guidelines
  • public health
  • health policy
http://creativecommons.org/licenses/by-nc/4.0/

This is an open access article distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited, appropriate credit is given, any changes made indicated, and the use is non-commercial. See: http://creativecommons.org/licenses/by-nc/4.0/.

Statistics from Altmetric.com

Request Permissions

If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.

Strengths and limitations of this study

  • This is the first systematic review that will identify patient-reported outcome measures that assess active ageing in older adults and will provide a comprehensive picture of their psychometric properties.

  • The COSMIN (COnsensus-based Standards for the selection of health Measurement INstruments) methodology will be applied in this study to comprehensively report the psychometric properties of each assessment tool.

  • This systematic review will follow the most up-to-date Preferred Reporting Items for Systematic Reviews and Meta-Analyses 2020, and the protocol will follow the Preferred Reporting Items for Systematic Review and Meta-Analysis Protocols 2015.

  • This systematic review will only include studies published in English and Chinese and this language restriction may bias the results.

Introduction

Driven by declining fertility and increasing longevity, population ageing has become a significant challenge throughout the world.1 According to the World Population Prospects 2019, by 2050 the number of persons aged 65 or over is estimated to more than double compared with 2019 and will reach up to 1.5 billion, increasing from 9% (2019) to 16% (2050).2 In China, as high as 18.7% and 13.5% of the population in 2020 were persons aged 60 or over and 65 or over, respectively.3 By 2050, persons aged 65 or over may reach 0.38 billion and account for nearly 30% of the whole Chinese population.4 Population ageing may have implications for nearly all sectors of the society, including labour and financial markets, demand for goods and services such as housing, transportation and social protection, as well as family structures and intergenerational ties.5 Therefore, more attention and efforts should be put on this global issue.

The WHO defines ‘active aging’ as ‘the process of optimizing opportunities for health, participation and security in order to enhance quality of life as people age’.6 The word ‘active’ refers to continuous participation in the social, financial, political, spiritual and cultural life, and not only in the ability to work and be physically active. Older adults who are unable to work and those living with sickness or disabilities can remain active, while contributing to their families, counterparts, communities and nations.7 Active ageing provides a more positive perspective of older adults, that is, regarding them as valuable resources instead of a burden to the society.

Active ageing has become a global goal under the current ageing situation.8 Evaluation of active ageing will be helpful in making public health policies, improving older adults’ quality of life and confronting global ageing challenges. Since accurate and reproducible assessment tools are prerequisite to robust and reliable results, it is significant to choose an acceptable patient-reported outcome measure (PROM) with strong psychometric properties to assess active ageing. Several assessment tools have been validated to assess active ageing, such as the Active Aging Scale for Thai Adults,8 the Active Aging Index9 and the University of Jyvaskyla Active Aging Scale.10 However, these assessment tools were developed in different situations. Their validation also varied significantly and none of them is considered the gold standard. There remains no systematic review that summarises all active ageing assessment tools and reports their psychometric properties. Therefore, this study aims to adopt the COSMIN (COnsensus-based Standards for the selection of health Measurement INstruments) approach11 to comprehensively report the psychometric properties of active ageing assessment tools obtained by multiple validation studies. Our attempt will be helpful in selecting PROMs of active ageing both in research and in clinical practice.

Methods and analysis

This protocol is reported according to the Preferred Reporting Items for Systematic Review and Meta-Analysis Protocols 2015.12 This systematic review will follow the COSMIN methodology for conducting systematic reviews of psychometric properties11 and the Preferred Reporting Items for Systematic Reviews and Meta-Analyses 2020 statement.13 We also have submitted registration materials prior to the literature search in the International Prospective Register of Systematic Reviews.14

Search strategy

We will follow the Peer Review of Electronic Search Strategies (PRESS)15 to develop the search strategy. First, two researchers (MJ and SH) will independently conduct the primary search in PubMed using both free terms and Medical Subject Headings (MeSH) terms to develop the search words and will fill out the updated PRESS 2015 Guideline Assessment Form.15 Second, a third researcher (ML) will revise the two forms and assess the inter-rater reliability using the PRESS 2015 Guideline Evidence-Based Checklist.1 Third, the identified search strategy will be confirmed through a discussion among three researchers. Fourth, a researcher (MJ) will conduct literature search using the identified search strategy in all included databases. The entire process will also be checked by another researcher (SH). Fifth, a researcher (MJ) will review the references of all the included studies to identify eligible literature not found using the search strategies.

We will search the following databases: PubMed, EMBASE, CINAHL, Web of Science, Cochrane Library, ProQuest Dissertations and Theses, CNKI, and Wanfang. The COSMIN filter16 will be applied in feasible databases. The detailed search strategies for PubMed are available in online supplemental appendix 1.

Inclusion criteria

Population

All adults aged 60 years and older in any country or setting are eligible populations for this systematic review. To provide a comprehensive description of PROMs of active ageing, we will not limit any possible issues that could explain inconsistencies between results, including but not limited to older adults living with or without any disease, institutionalised or non-institutionalised older adults, etc.

Instruments

We will include any type of measurement tools, including but not limited to questionnaires, checklists and scales. They can be self-report, interview-based and proxy report. PROMs that measure active ageing either as a whole or as a subscale will be considered.

Construct

We will apply the definition of ‘active ageing’ released by the WHO in 2002, which is the process of optimising opportunities for health, participation and security in order to enhance quality of life as people age.6 Obviously, health, participation and security are three important domains of active ageing. There are several terms similar to active ageing, such as healthy ageing, productive ageing, ageing well, optimal ageing, positive ageing and successful ageing. They may be used interchangeably with active ageing.17 Although active ageing is the only construct in this study, we will still expand our search strategy according to these similar terms, which is consistent with Kenbubpha et al’s study.18

Outcomes

We will involve any study that evaluated one or more psychometric properties of a PROM for active ageing according to the COSMIN methodology. Common psychometric property indicators include content validity (relevance, comprehensiveness and comprehensibility), structural validity (comparative fit index, Tucker-Lewis index, root mean square error of approximation or standardised root mean residuals), internal consistency (Cronbach’s alpha coefficients), reliability (intraclass correlation coefficient (ICC) or weighted kappa statistics), measurement error (smallest detectable change, limits of agreement or minimal important change), hypothesis testing for construct validity (whether the result is in accordance with the hypothesis), cross-cultural validity/measurement invariance (differential item functioning), criterion validity (correlation with gold standard or area under the curve) and responsiveness (area under the curve).

Types of studies

Any original study, such as cross-sectional and longitudinal studies, that developed or translated PROMs and reported psychometric property indicators using their raw data will be included. We only included literature and grey literature in English and Chinese after 2002 (the year WHO launched the definition of active ageing). The specific dates of coverage were January 2002 and February 2022.

Study selection

We will import all the references searched from the databases and remove duplicates in NoteExpress. Two researchers (MJ and SH) who have been trained in evidence-based methodologies will independently filter the references, first through reading the title and abstract and then through review of full text. Every excluded study will be recorded reasons according to inclusion criteria. A third researcher (ZW) will resolve disagreements in the whole study selection process.

Data extraction

We will extract data on the characteristics of PROMs as well as the study characteristics. As shown in table 1, the characteristics of PROMs will include title, target population, mode of administration (self-report, interview-based or proxy report), recall period, subscale and item number, range of scores, original language, theory, and available translations. We also have designed table 2 to present the study characteristics, which include author (year), PROM, country, PROM language, study design, sample size and participants, and year of development/validation. Two researchers (MJ and SH) will independently extract data and information using tables 1 and 2. A third researcher (ZW) will be invited to discuss any inconsistency and disagreement.

Table 1

PROM characteristics

Table 2

Study characteristics

Assessment of methodological quality

Two researchers (MJ and SH) will independently assess the methodological quality of each involved study using the COSMIN risk of bias checklist.19 A third researcher (ZW) will be invited to discuss any inconsistency and disagreement. The COSMIN risk of bias checklist has 10 domains and 116 items. It is used to assess methodological quality in terms of PROM development, content validity, structural validity, internal consistency, cross-cultural validity/measurement invariance, reliability, measurement error, criterion validity, hypotheses testing for construct validity and responsiveness. Each item has five options, namely ‘very good’, ‘adequate’, ‘doubtful’, ‘inadequate’ and ‘not applicable’. The ‘worst score counts’ principle is used to determine the overall quality of relative domains.

Summarising the quality of PROMs

Two researchers (MJ and SH) will independently summarise the quality of psychometric properties for each PROM according to the COSMIN criteria.20 A third researcher (ZW) will be invited to discuss any inconsistency and disagreement. The COSMIN criteria rates the psychometric properties of PROMs, including structural validity, internal consistency, cross-cultural validity/measurement invariance, reliability, measurement error, criterion validity, hypotheses testing for construct validity and responsiveness, as sufficient (+), insufficient (−) or indeterminate (?). The specific criteria for good measurement properties are shown in table 3. For instance, reliability will be rated as ‘+’ if the ICC or weighted kappa is ≥0.70, ‘−’ if the ICC or weighted kappa is <0.70, and ‘?’ if the ICC or weighted kappa is not reported. We will first rate each single study on psychometric properties. Then we will synthesise the results and come to an overall conclusion on the quality of the PROM’s psychometric properties as a whole according to the specific situation. If the ratings for each measure are consistent, the results from different studies on one psychometric property will be qualitatively summarised or pooled through meta-analysis and finally be rated as ‘+’ or ‘−’. A meta-analysis will be conducted according to the availability of quantitative data of psychometric properties. For instance, ICC between different studies that assess the same PROM may be pooled by calculating the weighted means (according to the sample size in each study) and 95% CI. We will not apply systematic review data management software considering we may not have much quantitative data synthesis work. On the other hand, if the ratings are inconsistent, we will explore explanations for the inconsistency between studies according to the context of different studies. Ratings will be provided in subgroups, such as different languages of the PROM, different participant characteristics (such as older adults living with or without any disease), etc, if the explanations are reasonable. If there is not enough information to explain the inconsistency, the overall rating will be rated as ‘?’.

Table 3

Criteria for good measurement properties

Grading the quality of evidence

Four researchers (MJ, SH, ML and JZ) will independently grade the quality of evidence, that is, the confidence that the pooled or summarised result is trustworthy, according to the modified Grading of Recommendations, Assessment, Development and Evaluation system.21 A fifth researcher (ZW) will be invited to discuss any inconsistency and disagreement. Using four factors to determine the quality of evidence (risk of bias, inconsistency, indirectness and imprecision), each psychometric property of PROM is graded as high, moderate, low or very low evidence.

Plans in case of possible amendments

If we need to amend this protocol, we will give the date of each amendment, describe the change and provide the rationale in this section. Changes will not be incorporated into the protocol. A researcher (SH) will ultimately be responsible for reporting any necessary amendments in a tabular format (table 4).

Table 4

Amendment notes

Ethics statements

Patient consent for publication

References

Supplementary materials

  • Supplementary Data

    This web only file has been produced by the BMJ Publishing Group from an electronic file supplied by the author(s) and has not been edited for content.

Footnotes

  • Contributors Study design: MJ. Search strategy, study selection, data extraction, assessment of methodological quality, data analysis: MJ, SH, ZW. Grading the quality of evidence: MJ, SH, ML, JZ, ZW. Supervision: ZW. Writing - original draft preparation: SH. Writing - review and editing: ML, JZ, ZW. Funding acquisition: ZW. All authors have read and agreed to the published version of the manuscript.

  • Funding This study was funded by the major projects of the National Social Science Foundation (21ZDA107). This funding provides scholarship for coauthors. The funder will have no input on protocol development, review conduct, data analysis and interpretation, and dissemination of the final report.

  • Competing interests None declared.

  • Provenance and peer review Not commissioned; externally peer reviewed.

  • Supplemental material This content has been supplied by the author(s). It has not been vetted by BMJ Publishing Group Limited (BMJ) and may not have been peer-reviewed. Any opinions or recommendations discussed are solely those of the author(s) and are not endorsed by BMJ. BMJ disclaims all liability and responsibility arising from any reliance placed on the content. Where the content includes any translated material, BMJ does not warrant the accuracy and reliability of the translations (including but not limited to local regulations, clinical guidelines, terminology, drug names and drug dosages), and is not responsible for any error and/or omissions arising from translation and adaptation or otherwise.