You are here

  • Home
  • Archive
  • Volume 11, Issue 9
  • Accuracy and cost-effectiveness of different screening strategies for identifying undiagnosed COPD among primary care patients (≥40 years) in China: a cross-sectional screening test accuracy study: findings from the Breathe Well group

Article Text

Article menu
Respiratory medicine
Original research
Accuracy and cost-effectiveness of different screening strategies for identifying undiagnosed COPD among primary care patients (≥40 years) in China: a cross-sectional screening test accuracy study: findings from the Breathe Well group
  1. Zihan Pan1,2,
  2. Andrew P Dickens3,
  3. Chunhua Chi1,
  4. Xia Kong1,
  5. Alexandra Enocson3,
  6. Brendan G Cooper3,4,
  7. Peymané Adab3,
  8. Kar Keung Cheng3,5,
  9. Alice J Sitch3,6,
  10. Sue Jowett3,
  11. Rachel Adams3,
  12. Jaime Correia-de-Sousa7,8,9,
  13. Amanda Farley3,
  14. Nicola K Gale10,
  15. Kate Jolly3,
  16. Mariam Maglakelidze11,12,
  17. Tamaz Maglakelidze11,
  18. Sonia M Martins13,
  19. Katarina Stavrikj14,
  20. Rafael Stelmach15,
  21. Alice M Turner3,
  22. Sian Williams8,
  23. Rachel E Jordan3
  1. 1General Practice Department, Peking University First Hospital, Beijing, People's Republic of China
  2. 2Pulmonary and Critical Care Medicine, Peking University Third Hospital, Beijing, People's Republic of China
  3. 3Institute of Applied Health Research, University of Birmingham, Birmingham, West Midlands, UK
  4. 4Lung Investigation Unit, University Hospitals Birmingham NHS Foundation Trust, Queen Elizabeth Hospital Birmingham, Birmingham, UK
  5. 5General Practice Development and Research Centre, Peking University Health Science Centre, Beijing, People's Republic of China
  6. 6NIHR Birmingham Biomedical Research Centre, University Hospitals Birmingham NHS Foundation Trust and University of Birmingham, Birmingham, UK
  7. 7Life and Health Sciences Research Institute (ICVS), School of Medicine, University of Minho, Braga, Portugal
  8. 8International Primary Care Respiratory Group, London, UK
  9. 9ICVS/3B's, PT Government Associate Laboratory, Braga/Guimarães, Portugal
  10. 10Health Services Management Centre,School of Social Policy, College of Social Sciences, University of Birmingham, Birmingham, UK
  11. 11Georgian Respiratory Association, Georgia
  12. 12Petre Shotadze Tbilisi Medical Academy, Georgia
  13. 13Family Medicine, ABC Medical School, Sao Paolo, Brazil
  14. 14Center for Family Medicine, Faculty of Medicine, Ss.Cyril and Methodius University in Skopje, North Macedonia
  15. 15Pulmonary Division, Heart Institute (InCor), Hospital das Clinicas da Faculdade de Medicina da, Uinversidade de Sao Paulo, Sao Paulo, Brazil
  1. Correspondence to Dr Chunhua Chi; chichunhua2012{at}qq.com; Dr Peymané Adab; p.adab{at}bham.ac.uk

Abstract

Objectives To examine the accuracy and cost-effectiveness of various chronic obstructive pulmonary disease (COPD) screening tests and combinations within a Chinese primary care population.

Design Screening test accuracy study.

Setting Urban and rural community health centres in four municipalities of China: Beijing (north), Chengdu (southwest), Guangzhou (south) and Shenyang (northeast).

Participants Community residents aged 40 years and above who attended community health centres for any reason were invited to participate. 2445 participants (mean age 59.8 (SD 9.6) years, 39.1% (n=956) male) completed the study (February–December 2019), 68.9% (n=1684) were never-smokers and 3.6% (n=88) had an existing COPD diagnosis. 13.7% (n=333) of participants had spirometry-confirmed airflow obstruction.

Interventions Participants completed six index tests (screening questionnaires (COPD Diagnostic Questionnaire, COPD Assessment in Primary Care To Identify Undiagnosed Respiratory Disease and Exacerbation Risk (CAPTURE), Chinese Symptom-Based Questionnaire (C-SBQ), COPD-SQ), microspirometry (COPD-6), peak flow (model of peak flow meters used in the study (USPE)) and the reference test (ndd Easy On-PC).

Primary and secondary outcomes Cases were defined as those with forced expiratory volume in one second (FEV1)/forced vital capacity (FVC) below the lower limit of normal (LLN-GLI) on the reference test. Performance of individual screening tests and their combinations was evaluated, with cost-effectiveness analyses providing cost per additional true case detected.

Results Airflow measurement devices (sensitivities 64.9% (95% CI 59.5% to 70.0%) and 67.3% (95% CI 61.9% to 72.3%), specificities 89.7% (95% CI 88.4% to 91.0%) and 82.6% (95% CI 80.9% to 84.2%) for microspirometry and peak flow, respectively) generally performed better than questionnaires, the most accurate of which was C-SBQ (sensitivity 63.1% (95% CI 57.6% to 68.3%) specificity 74.2% (95% CI 72.3% to 76.1%)). The combination of C-SBQ and microspirometry used in parallel maximised sensitivity (81.4%) (95% CI 76.8% to 85.4%) and had specificity of 68.0% (95% CI 66.0% to 70.0%), with an incremental cost-effectiveness ratio of £64.20 (CNY385) per additional case detected compared with peak flow.

Conclusions Simple screening tests to identify undiagnosed COPD within the primary care setting in China is possible, and a combination of C-SBQ and microspirometry is the most sensitive and cost-effective. Further work is required to explore optimal cut-points and effectiveness of programme implementation.

Trial registration number ISRCTN13357135.

  • general medicine (see internal medicine)
  • respiratory medicine (see thoracic medicine)
  • chronic airways disease

Data availability statement

Data are available on reasonable request. Data are available upon reasonable request. All data requests should be submitted to authors CC and PA for consideration. Access to anonymised data may be granted following review.

http://creativecommons.org/licenses/by-nc/4.0/

This is an open access article distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited, appropriate credit is given, any changes made indicated, and the use is non-commercial. See: http://creativecommons.org/licenses/by-nc/4.0/.

https://doi.org/10.1136/bmjopen-2021-051811

Statistics from Altmetric.com

    Request Permissions

    If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.

    Strengths and limitations of this study

    • Defining airflow obstruction according to the lower limit of normal increased the likelihood that identified cases were true chronic obstructive pulmonary disease.

    • Recruiting participants from both urban and rural community hospitals maximised the generalisability of our findings to primary care patients.

    • This study did not explore optimal cut-points for index tests, thus, further work is required.

    • While the study was conducted in four geographically disparate municipalities, our findings may not be generalisable to all adults ≥40 years old in China.

    Introduction

    Chronic obstructive pulmonary disease (COPD) is a common long-term condition characterised by persistent respiratory symptoms and airflow limitation.1 Nearly one-third of the 3.2 million annual global deaths from COPD are from China2 3 where COPD ranks among the top three leading causes of death with associated direct medical costs of 118% of local average annual income.4 COPD develops slowly, resulting in delays in symptom recognition and high rates of underdiagnosis. Ninety per cent of the estimated 100 million people with COPD in China are undiagnosed; slightly higher than the 60%–80% underdiagnosis rate worldwide.5–9 Symptom reporting and recognition are lower in China, with 60% of diagnosed patients not reporting symptoms such as cough, expectoration and wheeze.10

    While COPD screening programmes are not currently endorsed in the USA and UK,11–13 considering the high proportion and heavy burden of undiagnosed disease,4 early identification is being prioritised in China. National policies recommend screening for undiagnosed COPD14, but do not specify which screening tests to use. Furthermore, though spirometry is required for clinical diagnosis,1 it is not widely available in primary care settings in China. Therefore, screening could reduce the numbers needing spirometry referral.

    Globally, various COPD screening tools have been developed, including questionnaires and airflow measurement devices.15–17 However, accuracy studies were mainly conducted in Western countries and have not been validated in a Chinese population where the distribution and underlying causes of undiagnosed COPD may differ. Furthermore, the majority of Chinese studies have used secondary or tertiary care COPD populations rather than people from community settings.18 19 Finally, the cost-effectiveness of different screening tests have not been previously estimated in China; a crucial consideration given the high prevalence of COPD in this middle-income country.

    We examined the accuracy and cost-effectiveness of various screening tests and combinations within a Chinese primary care population.

    Methods

    Study design and participants

    We conducted a cross-sectional, multicentre study to evaluate the accuracy and cost-effectiveness of various COPD screening tests and test combinations in primary care in China. Full details of participant recruitment and study assessments are described in the published protocol.20

    Participants were recruited from one urban and one rural community health centre (CHC) in each of four municipalities: Beijing (North China), Chengdu (southwest China), Guangzhou (south China) and Shenyang (northeast China) (figure 1). Between February and December 2019, community-dwelling residents aged 40 years and above who attended CHCs for any reason were invited to participate, either directly by the attending clinician, or through poster or social media (WeChat) advertisements. Participants who were unable to give informed consent, had contraindications for spirometry or unable to perform the test for other reasons were excluded.

    Figure 1
    Figure 1

    Map of breathe Well-China research sites. CHSC, Community Health Service Center.

    Eligible participants provided informed consent at the start of the assessment visit, prior to height and weight measurement and completion of all index and reference tests. Participants also completed a study questionnaire concerning demographics, smoking status, exposures, medical diagnoses, respiratory symptoms21 and quality of life.22 Data were entered into a secure online Research Electronic Data Capture database.23 24

    Participants with airflow obstruction on the reference test were offered health education, smoking cessation advice, influenza vaccination and inhalers if relevant, or referred to tertiary hospitals for further treatment including pharmacotherapy or pulmonary rehabilitation.

    Study assessment

    Index tests

    The six index tests included four screening questionnaires: COPD Diagnostic Questionnaire (CDQ, cut-point ≥20),16 25 COPD Assessment in Primary Care To Identify Undiagnosed Respiratory Disease and Exacerbation Risk (CAPTURE) (cut-point ≥2),26 COPD Screening Questionnaire (COPD-SQ, cut-point ≥16)19 and the Chinese Symptom-Based Questionnaire (C-SBQ, cut-point ≥17)18 and two airflow measurement devices: microspirometry (Vitalograph COPD-6, cut-point for positive test forced expiratory volume in one second (FEV1)/FEV6<0.78),27 28 peak flow (model of peak flow meters used in the study (USPE), cut-point <350 L/min men, <250 L/min women).26 Questionnaires were selected to maximise symptom capture and minimise item duplication, while allowing comparison of the most relevant questionnaires (online supplemental appendix 1). Previously defined cut-points were used to identify participants at risk of COPD.

    Trained researchers provided instructions before participants performed three prebronchodilator manoeuvres with each airflow measurement device. The order of administering peak flow or microspirometry alternated by participant, and the best forced expiratory volume in one second (FEV1) and FEV6 measure for each device were used for analyses, irrespective of which attempt they came from.

    Participants completed the four screening questionnaires immediately after administration of a bronchodilator (400 ug, Salbutamol). Questionnaires were intended to be self-completed, although researchers were available to assist if needed.

    Reference test

    The reference test was quality diagnostic spirometry (ndd Easy On-PC), performed 20–60 min after bronchodilation. Spirometry was administered by a second researcher not involved in the index tests and blind to their results. Participants performed a minimum of 3 blows, and a maximum of 6, until repeatability within 100mls or 5%.29 Flow volume curves were classified according to the American thoracic Society/European Respiratory Society (ERS)29 criteria. Tests with at least three curves meeting these criteria, were ‘good’. ‘Acceptable’ tests contained at least one curve which concurred with the criteria, allowing accurate assessment of forced expiratory volume in one second (FEV1). If accurate assessment was not possible the curves were classified as ‘unacceptable’, and the test was excluded from analysis. All traces were over-read for quality by one of three independent respiratory experts and graded according to standard criteria,29 without knowledge of the index test results.

    Airflow obstruction was defined as post-bronchodilator forced expiratory volume in one second (FEV1)/forced vital capacity (FVC) ratio below the lower limit of normal (LLN) using the Global Lung Initiative (GLI) equations.

    Sample size

    The Alonzo method30 for paired test accuracy studies was used to calculate the sample size. Assuming independence of tests and prevalence of 12%, we required 1622 participants to detect a difference in sensitivity of 10% (95% vs 85%16 26 31 32 for the comparison of CAPTURE and peak flow for example) with 90% power. With lower test sensitivity (90% vs 80%) 2279 participants are needed to detect this difference with 90% power.

    Statistical analysis

    The diagnostic performance of each index test was investigated by presenting 2×2 tables and calculating the sensitivity, specificity, positive predictive value and negative predictive value with 95% CIs. Comparative test accuracy was assessed by calculating the difference in sensitivity and specificity, presenting 95% CIs and using McNemar’s test.

    The primary analysis compared the sensitivity and specificity between the CAPTURE screening questionnaire and the peak flow meter. The comparison was specified a priori as CAPTURE was rigorously developed, accounted for exposures other than smoking and was intended for use in conjunction with peak flow. Secondary analyses evaluated the comparative performance of all other individual index tests, as well as plausible combination test strategies. Test strategies were formed using two predetermined combinations for appropriate pairs of individual index tests (questionnaires and lung function tests); first, to maximise sensitivity, where a participant with a positive result for either index test would be positive for the strategy (parallel testing strategy) and second, to maximise specificity, where a participant would need a positive result on both index tests to be positive for the strategy (serial testing strategy).

    All analyses were conducted in Stata V.15.

    Economic analysis

    We conducted a cost-effectiveness analysis to calculate the cost per additional case detected for all tests and combination strategies. The strategies were ordered by the number of true cases detected, from least to greatest and the principle of dominance was applied to eliminate redundant strategies (where they were more costly and less effective). Each test was then compared with the next best alternative. For the purpose of this paper, the individual index tests and the combination strategy with the highest sensitivity were compared.

    The unit costs and quantity of any equipment, medication and consumables required, staff time (and salary costs) to deliver each individual test and use of facilities were determined to calculate the healthcare costs of delivering each screening test/strategy. Each individual test was timed at a sample of assessment clinics to estimate an overall mean time and range for each test. Equipment costs were depreciated (at 3.5% a year) over the estimated lifespan of the equipment (ranging from 1 to 6 years). Cost per patient visit was calculated assuming the equipment would be used for 12 000 patients per clinic per year. It was also assumed that positive cases would be confirmed with quality diagnostic spirometry (assuming 4000 patients/year). Costs were calculated in UK£ for a price year of 2019, and converted to Chinese Yuan (¥) using Purchasing Power Parities33 with a conversion rate of 6.0 (online supplemental appendix 2).

    The paper follows the Standards for Reporting Diagnostic accuracy studies (STARD) guidance34 for reporting studies of diagnostic accuracy.

    Results

    Sample

    We invited 6198 eligible people to the study. A total of 2560 (41.3%) consented, of whom 25 withdrew and 90 were excluded from analysis (86 because of incorrect inhaler technique, four had unusable spirometry data). A total of 2445 participants with complete data on all index and reference test were included in the final analysis (figure 2). Approximately two-thirds (68.0%) were recruited through their attending clinician, 24.5% via advertisements and 7.5% through word of mouth.

    Figure 2
    Figure 2

    Study flow chart.

    The mean age of participants was 59.8 (SD 9.6), 39.1% (n=956) were male, two-thirds (n=1684, 68.9%) were never smokers and over half lived in an urban area (1338, 54.7%). 46.7% had no diagnosed conditions (n=1142); the most common diagnosed condition was hypertension (n=842, 34.4%), 3.6% (n=88) had an existing COPD diagnosis and 8.4% (n=205) had an existing chronic bronchitis/emphysema diagnosis (table 1). 99.8% of participants had an acceptable usable spirometry (with 63.3% (n=1547) defined as good). 13.6% (n=333) of participants had spirometry-confirmed airflow obstruction using the LLN criteria, of whom 175 (52.5%) had moderate to severe obstruction, that is, Global Initiative for Chronic Obstructive Lung Disease (GOLD) stage II or above.1 Those with airflow obstruction were older (63.5 vs 69.2 years) and more likely to be male (59.8% vs 35.8%), have a positive smoking history (55.5% vs 27.3%) and childhood respiratory infections (14.7% vs 7.8%) compared with those without airflow obstruction. Respiratory symptoms of wheeze, productive cough or breathlessness (Modified British Medical Research Council (mMRC) ≥2) were reported by 52.9% of those with airflow obstruction (66.3% of those who were GOLD stage II or above), and 25.1% of those without. Among participants with no previously reported COPD diagnosis, the prevalence of obstruction was 9.9% (n=218), of whom 89 (40.8%) were GOLD stage II or above. Using the forced expiratory volume in one second (FEV1)/forced vital capacity (FVC)<0.7 criteria,1 17.4% (n=425) of all participants had airflow obstruction.

    View this table:
    Table 1

    Characteristics of study participants

    Performance of individual tests and screening strategies

    Among the screening questionnaires, the C-SBQ had the highest sensitivity in detecting airflow obstruction at 63.1% (95% CI 57.6% to 68.3%), CAPTURE the lowest sensitivity (51.7% (95% CI 46.1% to 57.1%), with CDQ (55.0% (95% CI 49.4% to 60.4%)) similar to COPD-SQ (55.3% (95% CI 49.7% to 60.7%)). The CDQ had the highest specificity (78.6% (95% CI 76.8% to 80.4%)). CAPTURE compared with CDQ had the most obvious difference in specificity of 8.4% (−10.7% to -6.0%; p<0.001) ((tables 2–4)).

    View this table:
    Table 2

    Accuracy of index tests and strategies

    View this table:
    Table 3

    Comparative sensitivity for individual tests

    View this table:
    Table 4

    Comparative specificity for individual tests

    Both peak flow and microspirometry devices had higher sensitivity and specificity compared with all questionnaires (tables 3 and 4). Peak flow had the highest sensitivity (67.3%) and microspirometry the highest specificity (89.7%) (tables 3 and 4).

    Of the combined screening strategies, C-SBQ combined with airflow measurement devices in parallel (ie, recorded as screen-positive if either test was positive) had the best performance, with sensitivities of 80.5%–81.4% and specificities of 65.5%–68%. Parallel strategies (requiring either test to be positive) optimised sensitivity and serial strategies (requiring both tests to be positive) optimised specificity. Taking CAPTURE and peak flow as an example, a parallel combination had sensitivity of 77.2% compared with 41.7% in serial combination, while the specificity significantly increased from 59.1% to 93.7% (table 2).

    Overall, test performance was slightly higher when screening questionnaires were combined with microspirometry rather than peak flow. Strategies including CAPTURE performed less well compared with those based on other questionnaires. Parallel strategies including the C-SBQ had the highest sensitivities, whereas those based on the CDQ had the highest specificity (tables 2 and 3). Full comparisons of serial and parallel strategies are described in online supplemental appendix 3.

    Cost-effectiveness of preferred screening tests

    Analysis of the C-SBQ parallel strategies revealed that the most costly strategy was the combination of C-SBQ and microspirometry, but this also detected the most true cases (table 5). The C-SBQ alone was dominated by microspirometry (more costly, less effective). The incremental cost-effectiveness ratio for C-SBQ and microspirometry (vs peak flow) was greatest at £64.20 (CNY 385.20), but could be considered cost-effective if the threshold willingness to pay for an additional true case detected in China is at least CNY 385.

    View this table:
    Table 5

    Per patient cost, effectiveness and cost-effectiveness of selected screening strategies

    Discussion

    This is the first study assessing the accuracy of individual screening tools and their combinations to identify undiagnosed COPD within Chinese community populations. We showed that the combination of a simple questionnaire and airflow measurement device could adequately identify adults requiring diagnostic spirometry. Our overall findings were consistent with a meta-analysis of studies from other countries35 that airflow measurement devices were more accurate than questionnaires, and that combinations of screening tests improved ability to detect COPD in primary care. Within single test strategies, microspirometry had the best performance (sensitivity 64.9%, specificity 89.7%). For combination strategies, the C-SBQ and microspirometry used in parallel, maximised sensitivity (81.4%) with reasonable specificity (68%) and would be deemed cost-effective if the Chinese health service was willing to pay ≥CNY385 per additional case detected.

    C-SBQ had the highest sensitivity of all screening questionnaires in our study, with comparable specificity. However, accuracy of the C-SBQ was worse than reported in the validation paper of the Chinese tool, with lower sensitivity (63.1% vs 82.5%) but slightly higher specificity (74.2% vs 72.9%). The observed discrepancy may be due to differences in the spectrum of clinical characteristics36 (community sample rather than tertiary care population in previous study) and airflow obstruction criteria used (we used the LLN rather than the GOLD criteria).

    Inclusion of the C-SBQ and the CDQ from which it was derived allowed direct comparison of the two measures, confirming that C-SBQ was more accurate for use in Chinese community populations when prioritising sensitivity (sensitivity 63.1% vs 55.0% with slightly lower specificity 74.2% vs 78.6%).

    Direct comparison between our findings and those of previous studies was limited by differences in populations and pretest probabilities. COPD among never smokers is more common in China than in western countries and we included never smokers in this study to maximise the range of potential COPD risk factors represented for example, environmental exposures such as dust, biomass fumes and passive smoking, as well as active smoking. Inevitably this contributed to the lower test performance observed. Furthermore, the CAPTURE questionnaire was originally designed to detect more severe COPD. The different case definition in our study therefore precludes direct comparison with previous studies (we plan to report accuracy for detecting more severe clinically significant COPD in a future publication).

    Our test accuracy study has highlighted the strengths of different screening tests, which can be used to evaluate future screening programmes. We recruited a large number of participants from urban and rural settings in four geographically diverse municipalities in China, and the proportion of never smokers in our sample (68.9%) was similar to that found in a recent nationally representative cross-sectional study in China (71.4%).;0 which included a younger population (age 20+). We demonstrated that lung function tests and diagnosis of COPD can be implemented by general practitioners (GPs) and nurses after a structured training course with regular quality over reading and feedback, as evidenced by 99% usable spirometry and consistently good quality spirometry in most GP sites. The fully paired study design enabled us to compare the accuracy of multiple index tests and strategies. Alternating the order of peak flow and microspirometry tests during assessments decreased the potential training effect that could have been introduced when conducting consecutive lung function tests in a research context.

    We defined the reference test as airflow obstruction regardless of clinical symptoms, to reflect the methods of previous studies and also account for the differing symptom profile reported among Chinese populations, where chronic respiratory symptoms are less recognised. In our study, just over half of those with obstruction were likely to benefit from some treatment due to reported symptoms, and a further quarter of those obstructed would benefit from smoking cessation advice as they had a positive smoking history but no respiratory symptoms.

    Accuracy might have differed if the GOLD criteria were used, though unlikely to substantially change the comparative performance of the tests. Defining airflow obstruction according to the LLN criteria increased the likelihood that participants testing positive on study spirometry were true COPD cases, rather than detecting comorbidities with similar clinical presentations such as cardiovascular disease.37 As prebronchodilator spirometry was omitted from the study assessment to minimise participant burden and increase uptake in this large community-based study, we could not assess airflow reversibility.

    Our study population included slightly more women than men (60% women). As smoking prevalence is also much lower among women, our study cannot provide an accurate estimate of COPD prevalence. However this should not impact on the estimate of screening test accuracy, which was the primary objective. It was not possible to exclude diagnosed patients with COPD from this study, as Chinese CHCs do not have COPD registers and patients are frequently unaware of their condition. However, as the aim of our study was to determine accuracy of different screening tests by comparing all tests against a reference standard, rather than to evaluate the implementation of a screening programme, inclusion of COPD patients was justified. By including some people with known COPD, we maximised the number of test positives in the study sample.

    Although China has recently introduced a national policy of COPD screening, there is no current guidance regarding the tests to use or which test characteristics (ie, sensitivity/specificity) to prioritise. Considering the estimated high prevalence of undiagnosed COPD in China, highly sensitive strategies may be preferred to maximise the number of detected cases, although this would result in large numbers being referred for diagnostic spirometry, many of whom would be false positives. However, the potential inefficiency may be offset by a recent policy to include spirometry in routine primary care health consultations; avoiding the need to refer patients to hospital for diagnostic assessment. While the more sensitive parallel strategies may be preferential in the Chinese healthcare setting, there is a trade-off between sensitivity and specificity according to epidemiology, resources and context; hence, serial strategies may be considered optimal in other settings.

    If the strategy of C-SBQ and microspirometry were used in practice and had the same accuracy as reported here, it is likely that true COPD cases who were not detected (false negatives) would have mild disease and would reattend with recurring symptoms, offering further opportunities for referral to diagnostic spirometry.

    While our analyses used recommended cut-points for the index tests, it is important to explore their optimal cut-points when applied in this context, as many tests were developed with alternate purposes and/or populations in mind. Thresholds used to indicate airflow obstruction (either in the screening tests or reference test) may not be valid in the whole Chinese population as adequate reference values for lung function are currently unreliable.

    Although we have determined the accuracy of different tests when used for screening Chinese community populations for undiagnosed COPD, we did not evaluate the implementation of a screening programme. A recently published model-based cost-effectiveness analysis from China which used international data on QALYs, demonstrated that use of a screening questionnaire combined with a hand-held spirometer was cost saving compared with no screening, but this did not compare different screening strategies and was not based on data from an implementation trial.38 It is important to undertake a trial to compare the effectiveness and cost-effectiveness of the most efficient screening strategy identified in this study (maximising yield with acceptable false positive rate) against usual care on yield and clinical outcomes. Such a trial would need to assess uptake of screening and incorporate pathways for clinical assessment and subsequent treatment for test positive cases. In our study sample, >75% had potential to benefit; less than half with obstruction had treatable symptoms and a further quarter with obstruction and no symptoms would benefit from smoking cessation advice. We presented cost per additional true case detected, however, no country has, to date, stated a willingness to pay threshold for this outcome. The quality-adjusted life-year (QALY) is a more common metric in health economic analyses, with established cost per QALY thresholds. Although outside the remit of our test accuracy study, future work should attempt to extrapolate cases detected to the management of patients with COPD, to assess the impact on quality of life and survival to allow the calculation of QALYs.

    In conclusion, we have demonstrated that within the primary care setting in China, the most efficient screening test strategy was a combination of the C-SBQ and microspirometry where a positive test in either would result in a referral for diagnostic spirometry. Further work is required to explore optimal cut-points and there is a need for a clinical trial to evaluate whether a screening programme using this test combination is clinically and cost-effective.

    Data availability statement

    Data are available on reasonable request. Data are available upon reasonable request. All data requests should be submitted to authors CC and PA for consideration. Access to anonymised data may be granted following review.

    Ethics statements

    Patient consent for publication

    Ethics approval

    The study has been approved by Peking University First Hospital (2018-R-141, PUFH) and University of Birmingham (ERN_18-1177, UoB).

    Acknowledgments

    The investigator and collaborative team include: R Jordan, P Adab (CIs), Z Pan, AP Dickens, C Chi, X Kong, A Enocson, BG Cooper, KK Cheng, A Sitch, S Jowett, R Adams, J Correia de Sousa, A Farley, N Gale, K Jolly, M Maglakelidze, T Maglakelidze, SM Martins, K Stavrikj, R Stelmach, A Turner and S Williams. We thank the dedicated team of researchers at Department of General Practice, Peking University First Hospital for managing and co-ordinating the project. We are also grateful for support from our Trial Steering Committee (Dr. Semira Manaseki-Holland (Chair), Prof. David Mannino, Mr. Zhiwei Zhang (patient), Dr. Xueying Zhou (clinician), Prof. Chunhua Chi, Dr. Rachel Jordan), and The International Scientific Advisory Committee (Prof. Debbie Jarvis, Dr. Semira Manaseki-Holland, Prof. David Mannino, Prof. Niels Chevannes). We especially want to thank the patients included in the study and the clinicians at all community hospitals for their assistance, without whom this project would not have been possible. The clinicians involved in this study included: Wenyan Duan, Mengmeng Guo, Zhi Jin (Caiyu Community Hospital, Beijing); Yuling Li, Shuo Chen, Kang Rong, Yi Cai, Jing Bai (Xinjiekou Community Hospital, Beijing); Wei Xiong, Honglin Luo, Juan Chen, Na Li (Hezuo Community Hospital, Chengdu); Min Chen, Yaling Luo, Xiaolong Zhou (Nanxin Community Hospital, Chengdu), Shixing Liu, Guoxiong Han, Shuhua Sun, Jian Long Li, Jianlong Cai, Haimei Chen, Yuanping Chen (Shayuan Community Hospital, Guangzhou); Bin Hu, Huilian Xuan, Jieya Zhang, Huanping Chen, Fengqi Liu, Haixia Yin (Jiulong Community Hospital, Guangzhou); Ying Chen, Xinzheng Cui, Yao Chen, Hui Peng, Weihan Jin, Xiaoguang Xu (Beishi Community Hospital, Shenyang); Zhenguo Gao, Zhongning Kan, Lina Song, Yongsheng Tong, Yuxuan Zhang, Shuai Mu, Yang Gao (Taoxian Community Hospital, Shenyang); Zhennan Qi, Hui Pang, Anny Gao, Xue Jin (Peking University First Hospital). We thank the patient advisory group for their useful comments, including Mr. Zhiwei Zhang, Mr. Chen Wang, Mr Baoyin Fang and Mr. Deqian Ma. We thank the support of the Health Committees in Xicheng District, Beijing and in Guangzhou for identifying potential research sites. We would also like to acknowledge Radmila Ristovska (1955-2020), also involved in the initiation of this study. We gratefully acknowledge International Primary Care Respiratory Group (IPCRG) for introducing us to the primary care networks involved in this study and for its continued facilitation of clinical engagement. We obtained appropriate permissions to use the Symptom Based Questionnaire, COPD Screening Questionnaire, COPD Diagnostic Questionnaire and COPD Assessment in Primary Care To Identify Undiagnosed Respiratory Disease and Exacerbation Risk (CAPTURE).

    References

    1. ↵
      1. Global Initiative for Chronic Obstructive Lung Disease (GOLD)
      . Global strategy for the diagnosis, management, and prevention of chronic obstructive pulmonary disease (2018 report). Available: https://goldcopd.org/wp-content/uploads/2019/12/GOLD-2020-FINAL-ver1.2-03Dec19_WMV.pdf
    2. ↵
      1. GBD 2015 Chronic Respiratory Disease Collaborators
      . Global, regional, and national deaths, prevalence, disability-adjusted life years, and years lived with disability for chronic obstructive pulmonary disease and asthma, 1990-2015: a systematic analysis for the global burden of disease study 2015. Lancet Respir Med 2017;5:691–706.doi:10.1016/S2213-2600(17)30293-Xpmid:http://www.ncbi.nlm.nih.gov/pubmed/28822787
      OpenUrlPubMed
    3. ↵
      1. Yin P,
      2. Wang H,
      3. Vos T, et al
      . A Subnational Analysis of Mortality and Prevalence of COPD in China From 1990 to 2013: Findings From the Global Burden of Disease Study 2013. Chest 2016;150:1269–80.doi:10.1016/j.chest.2016.08.1474pmid:http://www.ncbi.nlm.nih.gov/pubmed/27693597
      OpenUrlPubMed
    4. ↵
      1. Zhu B,
      2. Wang Y,
      3. Ming J, et al
      . Disease burden of COPD in China: a systematic review. Int J Chron Obstruct Pulmon Dis 2018;13:1353–64.doi:10.2147/COPD.S161555pmid:http://www.ncbi.nlm.nih.gov/pubmed/29731623
      OpenUrlPubMed
    5. ↵
      1. Bednarek M,
      2. Maciejewski J,
      3. Wozniak M, et al
      . Prevalence, severity and underdiagnosis of COPD in the primary care setting. Thorax 2008;63:402–7.doi:10.1136/thx.2007.085456pmid:http://www.ncbi.nlm.nih.gov/pubmed/18234906
      OpenUrlAbstract/FREE Full Text
    6. ↵
      1. Casas Herrera A,
      2. Montes de Oca M,
      3. López Varela MV, et al
      . Copd underdiagnosis and misdiagnosis in a high-risk primary care population in four Latin American countries. A key to enhance disease diagnosis: the PUMA study. PLoS One 2016;11:e0152266.doi:10.1371/journal.pone.0152266pmid:http://www.ncbi.nlm.nih.gov/pubmed/27073880
      OpenUrlPubMed
    7. ↵
      1. Çolak Y,
      2. Afzal S,
      3. Nordestgaard BG, et al
      . Prognosis of asymptomatic and symptomatic, undiagnosed COPD in the general population in Denmark: a prospective cohort study. Lancet Respir Med 2017;5:426–34.doi:10.1016/S2213-2600(17)30119-4pmid:http://www.ncbi.nlm.nih.gov/pubmed/28389225
      OpenUrlPubMed
    8. ↵
      1. Lamprecht B,
      2. Soriano JB,
      3. Studnicka M, et al
      . Determinants of underdiagnosis of COPD in national and international surveys. Chest 2015;148:971–85.doi:10.1378/chest.14-2535pmid:http://www.ncbi.nlm.nih.gov/pubmed/25950276
      OpenUrlCrossRefPubMed
    9. ↵
      1. Zhong N,
      2. Wang C,
      3. Yao W, et al
      . Prevalence of chronic obstructive pulmonary disease in China: a large, population-based survey. Am J Respir Crit Care Med 2007;176:753–60.doi:10.1164/rccm.200612-1749OCpmid:http://www.ncbi.nlm.nih.gov/pubmed/17575095
      OpenUrlCrossRefPubMedWeb of Science
    10. ↵
      1. Wang C,
      2. Xu J,
      3. Yang L, et al
      . Prevalence and risk factors of chronic obstructive pulmonary disease in China (the China Pulmonary Health [CPH] study): a national cross-sectional study. Lancet 2018;391:1706–17.doi:10.1016/S0140-6736(18)30841-9pmid:http://www.ncbi.nlm.nih.gov/pubmed/29650248
      OpenUrlCrossRefPubMed
    11. ↵
      1. US Preventive Services Task Force (USPSTF),
      2. Siu AL,
      3. Bibbins-Domingo K, et al
      . Screening for chronic obstructive pulmonary disease: US preventive services Task force recommendation statement. JAMA 2016;315:1372–7.doi:10.1001/jama.2016.2638pmid:http://www.ncbi.nlm.nih.gov/pubmed/27046365
      OpenUrlCrossRefPubMed
    12. ↵
      1. UK National Screening Committee
      . UK national screening Committee. An evaluation of screening for COPD against the National screening Committee criteria, 2013.
    13. ↵
      Screening for chronic obstructive pulmonary disease (COPD) in the general adult population. external review against programme appraisal criteria for the UK national screening Committee 2018.
    14. ↵
      1. National Health and Family Planning Commission of the People
      . National Health and Family Planning Commission of the People’s Republic of China. The 13th Five-Year Plan for Healthcare, 2016. Available: http://www.gov.cn/zhengce/content/
    15. ↵
      1. Dickens AP,
      2. Fitzmaurice DA,
      3. Adab P, et al
      . Accuracy of vitalograph lung monitor as a screening test for COPD in primary care. NPJ Prim Care Respir Med 2020;30:2.doi:10.1038/s41533-019-0158-2pmid:http://www.ncbi.nlm.nih.gov/pubmed/31900421
      OpenUrlPubMed
    16. ↵
      1. Stanley AJ,
      2. Hasan I,
      3. Crockett AJ, et al
      . Copd diagnostic questionnaire (CDQ) for selecting at-risk patients for spirometry: a cross-sectional study in Australian general practice. NPJ Prim Care Respir Med 2014;24:14024.doi:10.1038/npjpcrm.2014.24pmid:http://www.ncbi.nlm.nih.gov/pubmed/25010522
      OpenUrlPubMed
    17. ↵
      1. Jackson H,
      2. Hubbard R
      . Detecting chronic obstructive pulmonary disease using peak flow rate: cross sectional survey. BMJ 2003;327:653–4.doi:10.1136/bmj.327.7416.653pmid:http://www.ncbi.nlm.nih.gov/pubmed/14500437
      OpenUrlFREE Full Text
    18. ↵
      1. Zhang Q,
      2. Wang M,
      3. Li X, et al
      . Do symptom-based questions help screen COPD among Chinese populations? Sci Rep 2016;6:30419.doi:10.1038/srep30419pmid:http://www.ncbi.nlm.nih.gov/pubmed/27456860
      OpenUrlPubMed
    19. ↵
      1. Zhou Y-M,
      2. Chen S-Y,
      3. Tian J, et al
      . Development and validation of a chronic obstructive pulmonary disease screening questionnaire in China. Int J Tuberc Lung Dis 2013;17:1645–51.doi:10.5588/ijtld.12.0995pmid:http://www.ncbi.nlm.nih.gov/pubmed/24200283
      OpenUrlPubMed
    20. ↵
      1. Pan Z,
      2. Dickens AP,
      3. Chi C, et al
      . Study to evaluate the effectiveness and cost-effectiveness of different screening strategies for identifying undiagnosed COPD among residents (≥40 years) in four cities in China: protocol for a multicentre cross-sectional study on behalf of the breathe well group. BMJ Open 2020;10:e035738.doi:10.1136/bmjopen-2019-035738pmid:http://www.ncbi.nlm.nih.gov/pubmed/33247005
      OpenUrlAbstract/FREE Full Text
    21. ↵
      1. Ferris BG
      . Epidemiology standardization project (American thoracic Society). Am Rev Respir Dis 1978;118:1–120.pmid:http://www.ncbi.nlm.nih.gov/pubmed/742764
      OpenUrlPubMedWeb of Science
    22. ↵
      1. Jones PW,
      2. Harding G,
      3. Berry P, et al
      . Development and first validation of the COPD assessment test. Eur Respir J 2009;34:648–54.doi:10.1183/09031936.00102509pmid:http://www.ncbi.nlm.nih.gov/pubmed/19720809
      OpenUrlAbstract/FREE Full Text
    23. ↵
      1. Harris PA,
      2. Taylor R,
      3. Thielke R, et al
      . Research electronic data capture (REDCap)--a metadata-driven methodology and workflow process for providing translational research informatics support. J Biomed Inform 2009;42:377–81.doi:10.1016/j.jbi.2008.08.010pmid:http://www.ncbi.nlm.nih.gov/pubmed/18929686
      OpenUrlCrossRefPubMedWeb of Science
    24. ↵
      1. Harris PA,
      2. Taylor R,
      3. Minor BL, et al
      . The REDCap Consortium: building an international community of software platform partners. J Biomed Inform 2019;95:103208.doi:10.1016/j.jbi.2019.103208pmid:http://www.ncbi.nlm.nih.gov/pubmed/31078660
      OpenUrlCrossRefPubMed
    25. ↵
      1. Price DB,
      2. Tinkelman DG,
      3. Halbert RJ, et al
      . Symptom-Based questionnaire for identifying COPD in smokers. Respiration 2006;73:285–95.doi:10.1159/000090142pmid:http://www.ncbi.nlm.nih.gov/pubmed/16330875
      OpenUrlCrossRefPubMedWeb of Science
    26. ↵
      1. Martinez FJ,
      2. Mannino D,
      3. Leidy NK, et al
      . A new approach for identifying patients with undiagnosed chronic obstructive pulmonary disease. Am J Respir Crit Care Med 2017;195:748–56.doi:10.1164/rccm.201603-0622OCpmid:http://www.ncbi.nlm.nih.gov/pubmed/27783539
      OpenUrlPubMed
    27. ↵
      1. Frith P,
      2. Crockett A,
      3. Beilby J, et al
      . Simplified COPD screening: validation of the PiKo-6® in primary care. Prim Care Respir J 2011;20:190–8.doi:10.4104/pcrj.2011.00040pmid:http://www.ncbi.nlm.nih.gov/pubmed/21597667
      OpenUrlCrossRefPubMed
    28. ↵
      1. Labor M,
      2. Vrbica Žarko,
      3. Gudelj I, et al
      . Diagnostic accuracy of a pocket screening spirometer in diagnosing chronic obstructive pulmonary disease in general practice: a cross sectional validation study using tertiary care as a reference. BMC Fam Pract 2016;17:112.doi:10.1186/s12875-016-0518-8pmid:http://www.ncbi.nlm.nih.gov/pubmed/27542843
      OpenUrlPubMed
    29. ↵
      1. Miller MR,
      2. Crapo R,
      3. Hankinson J, et al
      . General considerations for lung function testing. Eur Respir J 2005;26:153–61.doi:10.1183/09031936.05.00034505pmid:http://www.ncbi.nlm.nih.gov/pubmed/15994402
      OpenUrlFREE Full Text
    30. ↵
      1. Alonzo TA,
      2. Pepe MS,
      3. Moskowitz CS
      . Sample size calculations for comparative studies of medical tests for detecting presence of disease. Stat Med 2002;21:835–52.doi:10.1002/sim.1058pmid:http://www.ncbi.nlm.nih.gov/pubmed/11870820
      OpenUrlCrossRefPubMedWeb of Science
    31. ↵
      1. Represas-Represas C,
      2. Fernández-Villar A,
      3. Ruano-Raviña A, et al
      . Screening for chronic obstructive pulmonary disease: validity and reliability of a portable device in Non-Specialized healthcare settings. PLoS One 2016;11:e0145571.doi:10.1371/journal.pone.0145571pmid:http://www.ncbi.nlm.nih.gov/pubmed/26726887
      OpenUrlPubMed
    32. ↵
      1. van den Bemt L,
      2. Wouters BCW,
      3. Grootens J, et al
      . Diagnostic accuracy of pre-bronchodilator FEV1/FEV6 from microspirometry to detect airflow obstruction in primary care: a randomised cross-sectional study. NPJ Prim Care Respir Med 2014;24:14033.doi:10.1038/npjpcrm.2014.33pmid:http://www.ncbi.nlm.nih.gov/pubmed/25119686
      OpenUrlPubMed
    33. ↵
      1. OCED
      . Purchasing power parities (PPP). Available: https://data.oecd.org/conversion/purchasing-power-parities-ppp.htm [Accessed 05 Oct 2020].
    34. ↵
      Stard 2015: an updated list of essential items for reporting diagnostic accuracy studies. Available: http://www.equator-network.org/reporting-guidelines/stard/ [Accessed 01 Jun 2020].
    35. ↵
      1. Haroon S,
      2. Jordan R,
      3. Takwoingi Y, et al
      . Diagnostic accuracy of screening tests for COPD: a systematic review and meta-analysis. BMJ Open 2015;5:e008133.doi:10.1136/bmjopen-2015-008133pmid:http://www.ncbi.nlm.nih.gov/pubmed/26450427
      OpenUrlAbstract/FREE Full Text
    36. ↵
      1. Leeflang MM,
      2. Rutjes AW,
      3. Reitsma JB, et al
      . Variation of a test’s sensitivity and specificity with disease prevalence. CMAJ2013:18511.
    37. ↵
      1. van Dijk W,
      2. Tan W,
      3. Li P, et al
      . Clinical relevance of fixed ratio vs lower limit of normal of FEV1/FVC in COPD: patient-reported outcomes from the CanCOLD cohort. Ann Fam Med 2015;13:41–8.doi:10.1370/afm.1714pmid:http://www.ncbi.nlm.nih.gov/pubmed/25583891
      OpenUrlAbstract/FREE Full Text
    38. ↵
      1. Qu S,
      2. You X,
      3. Liu T, et al
      . Cost-Effectiveness analysis of COPD screening programs in primary care for high-risk patients in China. NPJ Prim Care Respir Med 2021;31:28.doi:10.1038/s41533-021-00233-zpmid:http://www.ncbi.nlm.nih.gov/pubmed/34016999
      OpenUrlPubMed

    Supplementary materials

    Footnotes

    • ZP and APD are joint first authors.

    • Twitter @BreatheWell_UOB

    • Contributors RJ and PA co-led the study design, with contributions and advice from all other authors. CC, XK and KKC contributed to decisions on outcome measures. CC and KKC advised on involving GP practices. BC, APD, AE, RJ and PA advised on lung function testing. BC and AE provided training and oversaw the quality assessment for lung function testing. APD, RJ, AJS and PA designed the testing strategy. AJS and SJ designed the analysis plan and economic evaluations respectively. ZP coordinated the data collection, with support from APD, RJ and PA. ZP conducted the statistical analysis, supported by AJS, SJ and APD. ZP and APD wrote the manuscript with input from all other authors. CC was the local PI and oversaw all activities in China. RA, JC-d-S, AF, NKG, KJ, MM, TM, SM, KS, RS, AMT and SW contributed to the development and oversight of this study. As part of the Breathe Well Global Health Research Group, all authors contributed to and approved the final version.

    • Funding This research was funded by the National Institute for Health Research (NIHR) NIHR global group on global COPD in primary care, University of Birmingham, (project reference: 16/137/95) using UK aid from the UK Government to support global health research. This paper presents independent research supported by the NIHR Birmingham Biomedical Research Centre at the University Hospitals Birmingham NHS Foundation Trust and the University of Birmingham.

    • Disclaimer The views expressed in this publication are those of the authors and not necessarily those of the NIHR or the UK Department of Health and Social Care. The funder of the study had no role in study design, data collection, data interpretation, or writing of the report. The corresponding authors had full access to all the data in the study and had final responsibility for the decision to submit for publication.

    • Map disclaimer The inclusion of any map (including the depiction of any boundaries therein), or of any geographic or locational reference, does not imply the expression of any opinion whatsoever on the part of BMJ concerning the legal status of any country, territory, jurisdiction or area or of its authorities. Any such expression remains solely that of the relevant source and is not endorsed by BMJ. Maps are provided without any warranty of any kind, either express or implied.

    • Competing interests None declared.

    • Provenance and peer review Not commissioned; externally peer reviewed.

    • Supplemental material This content has been supplied by the author(s). It has not been vetted by BMJ Publishing Group Limited (BMJ) and may not have been peer-reviewed. Any opinions or recommendations discussed are solely those of the author(s) and are not endorsed by BMJ. BMJ disclaims all liability and responsibility arising from any reliance placed on the content. Where the content includes any translated material, BMJ does not warrant the accuracy and reliability of the translations (including but not limited to local regulations, clinical guidelines, terminology, drug names and drug dosages), and is not responsible for any error and/or omissions arising from translation and adaptation or otherwise.