Article Text
PDF
Abstract
Introduction Single photon emission computed tomography ventilation/perfusion (SPECT V/Q) imaging has many proponents within the nuclear medicine community and has already largely replaced planar V/Q scintigraphy in daily practice for the diagnosis of pulmonary embolism (PE). However, the test is still described in clinical guidelines as an experimental test because of insufficient evidence.
Methods and analysis We will conduct a systematic review and a meta-analysis of diagnostic accuracy and management outcome studies involving patients evaluated with V/Q SPECT for suspected acute PE. We will search from inception to 19 December 2017 MEDLINE, Embase and the Cochrane Central Register of Controlled Trials for diagnostic accuracy studies, randomised controlled trials and observational cohort studies. Two reviewers will conduct all screening and data collection independently. The methodological quality and risk of bias of eligible studies will be carefully and rigorously assessed using the Quality Assessment of Diagnostic Accuracy Studies-2, the Cochrane Collaboration’s tool and the Risk Of Bias In Non-randomised Studies - of Interventions (ROBINS-I) tools. The primary outcomes will be sensitivity, specificity and likelihood ratios of V/Q SPECT for the diagnosis of acute PE. The secondary outcomes will be the rate of venous thromboembolism during a 3-month follow-up period in patients left untreated after a negative diagnostic work-up based on SPECT V/Q.
Ethics and dissemination This study of secondary data does not require ethics approval. It will be presented internationally and published in the peer-reviewed literature.
PROSPERO registration number CRD42018084095.
- thromboembolism
- nuclear medicine
- chest imaging
This is an Open Access article distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited and the use is non-commercial. See: http://creativecommons.org/licenses/by-nc/4.0/
Statistics from Altmetric.com
Strengths and limitations of this study
Although single photon emission computed tomography ventilation/perfusion (SPECT V/Q) has already been largely implemented in daily practice for PE diagnosis, the test is still described as experimental in clinical guidelines.
Many studies have been published on SPECT V/Q for pulmonary embolism (PE) diagnosis but the performance of the test is still unclear because of methodological issues.
The performances of SPECT V/Q for the diagnosis of PE will be assessed using objective and widely accepted tools for quality assessment.
This systematic review and meta-analysis should provide elements of responses to the ongoing debate about the evidence of SPECT V/Q for the diagnosis of acute PE.
Introduction
Rationale
The diagnosis of pulmonary embolism (PE) remains challenging. Both missed diagnosis and excess diagnosis have undesirable consequences. Undiagnosed PE could be fatal in up to 25% of patients1 while anticoagulant therapy carries a risk of bleeding.2 Moreover, there is a trend towards indefinite duration of anticoagulant therapy after a first episode of PE that was not provoked by a major risk factor.3 A definitive and accurate diagnostic conclusion is therefore required for all patients with suspected PE.
The diagnostic strategy starts with clinical probability assessment and D-dimer testing. In patients with a non-high/unlikely clinical probability but positive D-dimer, and in patients with a high/likely clinical probability, lung imaging is required. CT pulmonary angiography (CTPA) is currently the predominantly used imaging test for PE. The test has been widely validated in diagnostic accuracy and management outcome studies.4–6 However, CTPA has some limitations, including the use of an iodinated contrast agent, approximatively 5% of inconclusive tests, higher amount of radiation to the breasts compared with alternative tests and an increasing concern regarding a possible overdiagnosis and overtreatment of PE.7 8
The alternative for PE diagnosis is lung scintigraphy. Planar ventilation/perfusion (V/Q) scintigraphy is also a well-established test for the diagnosis of PE.9 The accuracy of the test was assessed in the Prospective Investigation of Pulmonary Embolism Diagnosis (PIOPED) study, which is the planar V/Q scan landmark accuracy study versus pulmonary angiography.10 Diagnostic strategies based on planar V/Q scan were then widely validated in large management outcome studies.8 11–13
In recent years, the technology around V/Q scintigraphy has rapidly evolved allowing the introduction of single photon emission computed tomography (SPECT), a new method of scintigraphic acquisition.14 SPECT V/Q has been reported to improve the diagnostic performances of the test and significantly decrease the proportion of non-diagnostic studies.15 16 The Nuclear Medicine community is mostly enthusiastic and, already back in 2009, the European Association of Nuclear Medicine guidelines for V/Q scintigraphy strongly recommended the use V/Q SPECT over planar for PE diagnosis.17 Consequently, V/Q SPECT has already largely replaced V/Q planar scintigraphy in many nuclear medicine departments. In a survey performed in 2015 among 331 institutions from Australia, Canada and France, more than 2/3 of centres performed SPECT rather than planar images for PE diagnosis.18
Many accuracy studies aimed at assessing the diagnostic accuracy of SPECT for PE diagnosis. More recently, a few systematic reviews and meta-analyses have been published,19–21 and concluded that SPECT was superior to planar imaging,19 and superior21 or equal to CTPA.19 However, the clinical community remains much more cautious about the use SPECT V/Q for PE diagnosis. In particular, the specialists in venous thromboembolism (VTE) consistently describe SPECT V/Q as an experimental test rather than as an established imaging modality.7 9 22 23 Indeed, the exact accuracy of the test is still unclear because of methodological issues. For example, in many of available accuracy studies, there is an incorporation bias with the V/Q SPECT result participating in the final diagnostic conclusion. It is important to note that the previously published systematic reviews and meta-analyses on the diagnostic accuracy of SPECT have incorporated these studies with an incorporation bias into the analyses. This represents an important limitation and needs to be encounted for in the interpretation of the pooled results. In addition, there is wide heterogeneity within the studies in terms of reference standard, acquisition protocol and criteria used for interpretation. Finally, although some studies reported on the risk of VTE during follow-up in patients in whom the diagnosis of PE was ruled out on the basis of a negative V/Q SPECT, most did not use a standardised algorithm and additional tests were often performed at the discretion of the physicians. Thus, the clinical outcome of patients investigated with V/Q SPECT remains unclear.
Given this paradoxical situation of a test already largely implemented in daily practice but still described as experimental by clinicians, there is an urgent need to perform a systematic review on the performances of SPECT V/Q for the diagnosis of PE, using objective and widely accepted tools for quality assessment.
Objectives
The primary objective of this systematic review and meta-analysis is to establish the diagnostic accuracy (sensitivity, specificity, likelihood ratios (LRs)) of SPECT V/Q for the diagnosis of acute PE.
The secondary aim is to review the clinical outcomes of patients investigated for suspicion of acute PE with a standardised algorithm based on V/Q SPECT.
Methods
This protocol followed the recommendations in the statement on Preferred Reporting Items for Systematic Reviews and Meta-Analyses Protocol (PRISMA-P)24 and PRISMA of Diagnostic Test Accuracy (PRISMA-DTA).25 This protocol has been published in the PROSPERO International Prospective Register of Systematic Reviews with registration number CRD42018084095.
Eligibility criteria
Studies will be selected according to the criteria outlined below.
Study designs
To answer to the primary objective (diagnostic accuracy), we will include diagnostic accuracy studies of >10 patients.
To answer to the secondary objective (clinical outcome), we will include randomised controlled trials (RCTs) and prospective cohort studies. Studies with other types of designs, including retrospective cohort studies, case–control studies, case series and case reports will be excluded.
Participants/Interventions
The study population of interest will include adults (aged 18 years or older) with a suspected acute PE investigated using a SPECT V/Q.
Comparator
This study will be non-comparative.
Outcome
The primary outcomes will be sensitivity, specificity and positive and negative LRs of V/Q SPECT for the diagnosis of acute PE.
The secondary outcomes will be:
The rate of VTE during a 3-month follow-up period in patients left untreated after a negative diagnostic work-up based on SPECT V/Q.
The percentage of patients anticoagulated based on a positive V/Q SPECT study among patients assessed with V/Q SPECT for suspected acute PE.
Information sources and search strategy
The following databases will be searched during the electronic component of the systematic review: Medline (via OVID), Embase Classic+Embase (via OVID) and Cochrane’s Central Register of Controlled Trials. The specific search strategies will be created by a Health Sciences Librarian with expertise in the design of systematic review searching. A search strategy will be developed to define subject headings and keywords for all searches (see online supplementary appendix 1 for Medline search). After the Medline strategy is finalised, it will be adapted to the syntax of the other databases. There will be no beginning date identified, while the cut-off date will be 19 December 2017. There will be no language exclusion criteria nor any other publication restrictions. Additional references will be sought by hand-searching the bibliographies of relevant articles.
Supplementary file 1
Study records
Data management
Literature search results will be imported into EndNote, de-duplicated and then uploaded to the Covidence platform (www.covidence.org) to facilitate collaboration among the reviewers during the study selection process.
Selection process
Two reviewers will independently conduct title and abstract screening procedures. Full reports for all titles and abstracts that appear to meet the inclusion criteria or where there is any uncertainty will be obtained. Conflicts in screening will be resolved by consensus or by a third person. Search results and study selection will be illustrated in a PRISMA flow diagram,26 with reasons specified for excluding articles during full-text screening.
Data collection process
A structured data extraction form will be developed to facilitate the process of data collection from the studies that have been included in the review. Two reviewers will independently extract all data. Discrepancies between reviewers will be resolved by consensus or by a third person if necessary.
Data items
We will extract:
Study information: reference ID, authors, year of publication, journal and publication status.
Study characteristics: country, study period, funding, prospective or retrospective, single centre or multicentre.
Population characteristics: age, gender, sample size, referral pattern (eg, outpatients, emergency room or inpatients), prevalence of PE, number of participants lost to follow-up.
For accuracy studies:
Patient selection: consecutive or random sample, inclusion and exclusion criteria, clinical probability for PE, additional testing including D-dimer, intended use of the index test, clinical setting.
Information related to the index test, that is, V/Q SPECT: radiopharmaceuticals, combined CT acquisition, interpretation criteria (positivity thresholds), blinding information, number of readers and resolution of disagreements.
Information related to the reference standard: imaging procedures, interpretation method, follow-up.
Flow and timing: time interval and any interventions between the index test and reference standard, patients who did not receive the index test and/or reference standard, patients excluded from the 2×2 table.
Outcomes to estimate the test accuracy in the form of a cross tabulation of index test with reference standard (2× 2 table) including the number of true positives, false positives, false negatives and true negatives.
For outcome studies:
Patient selection: consecutive or random sample, inclusion and exclusion criteria, clinical probability for PE, additional testing including D-dimer.
Study design: RCT or prospective cohort study, a priori defined standardised diagnostic strategy to confirm or exclude PE, blind interpretation of the V/Q SPECT, length of follow-up.
Information related to V/Q SPECT: radiopharmaceuticals, combined CT acquisition, interpretation criteria (positivity thresholds), interpretation method, number of negative, positive and indeterminate results.
Information related to the diagnostic strategy and therapeutic management: additional testing (D-dimer test, compression ultrasound (CUS), CTPA or V/Q planar) performed in addition to the V/Q SPECT.
Outcomes: number of patients with a positive and a negative diagnostic work-up with regard to PE diagnosis, number of patients who received anticoagulation, number of patients lost to follow up, number of patients eligible for outcome assessment, that is, patients left untreated after a negative V/Q SPECT with a 3-month follow-up, number of thromboembolism events during the 3-month follow-up period in patients left untreated, number and cause of death.
Outcomes and prioritisation
The primary outcomes will be sensitivity, specificity and negative and positive LRs of V/Q SPECT for the diagnosis of acute PE.
The secondary outcome will be the rate of VTE during a 3-month follow-up period in patients left untreated after a negative diagnostic work-up.
Risk of bias of individual studies
The methodological quality and risk of bias of eligible studies will be carefully and rigorously assessed. The risk of bias for each study will be ascertained by two reviewers. Results will be compared and disagreements resolved by discussion or, if needed, with the help of a third reviewer.
Quality assessment
Diagnostic accuracy
The Quality Assessment of Diagnostic Accuracy Studies (QUADAS)-2 tool will be used to evaluate the risk of bias and concern about applicability of primary diagnostic accuracy studies27 (see table 1).
QUADAS-2 tool to evaluate the risk of bias and concern about applicability of diagnostic accuracy studies
We will consider appropriate the following reference standard tests: negative D-dimer in the presence of low or intermediate or unlikely clinical probability, planar V/Q scan when used and interpreted according to well-accepted diagnostic algorithms, CTPA or pulmonary angiography. Special attention will be paid to the independence of the reference standard with regard to the V/Q SPECT results in order to avoid any incorporation bias, and to the blind interpretation of the V/Q SPECT. The description of the reference standard will be considered appropriate if explained with sufficient detail to permit replication of the test. The time between reference standard and index test will be considered acceptable if <24 hour.
A judgement as to the possible risk of bias and concern about applicability on each item in the domains will be made. The results of the QUADAS-2 assessment for all included studies will be summarised in a table and a graphical display. If the answers to all signalling questions for a domain are ‘yes’, then the risk of bias and concern regarding applicability will we judged low. If a study is judged ‘high’ or ‘unclear’ in one or more domains, then it will be judged ‘at risk of bias’ or as having ‘concerns regarding applicability.’
Clinical outcomes
RCTs will be appraised using the Cochrane Collaboration’s tool for assessing risk of bias.28 For studies that have used a cohort design, the Risk Of Bias In Non-randomised Studies - of Interventions (ROBINS-I) tool29 for assessing the quality of non-randomised studies in meta-analyses will be used.
Particular attention will be paid to several criteria: (1) prospective enrolment of unselected patients with suspected PE; (2) a standardised PE diagnostic algorithm and management. If performed, the use of additional testing such as D-dimer test, lower-limb venous CUS or CTPA should be standardised and not left at the discretion of the attending physicians. Standardised management is necessary to permit generalisation of results; and (3) reliability of the 3-month follow-up (completeness, description of reasons for incomplete follow-up) and outcome measures (definition at the start of the study, objectivity).
Data synthesis
Diagnostic accuracy
The first step in data synthesis will consist in calculating the descriptive statistics in each primary study. These statistics will include sensitivity, specificity, positive LR and negative LR from the diagnostic 2×2 tables of primary studies. Using the calculated descriptive statistics with the 95% CI of each of the primary studies, a descriptive forest plot will be derived. A summary receiver operating characteristic plot will also be developed.
The main objective of this systematic review is to combine data from primary accuracy studies on V/Q SPECT for the diagnosis of acute PE. Prior to pooling results, the research team will also assess studies for clinical and methodological heterogeneity through comparison of important study characteristics including those related to the study design, patients, V/Q SPECT acquisition and interpretation (positivity threshold). The degree of statistical heterogeneity will be measured and interpreted using a combination of Cochrane’s Q (statistically significant at P<0.10) and the I2 statistic (>50% considered substantial). An I2 value >75% is indicative of a very high degree of heterogeneity and, if encountered, the data will not be pooled. A bivariate random-effects regression approach will be used for summary estimates of both sensitivity and specificity.
Clinical outcome
The second objective of this systematic review is to combine data from management outcome studies to assess the safety of a diagnostic strategy based on V/Q SPECT to rule out acute PE. This will be assessed by pooling the rate of VTE event during a 3-month follow-up period in patients left untreated after a negative diagnostic work-up based on SPECT V/Q. Only high-quality studies will be included in the meta analysis, that is, studies with (1) prospective enrolment of unselected patients with suspected PE; (2) an a priori defined PE diagnostic algorithm and management; and (3) a reliable 3-month follow-up and primary outcome measure. Prior to pooling results, the research team will also assess studies for clinical and methodological heterogeneity as described above. If homogeneity among studies is judged as satisfactory, then the results from trials will be pooled using standard meta-analysis procedures.
Patient and public involvement
Patients and public will not be involved in this study since this is a systematic review on published studies.
Discussion
In this systematic review and meta-analysis, we aim to assess the diagnostic performance of SPECT V/Q for the diagnosis of acute PE. We decided to assess both diagnostic accuracy of the test and the clinical outcome of patients during follow-up. Studies of new diagnostic tests for PE fall into two broad categories that correspond to early and late stages of test evaluation: accuracy and outcome studies. Accuracy studies determine the accuracy of a new test by comparing the findings with an established ‘gold’ or reference standard. In such a study, the diagnostic conclusion is based only on the results of the gold standard test. The new test is blindly read, which allows an independent determination of accuracy indices and the assessment of the optimal diagnostic cut-off for quantitative variables. Outcome studies assess the safety and usefulness of the test used the actual diagnostic management of patients. The new test becomes decisional, that is, the diagnostic conclusion and the therapeutic decision are made on the basis of the test’s result. The main evaluation criterion is the safety of using the test in deciding patient management and treatment. For VTE diagnosis, a widely accepted criterion is the 3-month rate of VTE in patients left without anticoagulant treatment after a negative strategy. A diagnostic strategy is deemed to safely exclude PE when the 3-month risk is not higher than 3%. This 3% rate corresponds to the upper limit of the 95% CI of VTE rate observed in patients with suspected PE left without anticoagulation after a negative pulmonary angiography.30
Limitations and challenges
In many available studies, the SPECT V/Q results were provided to the clinicians at the time of the diagnostic work up, and hence participated in the diagnostic conclusion. Therefore, the index test became part of the ‘reference standard’. This obviously introduces a major bias and artificially improves the accuracy of the test. Previously published meta-analysis did include such studies in their pooled accuracy indices estimates.19–21 We will pay particular attention to the independence and blind interpretation between the index test and the reference standard.
Heterogeneity of SPECT V/Q acquisition and interpretation across studies is a potential limitation that can cause challenges to be encountered in this review. According to centres and countries, scanning protocols and interpretation criteria vary. An arising challenge is the increasing use of a combined low-dose CT to enable correlation of functional and anatomical lung abnormalities. The use of a combined CT is thought by some experts to further improve the diagnostic performance of SPECT V/Q. Studies will be carefully examined for the criteria used for interpretation (positivity threshold) and for the exact imaging protocol.
Conclusions
Although SPECT V/Q has already been largely implemented in daily practice, the test is still described as experimental by clinicians. In this systematic review and meta-analysis, objective and widely accepted tools will be used to assess studies’ quality. Heterogeneity of studies will be assessed using conventional statistical methods. Accordingly, this systematic review and meta-analysis should provide elements of responses to the ongoing debate about the evidence of SPECT V/Q for the diagnosis of acute PE.
Ethics and dissemination
Ethical approval and patient consent are not required since this is a systematic review on published studies. The results of this study will be submitted for presentation at relevant national and international conferences, and for publication in a peer-reviewed journal.
References
Footnotes
Contributors PYLR, PR, GLG and PYS conceived the idea and design for this systematic review. PYLR, PR, AD, MC, GLG and PYS developed the methodology for the systematic review protocol. The contents of this manuscript were drafted by PYLR, GLG and PYS with input from all members of the authorship team. The manuscript was reviewed by PR, CT, AD, MC, HRE and FC for important intellectual content. All authors read and approved the final manuscript.
Funding The authors have not declared a specific grant for this research from any funding agency in the public, commercial or not-for-profit sectors.
Competing interests GLG holds an Early Researcher Award from the Province of Ontario, a CP Has Heart Cardiovascular Clinician Scientist Award from the Heart and Stroke Foundation of Ontario, and the Chair on Diagnosis of Venous Thromboembolism from the Department of Medicine, University of Ottawa.
Patient consent Not required.
Provenance and peer review Not commissioned; externally peer reviewed.
Data sharing statement There is no additional unpublished data from this study.