Article Text

Protocol
Protocol for a systematic review and meta-analysis of recurrence and metastasis of different surgical techniques for non-small cell lung cancer
  1. Xiongfeng Huang1,
  2. Donghong Zhu2,
  3. Yaoxing Cao3,
  4. Weijuan Li1,
  5. Jinxing Lai4,
  6. Yuxi Ren5
  1. 1Fuzhou Medical College, Nanchang University, Fuzhou, China
  2. 2Department of Respiratory, The Ninth Hospital of Nanchang, Nanchang, China
  3. 3Jiangxi College of Traditional Chinese Medicine, Fuzhou, China
  4. 4Affiliated Ganzhou Hospital of Nanchang University, Ganzhou, China
  5. 5Jiangxi University of Chinese Medicine, Nanchang, China
  1. Correspondence to Dr Yuxi Ren; renyuxi009{at}163.com

Abstract

Introduction Lung cancer remains the primary cause of cancer-related deaths on a global scale. Surgery is the main therapeutic option for non-small cell lung cancer (NSCLC). However, the optimal surgical approach for lymph node assessment in NSCLC resection remains controversial, and it is still uncertain whether lymph node dissection (LND) is more effective in reducing recurrence and metastasis rates in NSCLC compared with lymph node sampling (LNS). Therefore, we will conduct a meta-analysis to evaluate the recurrence and metastasis of LND versus LNS in patients with NSCLC.

Methods and analysis This systematic review and meta-analysis will follow the Preferred Reporting Items for Systematic Reviews and Meta-Analysis: The PRISMA Statement. According to the predefined inclusion criteria, we will conduct a comprehensive search for randomised controlled trials and non-randomised studies examining the recurrence and metastasis of LND compared with LNS in patients with NSCLC. A literature search from inception in PubMed, EMBASE, the Cochrane Library, CNKI, Wanfang, SINOMED, VIP and Web of Science will be done. There will be no limitations on language, and the search will be undertaken on 30 August 2024, with regular search for new studies. Additionally, relevant literature references will be retrieved and hand-searching of pertinent journals will be conducted. The main outcomes include overall recurrence rate, local recurrence rate and distant metastasis rate. The supplementary outcomes encompass the rates of regional recurrence and lymph node metastasis. Two independent reviewers will perform screening, data extraction and quality assessment. Our reviewers will perform subgroup analysis, sensitivity analysis and publication bias analysis to evaluate the heterogeneity and robustness. Review Manager 5.4 will be applied in analysing and synthesising. The Grading of Recommendations Assessment, Development and Evaluation will be used to assess the quality of evidence for the whole study.

Ethics and dissemination Ethical approval is dispensable for this study since no private information of the participants will be involved. The findings of the present study will be disseminated through a peer-reviewed journal or conference presentation.

Study registration The protocol of the systematic review has been registered on Open Science Framework, with a registration doi: https://doi.org/10.17605/OSF.IO/S2FT5.

  • Lung Diseases
  • ONCOLOGY
  • SURGERY
  • Meta-Analysis
http://creativecommons.org/licenses/by-nc/4.0/

This is an open access article distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited, appropriate credit is given, any changes made indicated, and the use is non-commercial. See: http://creativecommons.org/licenses/by-nc/4.0/.

Statistics from Altmetric.com

Request Permissions

If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.

Strengths and limitations of this study

  • The Grading of Recommendations Assessment, Development and Evaluation system will be used to evaluate the quality of the evidence.

  • To minimise the risk of bias, two researchers will independently carry out the study selection, data extraction and quality assessment.

  • Non-randomised studies may introduce methodological limitations and affect the overall quality of evidence.

  • The potential existence of significant heterogeneity among various studies could hinder the derivation of causal conclusions from their combined findings.

  • Because our search will focus primarily on English and Chinese databases, there is a possibility of overlooking studies in other languages, which could result in language bias.

Introduction

Non-small cell lung cancer (NSCLC), the predominant form of lung malignancy, continues to pose a significant threat to global health. In 2024, the American Cancer Society estimated that lung cancer is the leading cause of cancer death, with an estimated 340 people dying from lung cancer every day, almost 2.5 times more than colorectal cancer, which ranks second in cancer deaths.1 Lung cancer remains the primary cause of cancer-related deaths on a global scale.2–5

Surgical resection plays a crucial role in the management of NSCLC, and lymph node staging is essential for accurate prognostication and treatment planning. Lymph node dissection (LND) and lymph node sampling (LNS) are two surgical techniques used for NSCLC, but their relative effectiveness remains controversial.6–15 LNS involves the removal of a smaller number of lymph nodes for pathological examination. This approach is generally less invasive, leading to shorter operative times and potentially fewer postoperative complications.16 However, it may not provide as comprehensive nodal staging as dissection, leading to potential underestimation of the disease stage. LND, conversely, involves the complete removal of lymph nodes and surrounding tissue in specific anatomic regions. This approach offers a comprehensive assessment of nodal involvement, allowing for more accurate staging and potentially improving long-term outcomes. However, it is a more invasive procedure that may increase the risk of postoperative complications, which may result in a reduction in postoperative quality of life for patients. Furthermore, for some patients with early NSCLC, the incidence of lymph node metastasis is not very high, and most patients may not have regional lymph node metastasis. Thus, the necessity of performing complete and systematic LND in patients with NSCLC and whether the expected clinical effect can be achieved remains controversial.

Patients with NSCLC continue to experience a notable rate of recurrence and metastasis following surgical intervention, thereby impacting their overall survival outcomes. A meta-analysis of 11 observational studies showed that surgery decreased the risk of NSCLC recurrence in stages I−IV.17 Several studies have compared the recurrence and metastasis of LND and LNS in NSCLC surgery. Based on three previous studies,18–20 LND has been shown to reduce the incidence of recurrence and metastasis in NSCLC. Meng et al21 posited in their meta-analysis that the use of LND may be effective in eliminating hidden micrometastases to reduce the risk of both local recurrence and distant metastases. However, the results of our previous meta-analysis indicated that in individuals with NSCLC, LND and LNS yielded similar rates of recurrence and metastasis.22 Additionally, other studies have also shown that LND conducted in lung cancer does not impact the occurrence of recurrence and metastasis.23–25

The optimal surgical approach for lymph node assessment in NSCLC resection remains controversial, and it is still uncertain whether LND is more effective in reducing recurrence and metastasis rates in NSCLC compared with LNS. Clearly, newer systematic reviews and meta-analyses are required to resolve this issue, and definitive analyses can provide stronger rationales for the choice of a specific therapy. Consequently, we will perform a meta-analysis of relevant randomised controlled trials (RCTs) and non-randomised studies to evaluate the recurrence and metastasis of LND versus LNS in patients with NSCLC. We hope that this meta-analysis will offer strong evidence for the surgical treatment of patients with NSCLC and guide future clinical practice.

Materials and methods

Registration and reporting

This review protocol has been officially registered in the Open Science Framework (OSF) database (https://doi.org/10.17605/OSF.IO/S2FT5). The checklist for the Preferred Reporting Items for Systematic Review and Meta-Analysis Protocols can be found in online supplemental file 1.26 If there is a change to this protocol, details of the amendment and its reasons will be added to the OSF. The systematic review and meta-analysis are anticipated to commence on 30 August and conclude on 30 December.

Eligibility criteria

Types of studies

All relevant published RCTs and non-randomised studies will be included. The review will not include certain types of studies, such as methodological papers, editorials, qualitative research, individual case reports and secondary studies like narrative reviews, systematic reviews and meta-analyses. There will be no restrictions on the language used or the time of publication.

Types of participants

Individuals with NSCLC who received either LND or LNS will be eligible for inclusion, with no limitations based on country, race, ethnicity, age, gender or occupation.

Types of outcomes

The main outcomes are overall recurrence rate, local recurrence rate (ipsilateral lung, ipsilateral pleura, trachea, etc) and distant metastasis rate (contralateral lung, contralateral pleura, bone, liver, etc). The supplementary outcomes encompass the rates of regional recurrence and lymph node metastasis.

Information source and search strategy

A literature search from inception in PubMed, EMBASE, the Cochrane Library, CNKI, Wanfang, SINOMED, VIP and Web of Science will be done. The Gray Journal includes annual meetings of the American Society of Clinical Oncology and the American Society of Thoracic Surgery (chest surgery), using combinations of the following search terms: lymph node dissection, LND, lymph node sampling, LNS and non-small cell lung cancer, NSCLC. Detailed search strategies are shown in online supplemental file 2. There will be no limitations on language, and the search will be undertaken on 30 August 2024, with regular search for new studies. The bibliography of all articles obtained will be examined to identify additional publications that may be pertinent. In addition, abstracts from the American Society of Clinical Oncology and the European Society of Medical Oncology will be searched for potential studies. In order to gather thorough information from qualifying studies, we will contact primary authors to request any pertinent data, such as supplementary materials that may not have been fully disclosed or reported, and information from informal sources related to the research. Two reviewers will examine the reference list and individually choose the studies.

Study selection

The chosen articles will undergo a dual-review process by two separate authors. Following the initial screening of titles and abstracts of papers found through the search strategy, the papers will be sorted into two categories: potentially relevant or not relevant based on the eligibility criteria. Subsequently, efforts will be made to obtain the full texts of all potentially relevant papers, which will then be reviewed against the eligibility criteria. In the event of disagreements during the full-text screening, they will be resolved through discussion. If a consensus cannot be reached, a third author will step in to settle the dispute. The study selection process is illustrated in figure 1.

Figure 1

Flow diagram showing the selection process of articles.

Data extraction process

The data will be taken from each full-text article that meets the eligibility criteria: study design; country of study; interventions; outcomes; number and general characteristics of participants, for example, age and gender. The data extraction process will be conducted by two reviewers, with Microsoft Excel being used as the tool for data collection. Any disagreements between the two reviewers will be resolved by discussion or consulting with the third reviewer; the characteristics of the study are provided in online supplemental file 3.

Dealing with missing data

In cases where data are unavailable, two reviewers will make efforts to contact the original authors via email or phone to request supplementary information. Should the data remain unattainable, the study will be omitted from the analysis. The potential influence of missing data on the comprehensive analysis will be evaluated through sensitivity analysis.

Study risk of bias assessment

Two reviewers will assess the quality of the included studies. Disagreement between the two reviewers will be resolved by discussion with the third reviewer.

We will evaluate the included RCTs’ quality using the Cochrane Handbook’s ‘risk of bias’ technique.27 Sequence generation, allocation concealment, blinding, incomplete data and selective reporting were assessed, and each of them was graded as ‘yes (+)’, ‘no (-)’ or ‘unclear (?)’, which reflected low risk of bias, high risk of bias and uncertain risk of bias, respectively.28 The Newcastle-Ottawa scale will be used to evaluate the methodological rigour of non-randomised studies. The Newcastle-Ottawa scale consists of eight items that are divided into three categories: selection (four items, one star each), comparability (one item, up to two stars) and exposure/outcome (three items, one star each).29 One star will be given for each item in the selection and outcome domains, and up to two stars will be given for the comparability domain when a primary study satisfies the methodological required standard. Studies with star values between 0 and 4 will ultimately be classified as having a high risk of bias, studies with scores between 5 and 6 as having a moderate risk of bias and studies with scores between 7 and 9 as having a low risk of bias.30

Patient and public involvement

Since this study will focus on reviewing existing literature, there will be no direct participation of patients or the public. While patients will not be engaged in data collection or analysis for this review, their input, along with that of the public, will be considered in shaping future research stemming from this study.

Data analysis

Statistical analysis

Meta-analysis will be planned with sufficient clinically and statistically homogeneous and comparable reported outcomes among studies by pooling data using Review Manager V.5.4 software by The Cochrane Collaboration. Dichotomous data will be compared using a risk ratio or OR. Respective 95% CI will be calculated for each estimate and presented in forest plots.

Statistical heterogeneity will be assessed visually by Q and I2 statistics.31 For the Q statistic, a p value <0.10 will be regarded as statistically significant for heterogeneity. For the I2 statistic,32 if there is heterogeneity among the study results (I2>50%), the heterogeneity source will be further examined. After the exclusion of effects exerted by significant clinical heterogeneity, the random-effects model will be used for the meta-analysis.33 34 If there is no heterogeneity between the study results (I2<50%), this study will use the fixed-effect model in terms of meta-analysis.35 36 All reported p values are two-sided, and p values <0.05 will be regarded as significant for all included studies. In cases of significant heterogeneity encountered during the meta-analysis procedure, several strategies will be implemented. First, a subgroup analysis will be conducted to classify studies according to potential sources of heterogeneity, leading to separate meta-analyses for each subgroup. Second, meta-regression techniques will be used to examine study attributes and pinpoint factors that may be influencing the observed heterogeneity. Finally, if challenges with high heterogeneity persist, the option of transforming the meta-analysis into a systematic review will be considered, allowing for a qualitative synthesis of studies without quantitative amalgamation.

Assessment of publication bias

The funnel plot will be used to assess reporting bias. A symmetrical funnel shape will suggest the absence of publication bias, whereas an asymmetrical funnel plot will indicate the presence of such bias. An objective assessment of publication bias will be conducted using Egger’s linear regression test, where a p value <0.1 is considered statistically significant, indicating the presence of publication bias.37 38 We will conduct a trim-and-fill analysis to address any potential publication bias. This method involves excluding outlier studies and estimating hypothetical missing studies to create a balanced funnel plot.

Subgroup and sensitivity analyses

Subgroup analyses will be conducted based on study and population variables, including study type, age, gender, intervention approaches, sample size and other factors. For sensitivity analysis, studies of poorer methodological quality will be removed to see whether their deletion alters the outcomes of the analyses. In particular, we will exclude non-randomised studies deemed to be of low quality (rated between 0 and 4 stars) and those RCTs identified as having a high risk of bias. This methodology will enable us to evaluate the reliability of our findings and pinpoint any potential sources of bias. When heterogeneity is substantial, the leave-one-out method is used to ascertain whether it arises from a specific study. For instance, to ascertain whether heterogeneity diminishes, we eliminate one study. This approach is used to investigate each study individually in order to identify the root cause of heterogeneity.

Grading the quality of evidence

The evaluation of the evidence’s quality throughout the entire study will be conducted using the Grading of Recommendations Assessment, Development and Evaluation (GRADE) framework.39–41 This system is frequently used to evaluate the credibility of evidence and determine the level of recommendations. Two independent reviewers will use the five GRADE considerations, including the risk of bias, consistency of effect, imprecision, indirectness and publication bias, to meticulously evaluate the certainty of the evidence and arrive at sound conclusions.42 43 Verification will be carried out upon completion, and any uncertainties will be deliberated among reviewers or escalated to a third expert for guidance.

The level of evidence will be assessed and categorised as high, moderate, low or very low. RCT evidence is initially considered to have a high level of certainty, but this evaluation may be adjusted downwards if factors such as the risk of bias, indirectness, inconsistency, imprecision and publication bias are identified. On the other hand, evidence from observational studies is typically assigned a low level of certainty, but this rating may be elevated if there is evidence for a large magnitude of effect, mitigation of potential bias or confounding factors, leading to an upgrade from the initial low rating. Strong recommendations are made when there is a high level of evidence, while practice considerations are given when there is a moderate level of evidence. When the evidence level is below moderate, it is stated that there is insufficient evidence from the scientific literature to provide guidance to policymakers, clinicians, and patients.

Updates to study protocol

If modifications to the review protocol are deemed necessary, these adjustments will be thoroughly documented and incorporated as supplementary material alongside the final manuscript. Additionally, these updates will be reflected on the OSF register for future reference.

Ethics and dissemination

Ethical approval is dispensable for this study since no private information of the participants will be involved. The findings of the present study will be disseminated through a peer-reviewed journal or conference presentation.

Ethics statements

Patient consent for publication

References

Supplementary materials

Footnotes

  • Contributors XH conceived the study. XH and YC registered the protocol. XH and WL drafted the protocol. YC and JL revised it. XH and YR developed the search strategies and will run them. XH and YR will select studies and extract data. XH and DZ will analyze the data. All authors contributed to the article and approved the submitted version. XH is the guarantor.

  • Funding Science and technology project of Fuzhou Medical College of Nanchang University (fykj202404); science and technology project of Jiangxi Provincial Administration of Traditional Chinese Medicine (2023A0289); science and technology project of Jiangxi Provincial Administration of Traditional Chinese Medicine (2022B1103); Jiangxi Province Key Research and Development Program (2020YBBGWL001), Jiangxi Provincial Department of Education Science and Technology research key project (GJJ208902).

  • Competing interests None declared.

  • Patient and public involvement Patients and/or the public were not involved in the design, or conduct, or reporting, or dissemination plans of this research.

  • Provenance and peer review Not commissioned; externally peer reviewed.

  • Supplemental material This content has been supplied by the author(s). It has not been vetted by BMJ Publishing Group Limited (BMJ) and may not have been peer-reviewed. Any opinions or recommendations discussed are solely those of the author(s) and are not endorsed by BMJ. BMJ disclaims all liability and responsibility arising from any reliance placed on the content. Where the content includes any translated material, BMJ does not warrant the accuracy and reliability of the translations (including but not limited to local regulations, clinical guidelines, terminology, drug names and drug dosages), and is not responsible for any error and/or omissions arising from translation and adaptation or otherwise.