Article Text
PDF
Abstract
Introduction There is evidence that the use of some reporting guidelines, such as the Consolidated Standards for Reporting Trials, is associated with improved completeness of reporting in health research. However, the current levels of adherence to reporting guidelines are suboptimal. Over the last few years, several actions aiming to improve compliance with reporting guidelines have been taken and proposed. We will conduct a scoping review of interventions to improve adherence to reporting guidelines in health research that have been evaluated or suggested, in order to inform future interventions.
Methods and analysis Our review will follow the Joanna Briggs Institute scoping review methods manual. We will search for relevant studies in MEDLINE, EMBASE and Cochrane Library databases. Moreover, we will carry out lateral searches from the reference lists of the included studies, as well as from the lists of articles citing the included ones. One reviewer will screen the full list, which will be randomly split into two halves and independently screened by the other two reviewers. Two reviewers will perform data extraction independently. Discrepancies will be solved through discussion. In addition, this search strategy will be supplemented by a grey literature search. The interventions found will be classified as assessed or suggested, as well as according to different criteria, in relation to their target (journal policies, journal editors, authors, reviewers, funders, ethical boards or others) or the research stage at which they are performed (design, conducting, reporting or peer review). Descriptive statistical analysis will be performed.
Ethics and dissemination A paper summarising the findings from this review will be published in a peer-reviewed journal. This scoping review will contribute to a better understanding and a broader perspective on how the problem of adhering better to reporting guidelines has been tackled so far. This could be a major first step towards developing future strategies to improve compliance with reporting guidelines in health research.
- reporting guidelines
- scoping review
- adherence
This is an Open Access article distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited and the use is non-commercial. See: http://creativecommons.org/licenses/by-nc/4.0/
Statistics from Altmetric.com
Strengths and limitations of this study
Results from this scoping review will contribute to a broader perspective on how the problem of improving compliance with reporting guidelines has been addressed in the published literature thus far.
This scoping review is part of a larger project whose ultimate goal is to explore what strategies to improve adherence to reporting guidelines could be implemented and formally assessed.
A potential limitation could be the small number of eligible articles in the literature.
As this is a scoping review, the quality of the evidence will not be assessed.
Introduction
Reporting guidelines have been available since the inception of the Consolidated Standards for Reporting Trials (CONSORT) statement (1996), which provided a minimum set of recommendations for reporting randomised trials. From that time, different reporting guidelines for different study types, data and clinical areas have been developed. In general, these guidelines provide advice on how to report research methods and findings.1
Although the vast majority of reporting guidelines have not yet been assessed as to whether they help improve the reporting of research,2 for some of them, such as CONSORT, it has been shown that they may enhance the completeness of reporting.3 4
Dozens of systematic reviews have explored the extent of adherence to different reporting guidelines in some areas of health research.5–9 Samaan et al 10 went one step further and performed a systematic review of systematic reviews assessing adherence to reporting guidelines. As they considered a broad range of clinical areas and study designs since the creation of the CONSORT Statement, their results provided a global picture of compliance with reporting guidelines in health research. The authors determined that, although some studies reported acceptable overall reporting quality and stated that it has improved since the introduction of the CONSORT Statement, most of the reviews (43 of 50, 86%) concluded that more improvement is needed, or that the reporting quality was inadequate, poor, medium or suboptimal. For this reason, the authors outlined some recommendations to enhance adherence to reporting guidelines and encouraged action to develop strategies to improve the current state of completeness of reporting.
In recent years, different initiatives aiming to improve adherence to reporting guidelines have been proposed, and some of them have already been evaluated. For example, writing aid tools such as WebCONSORT11 have been developed and assessed, the influence of statistician involvement on quality of reporting has been evaluated12 and different studies have investigated the effect of explicitly endorsing reporting guidelines on completeness of reporting.3 4 13 14 While some of these actions have not been shown to have a benefit,11 12 others report better but still suboptimal levels of reporting.4 5 13 14 Therefore, further actions have to be taken to enhance the current levels of compliance with reporting guidelines.
As mentioned, several reviews have analysed the quality of reporting in different clinical areas and for different studies,5–10 but no scoping review investigating what actions have been taken or suggested in order to improve compliance with reporting guidelines has been performed so far. Given the low levels of completeness of reporting in health research observed10 and the need of taking further actions to mitigate this problem, we consider that performing such a scoping review is warranted.
The goal of this scoping review is to identify interventions aiming to improve adherence to reporting guidelines in health research. More specifically, in addition to quantify the effect of those already evaluated, our aim is to gather ideas suggested in the literature as possible interventions that could be implemented in the future.
Methods
Our research objectives will be addressed using established scoping review methodology. Since we aim to provide a wide overview of this field,15 and map the key concepts underpinning this research area and the main sources and types of evidence available, we consider that performing a scoping review is the most suitable approach.16 This protocol will follow the methodology manual published by the Joanna Briggs Institute for scoping reviews.17
Scoping review questions
We aim to answer the following questions:
What interventions to improve adherence to reporting guidelines in health research have been evaluated?
What actions to improve adherence to reporting guidelines have been suggested in the literature?
For each intervention found in the questions 1 and 2 above,
What was the target? We will consider the following possible targets: journal policies, journal editors, authors, reviewers, funders, ethical boards or others.
What research stages does it affect? We will consider the following possible research stages: design, conducting, reporting, and peer review.
In which healthcare area was it evaluated or suggested?
What was the rationale behind it?
In cases where it was evaluated,
How was it evaluated?
What reporting guidelines does it consider?
What was the effect on adherence to the reporting guidelines mentioned above?
Inclusion criteria
We will include:
Studies evaluating interventions aiming to improve the adherence to reporting guidelines in health research, irrespective of study design.
Commentaries, editorials, letters and studies containing ideas or suggestions of interventions that can be implemented.
The reporting guidelines considered will be those shown in the EQUATOR (Enhancing the QUAlity and Transparency Of Health Research) Network website1 as ‘Reporting Guidelines for main study types’ (see table 1). In addition, we will also include Quality of Reporting of Meta-analyses for systematic reviews, as it was the precursor of PRISMA.
Description of the acronyms and full names of the reporting guidelines shown in the EQUATOR website as ‘Reporting Guidelines for main study types’
Exclusion criteria
We will consider the following languages: English, French, German, Catalan and Spanish. Publications not written in any of those languages will be excluded.
Search strategy
We will search MEDLINE (via PubMed), EMBASE and Cochrane Library databases for relevant articles. The search will be limited to articles published between 1 January 1996 and 31 March 2017, given that the CONSORT Statement is considered the first reporting guideline in biomedical research and it was published in 1996. The search strategy has been developed with the help of a librarian of the Barcelona Tech. Table 2 and 3 show the detailed search terms for MEDLINE and EMBASE. The search terms for Cochrane Library are analogue to those used for EMBASE.
Search terms for MEDLINE (from 1 January 1996 to 31 March 2017) via PubMed
The retrieved studies will be exported into the reference manager Mendeley, which will be subsequently used to remove the duplicates. One reviewer (DB) will first screen the titles and abstracts for eligibility before reading the full texts, while the other two reviewers (EC and JJK) will be assigned and will also screen the titles and the abstracts of one of the two random halves in which the full list will be divided. This process will be carried out in Mendeley. Second, the reviewers will thoroughly examine the full text for all potentially eligible articles to confirm whether the study should be included or not. One reviewer (DB) will ensure literature saturation by searching the reference lists of included studies, as well as the lists of articles citing them, according to PubMed. Disagreement will be addressed by consensus after discussion, and the third reviewer (EC or JJK) will be consulted if no consensus is reached.
Search terms for EMBASE (from 1 January 1996 to 31 March 2017)
In addition, we will perform a grey literature search, including websites of networks promoting the use of reporting guidelines (ie, EQUATOR Network), organisations that offer resources for reviewers (ie, Publons), work groups of medical journal editors (ie, ICMJE), biomedical journal publishers (ie, BMJ Publishing Group) or funding agencies (ie, NIH). In addition, a non-systematic search in Google Scholar will be performed.
The starting date of the search is 8 May 2017.
Data extraction
The selected articles will be exported into an Excel file, where the data extraction will be performed. Two authors (DB and JJK) will independently extract data as shown below:
Publication characteristics: title, year of publication, author, design, country of origin and field of study.
Characteristics of the intervention:
Classification as evaluated or suggested.
Target: journal policies, authors, peer reviewers, journal editors, funders, ethical boards or others.
Research stage: design, conducting, reporting or peer review.
Healthcare area where it was evaluated or suggested.
Rationale.
In case that it was evaluated, way of assessment, reporting guidelines considered, and effect of the intervention on adherence to those reporting guidelines.
Overall conclusions by the authors.
If further information is needed, we will contact the authors of the included studies. Any disagreement will be solved by discussion.
Synthesis and reporting of results
The interventions found will be first divided in two groups: the ones that have already been evaluated and the ones that have not. For each group, the interventions will be classified according to their target population, as well as to the research stage at which they were performed or suggested. The general characteristics of included studies will be summarised. In addition, for the group of evaluated interventions, we will describe how the authors assessed them, what reporting guidelines they considered and what their effect on adherence to those reporting guidelines was. Descriptive statistical analysis will be performed.
A checklist for reporting scoping reviews, the ‘Preferred Reporting Items for Systematic Reviews and Meta-Analysis: extension for Scoping Reviews (PRISMA-ScR)’, is currently under development.18 However, according to its developers, it is highly unlikely that the checklist will be published before we report the results of the review.
Discussion
The aim of this review is to identify and classify interventions to improve adherence to reporting guidelines. We believe that having a wide picture of how the problem of adhering better to reporting guidelines has been tackled so far, as well as investigating what further actions have been suggested, is critical to facing the problem of improving adherence to reporting guidelines with a broader perspective.
This scoping review is part of a larger project whose ultimate goal is to explore what strategies to improve adherence to reporting guidelines could be implemented and formally assessed. The results of this review could send a message to funders, authors, editors and reviewers about what has already been done to face this critical problem, and about what else could be done from now on. We believe that this review could be a major first step towards developing future strategies to improve adherence to reporting guidelines.
Acknowledgments
The authors thank the MiRoR Project and Marie Curie Actions for their support and Montse Aragües for her help to develop the search strategy. They are especially grateful to Ketevan Glonti and Darko Hren for their thoughtful comments and suggestions on the final draft of the manuscript.
References
Footnotes
Contributors All authors: contributed to conceptualising and designing the study; read and approved the final version of the manuscript. DBdT-Dand EC: drafted the manuscript. IB, DM, DGA and JJK: made major revisions.
Funding This scoping review belongs to the ESR 14 research project from the Methods in Research on Research (MiRoR) project, which has received funding from the European Union’s Horizon 2020 research and innovation programme under the Marie Sklodowska-Curie grant agreement No 676207.
Competing interests None declared.
Provenance and peer review Not commissioned; externally peer reviewed.