Article Text

Original research
Target and actual sample sizes for studies from two trial registries from 1999 to 2020: an observational study
  1. Adrian Gerard Barnett1,
  2. Paul Glasziou2
  1. 1Australian Centre for Health Services Innovation and Centre for Healthcare Transformation, School of Public Health & Social Work, Queensland University of Technology, Brisbane, Queensland, Australia
  2. 2CREBP, Bond University, Robina, Queensland, Australia
  1. Correspondence to Adrian Gerard Barnett; a.barnett{at}qut.edu.au

Abstract

Objectives To investigate differences between target and actual sample sizes, and what study characteristics were associated with sample sizes.

Design Observational study.

Setting The large trial registries of clinicaltrials.gov (starting in 1999) and ANZCTR (starting in 2005) through to 2021.

Participants Over 280 000 interventional studies excluding studies that were withheld, terminated for safety reasons or were expanded access.

Main outcome measures The actual and target sample sizes, and the within-study ratio of the actual to target sample size.

Results Most studies were small: the median actual sample sizes in the two databases were 60 and 52. There was a decrease over time in the target sample size of 9%–10% per 5 years, and a larger decrease of 18%–21% per 5 years for the actual sample size. The actual-to-target sample size ratio was 4.1% lower per 5 years, meaning more studies (on average) failed to hit their target sample size.

Conclusion Registered studies are more often under-recruited than over-recruited and worryingly both target and actual sample sizes appear to have decreased over time, as has the within-study gap between the target and actual sample size. Declining sample sizes and ongoing concerns about underpowered studies mean more research is needed into barriers and facilitators for improving recruitment and accessing data.

  • statistics & research methods
  • clinical trials
  • epidemiology

Data availability statement

Data are available in a public, open access repository. All data and code are openly available from the github database: https://github.com/agbarnett/registries.

http://creativecommons.org/licenses/by-nc/4.0/

This is an open access article distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited, appropriate credit is given, any changes made indicated, and the use is non-commercial. See: http://creativecommons.org/licenses/by-nc/4.0/.

Statistics from Altmetric.com

Request Permissions

If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.

Data availability statement

Data are available in a public, open access repository. All data and code are openly available from the github database: https://github.com/agbarnett/registries.

View Full Text

Supplementary materials

Footnotes

  • Twitter @aidybarnett

  • Contributors Study design and data interpretation: AGB and PG. Data analysis and initial manuscript drafting: AGB. Critical review of early and final versions of the manuscript: PG. AB is the guarantor.

  • Funding This work was supported by National Health and Medical Research Council (https://www.nhmrc.gov.au/) grant number APP1117784. The funders had no role in study design, data collection and analysis, decision to publish or preparation of the manuscript.

  • Competing interests Paul Glasziou is a member of the ANZCTR advisory committee.

  • Provenance and peer review Not commissioned; externally peer reviewed.

  • Supplemental material This content has been supplied by the author(s). It has not been vetted by BMJ Publishing Group Limited (BMJ) and may not have been peer-reviewed. Any opinions or recommendations discussed are solely those of the author(s) and are not endorsed by BMJ. BMJ disclaims all liability and responsibility arising from any reliance placed on the content. Where the content includes any translated material, BMJ does not warrant the accuracy and reliability of the translations (including but not limited to local regulations, clinical guidelines, terminology, drug names and drug dosages), and is not responsible for any error and/or omissions arising from translation and adaptation or otherwise.