Download PDFPDF

Quantitative investigation of inappropriate regression model construction and the importance of medical statistics experts in observational medical research: a cross-sectional study
Compose Response

Plain text

  • No HTML tags allowed.
  • Web page addresses and e-mail addresses turn into links automatically.
  • Lines and paragraphs break automatically.
Author Information
First or given name, e.g. 'Peter'.
Your last, or family, name, e.g. 'MacMoody'.
Your email address, e.g.
Your role and/or occupation, e.g. 'Orthopedic Surgeon'.
Your organization or institution (if applicable), e.g. 'Royal Free Hospital'.
Statement of Competing Interests


  • A rapid response is a moderated but not peer reviewed online response to a published article in a BMJ journal; it will not receive a DOI and will not be indexed unless it is also republished as a Letter, Correspondence or as other content. Find out more about rapid responses.
  • We intend to post all responses which are approved by the Editor, within 14 days (BMJ Journals) or 24 hours (The BMJ), however timeframes cannot be guaranteed. Responses must comply with our requirements and should contribute substantially to the topic, but it is at our absolute discretion whether we publish a response, and we reserve the right to edit or remove responses before and after publication and also republish some or all in other BMJ publications, including third party local editions in other countries and languages
  • Our requirements are stated in our rapid response terms and conditions and must be read. These include ensuring that: i) you do not include any illustrative content including tables and graphs, ii) you do not include any information that includes specifics about any patients,iii) you do not include any original data, unless it has already been published in a peer reviewed journal and you have included a reference, iv) your response is lawful, not defamatory, original and accurate, v) you declare any competing interests, vi) you understand that your name and other personal details set out in our rapid response terms and conditions will be published with any responses we publish and vii) you understand that once a response is published, we may continue to publish your response and/or edit or remove it in the future.
  • By submitting this rapid response you are agreeing to our terms and conditions for rapid responses and understand that your personal data will be processed in accordance with those terms and our privacy notice.
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.

Vertical Tabs

Other responses

  • Published on:
    Discussion of “A quantitative investigation of inappropriate use of model selection and the importance of medical statistics experts in observational medical research: a cross-sectional study ” by Nojima, Tokunaga and Nagamura
    • Anthony Atkinson, Professor, Department of Statistics London School of Economics

    The problem is the method used in practice for the selection of variables to be included in logistic regression and Cox models in observational medical studies.

    The motivation comes from the authors’ work as statistical consultants. Many medical researchers had the idea that only variables which were individually significant should be included in the fitted model. This is in contrast to the correct procedure in which the model should contain variables that are jointly significant. To find these models requires fitting several models and selecting the best, rather than fitting just one. An example is in Table 1 below.

    The paper presents the results of a survey in which the frequency of an incorrect method of variable selection was measured as a function of the assessed statistical expertise of the authors of the papers: first author, any other author or none. The expertise was based on the authors’ departmental affiliations. It was found that the frequency of correct variable selection increased with the statistical qualifications of the authors. Clinical trials, as opposed to observational studies, were not included.

    The authors also consider how the situation might be improved. A breakdown of the results by country from papers in which the first author is not an expert shows North America and Northern Europe show relatively high expert involvement compared with East Asia, which have a lower involvement. Taiwan is an exception. In the authors’ own cou...

    Show More
    Conflict of Interest:
    None declared.