Download PDFPDF

Order effects in high stakes undergraduate examinations: an analysis of 5 years of administrative data in one UK medical school
Compose Response

Plain text

  • No HTML tags allowed.
  • Web page addresses and e-mail addresses turn into links automatically.
  • Lines and paragraphs break automatically.
Author Information
First or given name, e.g. 'Peter'.
Your last, or family, name, e.g. 'MacMoody'.
Your email address, e.g.
Your role and/or occupation, e.g. 'Orthopedic Surgeon'.
Your organization or institution (if applicable), e.g. 'Royal Free Hospital'.
Statement of Competing Interests


  • Responses are moderated before posting and publication is at the absolute discretion of BMJ, however they are not peer-reviewed
  • Once published, you will not have the right to remove or edit your response. Removal or editing of responses is at BMJ's absolute discretion
  • If patients could recognise themselves, or anyone else could recognise a patient from your description, please obtain the patient's written consent to publication and send them to the editorial office before submitting your response [Patient consent forms]
  • By submitting this response you are agreeing to our full [Response terms and requirements]

Vertical Tabs

Other responses

  • Published on:
    Sharing of information in objective structured clinical examinations -- does no evidence of difference mean evidence of no difference?

    Recently, the University of Glasgow medical school had to ask all medical students to retake their Objective Structured Clinical Examinations (OSCE) because of leaking of exam details online.<1> In contrary, this study here suggested that quarantining students to prevent collusion is unnecessary.<2> When I studied medicine at the University of Birmingham, I was also told that knowing the OSCE questions prior to the exam make no difference in the scores. I always find these data counter-intuitive, as I cannot explain why knowing the exam questions beforehand would not give candidates an advantage. I am aware that other students are similarly concerned about the fairness of OSCEs when information is colluded, but are told that the data suggest otherwise.<3> I would like to comment on the validity of these data here.

    First of all, all medical students and graduates must have heard of the phrase ‘no evidence of difference does not mean evidence of no difference’ during their epidemiology and research modules. As an analogy, if I don’t hate you, it doesn’t mean I love you. When a study fails to detect statistical significance among groups, it could be due to a Type II error, meaning failure to detect a difference when there is indeed a difference. Although the authors of the current study stated that other studies also failed to show inter-day difference in students’ OSCE performance, researchers cannot declare no difference between groups -- they must...

    Show More
    Conflict of Interest:
    None declared.