Seriousness checks are useful to improve data validity in online research

Behav Res Methods. 2013 Jun;45(2):527-35. doi: 10.3758/s13428-012-0265-2.

Abstract

Nonserious answering behavior increases noise and reduces experimental power; it is therefore one of the most important threats to the validity of online research. A simple way to address the problem is to ask respondents about the seriousness of their participation and to exclude self-declared nonserious participants from analysis. To validate this approach, a survey was conducted in the week prior to the German 2009 federal election to the Bundestag. Serious participants answered a number of attitudinal and behavioral questions in a more consistent and predictively valid manner than did nonserious participants. We therefore recommend routinely employing seriousness checks in online surveys to improve data validity.

Publication types

  • Validation Study

MeSH terms

  • Adolescent
  • Adult
  • Age Factors
  • Attitude*
  • Data Interpretation, Statistical*
  • Educational Status
  • Female
  • Germany
  • Humans
  • Information Storage and Retrieval / standards
  • Male
  • Online Systems / standards*
  • Patient Selection*
  • Politics*
  • Population Surveillance
  • Reproducibility of Results
  • Research Design
  • Self Report / standards*
  • Surveys and Questionnaires / standards*
  • Young Adult