Seriousness check

The seriousness check is a technique that can be used in online research (also called Internet-based research, Web-based research, Web-based experiments) to improve data quality. Nowadays, many scientific studies with human participants are conducted online and are accessible to a large diversity of participants. Nonetheless, many people just want to look at the different pages of the questionnaire, instead of giving carefully chosen answers to the questions. The seriousness check addresses this problem: In this approach the respondents are asked about the seriousness of their participation or for a probability estimate that they will complete the entire study or experiment. Thus, by using the seriousness check irrelevant data entries can be easily identified and be excluded from the data analysis.

Seriousness checks can be implemented both before and after participation in the study. However, it has been shown that the seriousness check is a good predictor of dropout rates when implemented in the first page of the experiment.

There are Web-based tools, e.g. WEXTOR, that implement the seriousness check by default.

Several studies have shown that performing a seriousness check at the start of a study best predicts motivation and dropout probability. It was observed that of those answering “I would like to look at the pages only" around 75% will drop, while of those answering “I would like to seriously participate now" only ca. 10-15% will drop during the study. Overall, about 30-50% of visitors will fail the seriousness check, i.e. answer “I would like to look at the pages only". Moreover, it was found that emphasizing seriousness increased information seeking in participants and the time they spent on the study. Following up on this, it was shown that motivation and self-reported seriousness significantly predict several data quality indicators