Download full text
(613.2Kb)
Citation Suggestion
Please use the following Persistent Identifier (PID) to cite this document:
https://nbn-resolving.org/urn:nbn:de:0168-ssoar-85091-4
Exports for your reference manager
The Issue of Noncompliance in Attention Check Questions: False Positives in Instructed Response Items
[journal article]
Abstract Attention checks detect inattentiveness by instructing respondents to perform a specific task. However, while respondents may correctly process the task, they may choose to not comply with the instructions. We investigated the issue of noncompliance in attention checks in two web surveys. In Study 1... view more
Attention checks detect inattentiveness by instructing respondents to perform a specific task. However, while respondents may correctly process the task, they may choose to not comply with the instructions. We investigated the issue of noncompliance in attention checks in two web surveys. In Study 1, we measured respondents’ attitudes toward attention checks and their self-reported compliance. In Study 2, we experimentally varied the reasons given to respondents for conducting the attention check. Our results showed that while most respondents understand why attention checks are conducted, a nonnegligible proportion of respondents evaluated them as controlling or annoying. Most respondents passed the attention check; however, among those who failed the test, 61% seem to have failed the task deliberately. These findings reinforce that noncompliance is a serious concern with attention check instruments. The results of our experiment showed that more respondents passed the attention check if a comprehensible reason was given.... view less
Keywords
survey research; data capture; data quality; online survey; attention; response behavior
Classification
Methods and Techniques of Data Collection and Data Analysis, Statistical Methods, Computer Methods
Document language
English
Publication Year
2022
Page/Pages
p. 346-360
Journal
Field Methods, 34 (2022) 4
DOI
https://doi.org/10.1177/1525822X221115830
ISSN
1552-3969
Status
Published Version; peer reviewed