Download full text
(external source)
Citation Suggestion
Please use the following Persistent Identifier (PID) to cite this document:
https://doi.org/10.18148/srm/2020.v14i1.7374
Exports for your reference manager
Attention Check Items and Instructions in Online Surveys with Incentivized and Non-Incentivized Samples: Boon or Bane for Data Quality?
[journal article]
Abstract In this paper, we examine rates of careless responding and reactions towards detection methods (i.e., attention check item and instruction) in an experimental setting based on two different samples. First, we use a quota sample (with monetary incentive), a central data source for internet-based surv... view more
In this paper, we examine rates of careless responding and reactions towards detection methods (i.e., attention check item and instruction) in an experimental setting based on two different samples. First, we use a quota sample (with monetary incentive), a central data source for internet-based surveys in sociological and political research. Second, we include a voluntary opt-in panel (without monetary incentive) well suited to conduct survey experiments (e.g., factorial surveys). Respondents’ reactions towards the detection items are analyzed by objective, non-reactive indicators (i.e., break-off, item nonresponse, and measurement quality), and two self-report scales. Our reaction analyses reveal that the detection methods that we applied are not only well suited to identify careless respondents but also exert a motivational rather than demotivating influence on respondents’ answer behavior and, hence, contribute to data quality.... view less
Keywords
response behavior; measurement; quality; data quality; online survey; justice; survey research; quota; sample; questionnaire; participation; social participation; ISSP
Classification
Methods and Techniques of Data Collection and Data Analysis, Statistical Methods, Computer Methods
Free Keywords
careless responding; inattentive responding; satisficing; detection method; online survey; true-score-models; multi-trait-multi-method (MTMM); decent life; ZA5719 (Datenfile Version 2.0.0.): Langfrist-online-tracking, T19 (GLES); ZA3430: International Social Survey Programme: Social Inequality III - ISSP 1999
Document language
English
Publication Year
2020
Page/Pages
p. 55-77
Journal
Survey Research Methods, 14 (2020) 1
ISSN
1864-3361
Status
Published Version; peer reviewed