Download full text
(2.529Mb)
Citation Suggestion
Please use the following Persistent Identifier (PID) to cite this document:
https://nbn-resolving.org/urn:nbn:de:0168-ssoar-85103-7
Exports for your reference manager
Relying on External Information Sources When Answering Knowledge Questions in Web Surveys
[journal article]
Abstract Knowledge questions frequently are used in survey research to measure respondents’ topic-related cognitive ability and memory. However, in self-administered surveys, respondents can search external sources for additional information to answer a knowledge question correctly. In this case, the knowled... view more
Knowledge questions frequently are used in survey research to measure respondents’ topic-related cognitive ability and memory. However, in self-administered surveys, respondents can search external sources for additional information to answer a knowledge question correctly. In this case, the knowledge question measures accessible and procedural memory. Depending on what the knowledge question aims at, the validity of this measure is limited. Thus, in this study, we conducted three experiments using a web survey to investigate the effects of task difficulty, respondents’ ability, and respondents’ motivation on the likelihood of searching external sources for additional information as a form of over-optimizing response behavior when answering knowledge questions. We found that the respondents who are highly educated and more interested in a survey are more likely to invest additional efforts to answer knowledge questions correctly. Most importantly, our data showed that for these respondents, a more difficult question design further increases the likelihood of over-optimizing response behavior.... view less
Keywords
survey research; online survey; questionnaire; cognitive ability; measurement; response behavior; data quality
Classification
Methods and Techniques of Data Collection and Data Analysis, Statistical Methods, Computer Methods
Free Keywords
knowledge questions; measurement error; paradata; satisficing; web surveys
Document language
English
Publication Year
2022
Page/Pages
p. 816-836
Journal
Sociological Methods & Research, 51 (2022) 2
DOI
https://doi.org/10.1177/0049124119882470
ISSN
1552-8294
Status
Published Version; peer reviewed
Licence
Deposit Licence - No Redistribution, No Modifications