Bookmark and Share

Prior exposure to instructional manipulation checks does not attenuate survey context effects driven by satisficing or Gricean norms


Hauser, David J.; Sunderrajan, Aashna; Natarajan, Madhuri; Schwarz, Norbert


Bitte beziehen Sie sich beim Zitieren dieses Dokumentes immer auf folgenden Persistent Identifier (PID):http://dx.doi.org/10.12758/mda.2016.008

Weitere Angaben:
Abstract "Instructional manipulation checks (IMCs) are frequently included in unsupervised online surveys and experiments to assess whether participants pay close attention to the questions. However, IMCs are more than mere measures of attention - they also change how participants approach subsequent tasks, increasing attention and systematic reasoning. We test whether these previously documented changes in information processing moderate the emergence of response effects in surveys by presenting an IMC either before or after questions known to produce classic survey context effects. When the items precede an IMC, familiar satisficing as well as conversational effects replicate. More important, their pattern and size does not change when the items follow an IMC, in contrast to experiments with reasoning tasks. Given a power of 82% to 98% to detect an effect of d=.3, we conclude that prior exposure to an IMC is unlikely to increase or attenuate these types of context effects in surveys." (author's abstract)
Thesaurusschlagwörter survey research; data collection method; online survey; data capture; data quality; response behavior
Klassifikation Erhebungstechniken und Analysetechniken der Sozialwissenschaften
Methode Grundlagenforschung; Methodenentwicklung
Freie Schlagwörter instructional manipulation checks; survey context effects; satisficing; Gricean conversational norms
Sprache Dokument Englisch
Publikationsjahr 2016
Seitenangabe S. 195-220
Zeitschriftentitel Methods, data, analyses : a journal for quantitative methods and survey methodology (mda), 10 (2016) 2
ISSN 2190-4936
Status Veröffentlichungsversion; begutachtet (peer reviewed)
Lizenz Creative Commons - Namensnennung