Export für Ihre Literaturverwaltung

Übernahme per Copy & Paste



Bookmark and Share

Asking probing questions in web surveys: which factors have an impact on the quality of responses?


Behr, Dorothée; Kaczmirek, Lars; Bandilla, Wolfgang; Braun, Michael


Bitte beziehen Sie sich beim Zitieren dieses Dokumentes immer auf folgenden Persistent Identifier (PID):http://nbn-resolving.de/urn:nbn:de:0168-ssoar-449736

Weitere Angaben:
Abstract Cognitive interviewing is a well-established method for evaluating and improving a questionnaire prior to fielding. However, its present implementation brings with it some challenges, notably in terms of small sample sizes or the possibility of interviewer effects. In this study, the authors test web surveys through nonprobability online panels as a supplemental means to implement cognitive interviewing techniques. The overall goal is to tackle the above-mentioned challenges. The focus in this article is on methodological features that pave the way for an eventual successful implementation of category-selection probing in web surveys. The study reports on the results of 1,023 respondents from Germany. In order to identify implementation features that lead to a high number of meaningful answers, the authors explore the effects of (1) different panels, (2) different probing variants, and (3) different numbers of preceding probes on answer quality. The overall results suggest that category-selection probing can indeed be implemented in web surveys. Using data from two panels - a community panel where members can actively get involved, for example, by creating their own polls, and a "conventional" panel where answering surveys is the members' only activity - the authors find that high community involvement does not increase the likelihood to answer probes or produce longer statements. Testing three probing variants that differ in wording and provided context, the authors find that presenting the context of the probe (i.e., the probed item and the respondent's answer) produces a higher number of meaningful answers. Finally, the likelihood to answer a probe decreases with the number of preceding probes. However, the word count of those who eventually answer the probes slightly increases with an increasing number of probes. (author's abstract)
Thesaurusschlagwörter survey research; online survey; panel; data quality; questionnaire; development; measurement instrument; reactivity effect; response behavior; scaling
Klassifikation Erhebungstechniken und Analysetechniken der Sozialwissenschaften
Methode empirisch; empirisch-quantitativ; Grundlagenforschung; Methodenentwicklung
Sprache Dokument Englisch
Publikationsjahr 2012
Seitenangabe S. 487-498
Zeitschriftentitel Social Science Computer Review, 30 (2012) 4
DOI http://dx.doi.org/10.1177/0894439311435305
ISSN 0894-4393
Status Veröffentlichungsversion; begutachtet (peer reviewed)
Lizenz Deposit Licence - Keine Weiterverbreitung, keine Bearbeitung
Dieser Beitrag ist mit Zustimmung des Rechteinhabers aufgrund einer (DFG geförderten) Allianz- bzw. Nationallizenz frei zugänglich.