Diese Seite wird derzeit technisch überarbeitet. Es kann dabei vorübergehend zu längeren Ladezeiten kommen. Wir bitten, eventuelle Unannehmlichkeiten zu entschuldigen und danken für Ihr Verständnis.
How Much is a Box? The Hidden Cost of Adding an Open-ended Probe to an Online Survey
[journal article]
dc.contributor.author | Luebker, Malte | de |
dc.date.accessioned | 2021-02-16T10:49:43Z | |
dc.date.available | 2021-02-16T10:49:43Z | |
dc.date.issued | 2021 | de |
dc.identifier.issn | 2190-4936 | de |
dc.identifier.uri | https://www.ssoar.info/ssoar/handle/document/71616 | |
dc.description.abstract | Probing questions, essentially open-ended comment boxes that are attached to a traditional closed-ended question, are increasingly used in online surveys. They give respondents an opportunity to share information that goes beyond what can be captured through standardized response categories. However, even when probes are non-mandatory, they can add to perceived response burden and incur a cost in the form of lower respondent cooperation. This paper seeks to measure this cost and reports on a survey experiment that was integrated into a short questionnaire on a German salary comparison site (N = 22,306). Respondents were randomly assigned to one of three conditions: a control without a probing question; a probe that was embedded directly into the closed-ended question; and a probe displayed on a subsequent page. For every meaningful comment gathered, the embedded design resulted in 0.1 break-offs and roughly 3.7 item missings for the closed-ended question. The paging design led to 0.2 additional break-offs for every open-ended answer it collected. Against expectations, smartphone users were more likely to provide meaningful (albeit shorter) open-ended answers than those using a PC or laptop. However, smartphone use also amplified the adverse effects of the probe on break-offs and item non-response to the closed-ended question. Despite documenting their hidden cost, this paper argues that the value of the additional information gathered by probes can make them worthwhile. In conclusion, it endorses the selective use of probes as a tool to better understand survey respondents. | de |
dc.language | en | de |
dc.subject.ddc | Sozialwissenschaften, Soziologie | de |
dc.subject.ddc | Social sciences, sociology, anthropology | en |
dc.subject.other | open-ended probes; survey experiment; mobile survey response | de |
dc.title | How Much is a Box? The Hidden Cost of Adding an Open-ended Probe to an Online Survey | de |
dc.description.review | begutachtet (peer reviewed) | de |
dc.description.review | peer reviewed | en |
dc.source.journal | Methods, data, analyses : a journal for quantitative methods and survey methodology (mda) | |
dc.source.volume | 15 | de |
dc.publisher.country | DEU | |
dc.source.issue | 1 | de |
dc.subject.classoz | Erhebungstechniken und Analysetechniken der Sozialwissenschaften | de |
dc.subject.classoz | Methods and Techniques of Data Collection and Data Analysis, Statistical Methods, Computer Methods | en |
dc.subject.thesoz | Mobiltelefon | de |
dc.subject.thesoz | Antwortverhalten | de |
dc.subject.thesoz | questionnaire | en |
dc.subject.thesoz | online survey | en |
dc.subject.thesoz | response behavior | en |
dc.subject.thesoz | Online-Befragung | de |
dc.subject.thesoz | survey research | en |
dc.subject.thesoz | cell phone | en |
dc.subject.thesoz | Umfrageforschung | de |
dc.subject.thesoz | Fragebogen | de |
dc.rights.licence | Creative Commons - Attribution 4.0 | en |
dc.rights.licence | Creative Commons - Namensnennung 4.0 | de |
internal.status | formal und inhaltlich fertig erschlossen | de |
internal.identifier.thesoz | 10040714 | |
internal.identifier.thesoz | 10035808 | |
internal.identifier.thesoz | 10037911 | |
internal.identifier.thesoz | 10060117 | |
internal.identifier.thesoz | 10037914 | |
dc.type.stock | article | de |
dc.type.document | journal article | en |
dc.type.document | Zeitschriftenartikel | de |
dc.source.pageinfo | 7-42 | de |
internal.identifier.classoz | 10105 | |
internal.identifier.journal | 614 | |
internal.identifier.document | 32 | |
internal.identifier.ddc | 300 | |
dc.source.issuetopic | The Use of Open-ended Questions in Surveys | en |
dc.identifier.doi | https://doi.org/10.12758/mda.2020.09 | de |
dc.description.pubstatus | Published Version | en |
dc.description.pubstatus | Veröffentlichungsversion | de |
internal.identifier.licence | 16 | |
internal.identifier.pubstatus | 1 | |
internal.identifier.review | 1 | |
internal.pdf.wellformed | true | |
internal.pdf.encrypted | false | |
ssoar.urn.registration | false | de |
Files in this item
This item appears in the following Collection(s)
-
Erhebungstechniken und Analysetechniken der Sozialwissenschaften
Methods and Techniques of Data Collection and Data Analysis, Statistical Methods, Computer Methods