Download full text
(1.779Mb)
Citation Suggestion
Please use the following Persistent Identifier (PID) to cite this document:
https://nbn-resolving.org/urn:nbn:de:0168-ssoar-91644-3
Exports for your reference manager
The Impact of Survey Mode Design and Questionnaire Length on Measurement Quality
[journal article]
Abstract Mixed-mode surveys are popular as they can save costs and maintain (or improve) response rates relative to single-mode surveys. Nevertheless, it is not yet clear how design decisions like survey mode or questionnaire length impact measurement quality. In this study, we compare measurement quality in... view more
Mixed-mode surveys are popular as they can save costs and maintain (or improve) response rates relative to single-mode surveys. Nevertheless, it is not yet clear how design decisions like survey mode or questionnaire length impact measurement quality. In this study, we compare measurement quality in an experiment of three distinct survey designs implemented in the German sample of the European Values Study: a single-mode face-to-face design, a mixed-mode mail/web design, and a shorter (matrix) questionnaire in the mixed-mode design. We compare measurement quality in different ways, including differences in distributions across several data quality indicators as well as equivalence testing over 140 items in 25 attitudinal scales. We find similar data quality across the survey designs, although the mixed-mode survey shows more item nonresponse compared to the single-mode survey. Using equivalence testing we find that most scales achieve metric equivalence and, to a lesser extent, scalar equivalence across the designs.... view less
Keywords
EVS; data quality; survey; questionnaire; data collection method; measurement; response behavior; survey research
Classification
Methods and Techniques of Data Collection and Data Analysis, Statistical Methods, Computer Methods
Free Keywords
matrix sampling, mixed-mode survey, measurement invariance, split questionnaire; European Values Study 2017: Integrated Dataset (EVS 2017) (ZA7500 v3.0.0)
Document language
English
Publication Year
2022
Page/Pages
p. 1-50
Journal
Sociological Methods & Research (2022) OnlineFirst
DOI
https://doi.org/10.1177/00491241221140139
ISSN
1552-8294
Status
Published Version; peer reviewed