Download full text
(external source)
Citation Suggestion
Please use the following Persistent Identifier (PID) to cite this document:
https://doi.org/10.12758/mda.2021.05
Exports for your reference manager
In Search of the Best Response Scale in a Mixed-mode Survey (Web and Mail): Evidence from MTMM Experiments in the GESIS Panel
[journal article]
Abstract Mixed-mode surveys allow researchers to combine the advantages of multiple modes, for example, the low cost of the web mode with the higher coverage of offline modes. One drawback of combining modes is that there might be systematic differences in measurement across modes. Thus, it would be useful t... view more
Mixed-mode surveys allow researchers to combine the advantages of multiple modes, for example, the low cost of the web mode with the higher coverage of offline modes. One drawback of combining modes is that there might be systematic differences in measurement across modes. Thus, it would be useful to know which measurement methods work best in all employed modes. This study sets out to find a method that results in the highest measurement quality across self-administered web mode questionnaires (web mode) and self-administered paper questionnaires sent out by mail (mail mode). Two Multitrait-Multimethod (MTMM) experiments employing questions on environmental attitudes and supernatural beliefs were implemented in the GESIS Panel, a probability-based panel in Germany. The experiments were designed to estimate the measurement quality of three different response scales: A seven-point fully labelled scale, a 101-point numerical openended scale and an eleven-point partially labelled scale. Our results show that the elevenpoint partially labelled scale consistently leads to the highest measurement quality across both modes. We thus recommend using eleven-point partially labelled scales when measuring attitudes or beliefs in mixed-mode surveys combining web and mail mode.... view less
Keywords
survey research; data capture; measurement; quality; online survey; mail survey; questionnaire; data quality
Classification
Methods and Techniques of Data Collection and Data Analysis, Statistical Methods, Computer Methods
Free Keywords
measurement quality; length of response scales; labelling of response scales; Multitrait-Multimethod (MTMM); mixed-mode; self-completion; web mode; mail mode; GESIS Panel
Document language
English
Publication Year
2021
Page/Pages
p. 161-190
Journal
Methods, data, analyses : a journal for quantitative methods and survey methodology (mda), 15 (2021) 2
ISSN
2190-4936
Status
Published Version; peer reviewed