Download full text
(external source)
Citation Suggestion
Please use the following Persistent Identifier (PID) to cite this document:
https://doi.org/10.12758/mda.2022.04
Exports for your reference manager
Factorial Surveys with Multiple Ratings per Vignette: A Seemingly Unrelated Multilevel Regressions Framework
[journal article]
Abstract Factorial surveys are a prominent tool in the social sciences. Reanalyzing a literature survey on the factorial survey approach (Wallander, 2009), I show that about a quarter of applied factorial surveys asks respondents to provide multiple ratings on the same vignette. This paper is the first to ... view more
Factorial surveys are a prominent tool in the social sciences. Reanalyzing a literature survey on the factorial survey approach (Wallander, 2009), I show that about a quarter of applied factorial surveys asks respondents to provide multiple ratings on the same vignette. This paper is the first to propose a statistical modeling approach for precisely this situation. Data from factorial surveys with multiple ratings per vignette are afflicted with two sources of statistical dependencies. First, each respondent answers multiple vignettes, which is typically accounted for via random effects models, and, second, each vignette prompts multiple ratings. The first problem is common for almost any factorial survey and has been addressed decades ago. The second problem is addressed here. I propose to apply a seemingly unrelated regression approach to account for the statistical dependencies between multiple ratings per vignette. Due to the use of a structural equation modeling approach, the model allows not only to correctly compare coefficients across ratings but also to analyze the factor structure underlying these ratings. The proposed model is illustrated by two examples from recent research. All data and syntax are available online and allows for an easy adaption of the proposed model to readers’ own research.... view less
Keywords
survey research; data capture; data collection method; factor analysis; regression
Classification
Methods and Techniques of Data Collection and Data Analysis, Statistical Methods, Computer Methods
Free Keywords
factorial survey; vignette study; seemingly unrelated regressions; multiple ratings; multilevel; random effects; factor analysis; latent variables
Document language
English
Publication Year
2022
Page/Pages
p. 335-360
Journal
Methods, data, analyses : a journal for quantitative methods and survey methodology (mda), 16 (2022) 2
ISSN
2190-4936
Status
Published Version; peer reviewed