Professor Patrick Kuhn p.m.kuhn@durham.ac.uk
Professor
The Misreporting Trade-off Between List Experiments and Direct Questions in Practice: Partition Validation Evidence from Two Countries
Kuhn, Patrick M.; Vivyan, Nick
Authors
Professor Nick Vivyan nick.vivyan@durham.ac.uk
Professor
Abstract
To reduce strategic misreporting on sensitive topics, survey researchers increasingly use list experiments rather than direct questions. However, the complexity of list experiments may increase non-strategic misreporting. We provide the first empirical assessment of this trade-off between strategic and non-strategic misreporting. We field list experiments on election turnout in two different countries, collecting measures of respondents' true turnout. We detail and apply a partition validation method which uses true scores to distinguish true and false positives and negatives for list experiments, thus allowing detection of non-strategic reporting errors. For both list experiments, partition validation reveals non-strategic misreporting that is: undetected by standard diagnostics or validation; greater than assumed in extant simulation studies; and severe enough that direct turnout questions subject to strategic misreporting exhibit lower overall reporting error. We discuss how our results can inform the choice between list experiment and direct question for other topics and survey contexts.
Citation
Kuhn, P. M., & Vivyan, N. (2022). The Misreporting Trade-off Between List Experiments and Direct Questions in Practice: Partition Validation Evidence from Two Countries. Political Analysis, 30(3), 381-402. https://doi.org/10.1017/pan.2021.10
Journal Article Type | Article |
---|---|
Acceptance Date | Dec 22, 2020 |
Online Publication Date | Apr 16, 2021 |
Publication Date | 2022-07 |
Deposit Date | Jan 5, 2021 |
Publicly Available Date | Mar 28, 2024 |
Journal | Political Analysis |
Print ISSN | 1047-1987 |
Electronic ISSN | 1476-4989 |
Publisher | Political Methodology Section |
Peer Reviewed | Peer Reviewed |
Volume | 30 |
Issue | 3 |
Pages | 381-402 |
DOI | https://doi.org/10.1017/pan.2021.10 |
Files
Published Journal Article (Advance online version)
(629 Kb)
PDF
Publisher Licence URL
http://creativecommons.org/licenses/by/4.0/
Copyright Statement
Advance online version © The Author(s) 2021. Published
by Cambridge University Press
on behalf of the Society for
Political Methodology. This is an
Open Access article, distributed
under the terms of the Creative
Commons Attribution licence
(http://creativecommons.org/
licenses/by/4.0/), which permits
unrestricted re-use, distribution,
and reproduction in any
medium, provided the original
work is properly cited.
You might also like
Advantages, Challenges and Limitations of Audit Experiments with Constituents
(2021)
Journal Article
Psychological Threat and Turnout Misreporting
(2021)
Journal Article
A Choice-Based Measure of Issue Importance in the Electorate
(2020)
Journal Article
Who Votes More Strategically?
(2020)
Journal Article
Costly signals: Voter responses to parliamentary dissent in Austria, Britain and Germany
(2020)
Journal Article
Downloadable Citations
About Durham Research Online (DRO)
Administrator e-mail: dro.admin@durham.ac.uk
This application uses the following open-source libraries:
SheetJS Community Edition
Apache License Version 2.0 (http://www.apache.org/licenses/)
PDF.js
Apache License Version 2.0 (http://www.apache.org/licenses/)
Font Awesome
SIL OFL 1.1 (http://scripts.sil.org/OFL)
MIT License (http://opensource.org/licenses/mit-license.html)
CC BY 3.0 ( http://creativecommons.org/licenses/by/3.0/)
Powered by Worktribe © 2024
Advanced Search