R. Coe
Unobserved but not unimportant: The effects of unmeasured variables on causal attributions
Coe, R.
Authors
Abstract
The objective of the present study was to estimate how much difference the inclusion of plausibly important but unmeasured variables could make to estimates of the effects of educational programmes. Two examples of policy-relevant research in education were identified. A sensitivity analysis using Monte Carlo simulation was conducted to estimate the size of a possible spurious 'effect' that could actually be entirely due to the failure to incorporate a plausible unobserved variable. In both examples the effect size reported in the original study was within the range of possible spurious effects. What appeared to the original researchers to be substantial and unequivocal causal effects were reduced to tiny and uncertain differences when the effects of plausible unobserved differences were taken into account. Evaluators who rely on statistical control should be more cautious in making causal claims, consider possible effects of unmeasured variables and conduct sensitivity analyses. Alternatively, stronger designs should be used.
Citation
Coe, R. (2009). Unobserved but not unimportant: The effects of unmeasured variables on causal attributions. Effective education, 1(2), 101-122. https://doi.org/10.1080/19415530903522519
Journal Article Type | Article |
---|---|
Publication Date | Sep 1, 2009 |
Deposit Date | Feb 10, 2010 |
Publicly Available Date | Apr 1, 2011 |
Journal | Effective Education |
Print ISSN | 1941-5532 |
Electronic ISSN | 1941-5540 |
Publisher | Taylor and Francis |
Peer Reviewed | Peer Reviewed |
Volume | 1 |
Issue | 2 |
Pages | 101-122 |
DOI | https://doi.org/10.1080/19415530903522519 |
Keywords | Selection bias, Unobserved variables, Causal inference, Sensitivity analysis, Monte Carlo simulation, Education. policy. |
Files
Accepted Journal Article
(812 Kb)
PDF
Copyright Statement
This is an electronic version of an article published in Coe, R. (2009) 'Unobserved but not unimportant : the effects of unmeasured variables on causal attributions.', Effective education., 1 (2). pp. 101-122. Effective education is available online at: http://www.informaworld.com/smpp/content~db=all?content=10.1080/19415530903522519
You might also like
Teaching meta-analysis using MetaLight
(2012)
Digital Artefact
Downloadable Citations
About Durham Research Online (DRO)
Administrator e-mail: dro.admin@durham.ac.uk
This application uses the following open-source libraries:
SheetJS Community Edition
Apache License Version 2.0 (http://www.apache.org/licenses/)
PDF.js
Apache License Version 2.0 (http://www.apache.org/licenses/)
Font Awesome
SIL OFL 1.1 (http://scripts.sil.org/OFL)
MIT License (http://opensource.org/licenses/mit-license.html)
CC BY 3.0 ( http://creativecommons.org/licenses/by/3.0/)
Powered by Worktribe © 2024
Advanced Search