Cookies

We use cookies to ensure that we give you the best experience on our website. By continuing to browse this repository, you give consent for essential cookies to be used. You can read more about our Privacy and Cookie Policy.


Durham Research Online
You are in:

Application of Bayesian posterior probabilistic inference in educational trials

Uwimpuhwe, Germaine and Singh, Akansha and Higgins, Steve and Kasim, Adetayo (2021) 'Application of Bayesian posterior probabilistic inference in educational trials.', International journal of research & method in education., 44 (5). pp. 533-554.

Abstract

Educational researchers advocate the use of an effect size and its confidence interval to assess the effectiveness of interventions instead of relying on a p-value, which has been blamed for lack of reproducibility of research findings and the misuse of statistics. The aim of this study is to provide a framework, which can provide direct evidence of whether an intervention works for the study participants in an educational trial as the first step before generalizing evidence to the wider population. A hierarchical Bayesian model was applied to ten cluster and multisite educational trials funded by the Education Endowment Foundation in England, to estimate the effect size and associated credible intervals. The use of posterior probability is proposed as an alternative to p-values as a simple and easily interpretable metric of whether an intervention worked or not. The probability of at least one month’s progression or any other appropriate threshold is proposed to use in education outcomes instead of using a threshold of zero to determine a positive impact. The results show that the probability of at least one month’s progress ranges from 0.09 for one trial, GraphoGame Rime, to 0.94 for another, the Improving Numeracy and Literacy trial.

Item Type:Article
Full text:(AM) Accepted Manuscript
Download PDF
(1154Kb)
Status:Peer-reviewed
Publisher Web site:https://doi.org/10.1080/1743727X.2020.1856067
Publisher statement:This is an Accepted Manuscript of an article published by Taylor & Francis in International Journal of Research & Method in Education on 17th December 2020, available online: http://www.tandfonline.com/10.1080/1743727X.2020.1856067
Date accepted:23 November 2020
Date deposited:08 January 2021
Date of first online publication:17 December 2020
Date first made open access:17 June 2022

Save or Share this output

Export:
Export
Look up in GoogleScholar