Sources of bias in outcome assessment in randomised controlled trials: a case study

Ainsworth, H.; Hewitt, C.; Torgerson, C.; Higgins, S.; Wiggins, A.; Torgerson, D.

Abstract

Randomised controlled trials (RCTs) can be at risk of bias. Using data from a RCT we considered the impact of post-randomisation bias. We compared the trial primary outcome, which was administered blindly, with the secondary outcome which was not administered blindly. 522 children from 44 schools were randomised to receive a one-to-one maths tuition programme that was assessed using two outcome measures. The primary outcome measure was assessed blindly whilst the secondary outcome was delivered by the classroom teacher and therefore this was un-blinded. The effect sizes for primary and secondary outcomes were substantially different (0.33 and 1.11 respectively). Test questions that were similar between the two tests this did not explain the difference. There was greater heterogeneity between schools for the primary outcome, compared with the secondary outcome. We conclude that, in this trial, the difference between the primary and secondary outcomes was likely to have been due to lack of blinding of testers.

Citation

Ainsworth, H., Hewitt, C., Torgerson, C., Higgins, S., Wiggins, A., & Torgerson, D. (2015). Sources of bias in outcome assessment in randomised controlled trials: a case study. Educational Research and Evaluation, 21(1), 3-14. https://doi.org/10.1080/13803611.2014.985316

• Journal Article Type: Article
• Acceptance Date: Oct 14, 2014
• Online Publication Date: Nov 24, 2014
• Publication Date: Feb 1, 2015
• Deposit Date: Nov 6, 2014
• Publicly Available Date: May 24, 2016
• Journal: Educational Research and Evaluation
• Print ISSN: 1380-3611
• Electronic ISSN: 1744-4187
• Publisher: Taylor and Francis Group
• Peer Reviewed: Peer Reviewed
• Volume: 21
• Issue: 1
• Pages: 3-14
• DOI: https://doi.org/10.1080/13803611.2014.985316
• Keywords: Randomised trials, Methodology, Blinding, Treatment inherent; measures.
• Public URL: https://durham-repository.worktribe.com/output/1442444