Professor Steven Bradley s.p.bradley@durham.ac.uk
Professor
Addressing Bias to Improve Reliability in Peer Review of Programming Coursework
Bradley, Steven
Authors
Abstract
Peer review has many potential pedagogical benefits, particularly in the area of programming, where it is a part of everyday professional practice. Although sometimes used for formative assessment, it is less commonly used for summative assessment, partly because of a perceived difficulty with reliability. We explore the use of a hierarchical Bayesian model to account for varying bias and precision amongst student assessors. We show that the model is sound and produces benefits in assessment reliability in real assessments. Such analyses have been used in essay subjects before but not, to our knowledge, within programming.
Citation
Bradley, S. (2019, November). Addressing Bias to Improve Reliability in Peer Review of Programming Coursework. Presented at Koli Calling 2019, Finland
Presentation Conference Type | Conference Paper (published) |
---|---|
Conference Name | Koli Calling 2019 |
Acceptance Date | Sep 11, 2019 |
Online Publication Date | Nov 21, 2019 |
Publication Date | Nov 21, 2019 |
Deposit Date | Oct 30, 2019 |
Publicly Available Date | Jan 28, 2020 |
Pages | 1-19 |
Book Title | Koli Calling '19 : proceedings of the 19th Koli Calling International Conference on Computing Education Research. |
DOI | https://doi.org/10.1145/3364510.3364523 |
Public URL | https://durham-repository.worktribe.com/output/1141608 |
Files
Accepted Conference Proceeding
(1.1 Mb)
PDF
Copyright Statement
© 2019 Copyright held by the owner/author(s). This is the author's version of the work. It is posted here for your personal use. Not for redistribution. The definitive Version of Record was published in Koli Calling '19 : Proceedings of the 19th Koli Calling International Conference on Computing Education Research, https://doi.org/10.1145/3364510.3364523
You might also like
Economical crowdsourcing for camera trap image classification
(2018)
Journal Article
ExBERT: An External Knowledge Enhanced BERT for Natural Language Inference
(2021)
Book Chapter
Downloadable Citations
About Durham Research Online (DRO)
Administrator e-mail: dro.admin@durham.ac.uk
This application uses the following open-source libraries:
SheetJS Community Edition
Apache License Version 2.0 (http://www.apache.org/licenses/)
PDF.js
Apache License Version 2.0 (http://www.apache.org/licenses/)
Font Awesome
SIL OFL 1.1 (http://scripts.sil.org/OFL)
MIT License (http://opensource.org/licenses/mit-license.html)
CC BY 3.0 ( http://creativecommons.org/licenses/by/3.0/)
Powered by Worktribe © 2024
Advanced Search