Systematic structural discrepancy assessment for computer models

Goldstein, Michael; Vernon, Ian; Cumming, Jonathan A.

Abstract

Model or structural discrepancy is an essential component in the analysis of computer simulators, representing the differences between the outputs of the simulator and the real-world system that the simulator seeks to represent. This discrepancy can arise from various sources such as simplifications of the model science in the simulator, choices made in our particular implementation of that science, and epistemic uncertainties such as the absence of features or science that we did not know to include or have yet to discover. In this paper, we define and distinguish two types of discrepancy: internal discrepancy that can be assessed by experiments on the simulator itself; and external discrepancy which lies outside the scope of such experiments. We present a tractable methodology and workflow for the assessment of structural discrepancy on the basis of collections of experiments applied to the computer model and illustrate our approach in the context of a simple biological model. This article is part of the theme issue ‘Uncertainty quantification for healthcare and biological systems (Part 2)’ .

Citation

Goldstein, M., Vernon, I., & Cumming, J. A. (2025). Systematic structural discrepancy assessment for computer models. Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences, 383(2293), Article 20240214. https://doi.org/10.1098/rsta.2024.0214

• Journal Article Type: Article
• Acceptance Date: Feb 6, 2025
• Online Publication Date: Apr 2, 2025
• Publication Date: Apr 2, 2025
• Deposit Date: Feb 6, 2025
• Publicly Available Date: Apr 3, 2025
• Journal: Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences
• Print ISSN: 1364-503X
• Electronic ISSN: 1471-2962
• Publisher: The Royal Society
• Peer Reviewed: Peer Reviewed
• Volume: 383
• Issue: 2293
• Article Number: 20240214
• DOI: https://doi.org/10.1098/rsta.2024.0214
• Keywords: discrepancy, emulation, computer models, model inadequacy
• Public URL: https://durham-repository.worktribe.com/output/3469277