Parametric Predictive Bootstrap Method for the Reproducibility of Hypothesis Tests

Aldawsari, Abdulrahman M. A.; Coolen-Maturi, Tahani; Coolen, Frank P. A.

Abstract

Hypothesis tests are essential tools in applied statistics, but their results can vary when repeated. The reproducibility probability (RP) quantifies the probability of obtaining the same test outcome—either rejecting or not rejecting the null hypothesis—if a hypothesis test is repeated under identical conditions. In this paper, we apply the parametric predictive bootstrap (PP-B) method to evaluate the reproducibility of parametric tests and compare it with the nonparametric predictive bootstrap (NPI-B) method. The explicitly predictive nature of both methods aligns well with the concept of RP. Simulation studies demonstrate that PP-B provides RP values with less variability than NPI-B, benefiting from the assumed parametric model. The bootstrap approach offers a flexible framework for assessing test reproducibility and can be extended to a wide range of parametric tests.

Citation

Aldawsari, A. M. A., Coolen-Maturi, T., & Coolen, F. P. A. (2025). Parametric Predictive Bootstrap Method for the Reproducibility of Hypothesis Tests. Journal of statistical theory and practice, 19(2), Article 21. https://doi.org/10.1007/s42519-025-00438-2

• Journal Article Type: Article
• Acceptance Date: Mar 1, 2025
• Online Publication Date: Mar 18, 2025
• Publication Date: Jun 1, 2025
• Deposit Date: Mar 3, 2025
• Publicly Available Date: Mar 26, 2025
• Journal: Journal of Statistical Theory and Practice
• Electronic ISSN: 1559-8616
• Publisher: Springer
• Peer Reviewed: Peer Reviewed
• Volume: 19
• Issue: 2
• Article Number: 21
• DOI: https://doi.org/10.1007/s42519-025-00438-2
• Keywords: Hypothesis tests, Reproducibility probability, Bootstrap, Nonparametric predictive inference bootstrap, Parametric predictive bootstrap
• Public URL: https://durham-repository.worktribe.com/output/3670068