Nonparametric predictive inference for reproducibility of two basic tests based on order statistics

Coolen, F.P.A.; Alqifari, H.N.

Abstract

Reproducibility of statistical hypothesis tests is an issue of major importance in applied statistics: if the test were repeated, would the same overall conclusion be reached, that is rejection or non-rejection of the null hypothesis? Nonparametric predictive inference (NPI) provides a natural framework for such inferences, as its explicitly predictive nature fits well with the core problem formulation of a repeat of the test in the future. NPI is a frequentist statistics method using relatively few assumptions, made possible by the use of lower and upper probabilities. For inference on reproducibility of statistical tests, NPI provides lower and upper reproducibility probabilities (RP). In this paper, the NPI-RP method is presented for two basic tests using order statistics, namely a test for a specific value for a population quantile and a precedence test for comparison of data from two populations, as typically used for experiments involving lifetime data if one wishes to conclude before all observations are available.

Citation

Coolen, F., & Alqifari, H. (2018). Nonparametric predictive inference for reproducibility of two basic tests based on order statistics. Revstat Statistical Journal, 16(2), 167-185

• Journal Article Type: Article
• Acceptance Date: Jul 6, 2017
• Online Publication Date: Apr 1, 2018
• Publication Date: Apr 1, 2018
• Deposit Date: Jul 10, 2017
• Publicly Available Date: May 4, 2018
• Journal: Revstat Statistical Journal
• Print ISSN: 1645-6726
• Electronic ISSN: 2183-0371
• Publisher: Instituto Nacional de Estatística
• Peer Reviewed: Peer Reviewed
• Volume: 16
• Issue: 2
• Pages: 167-185
• Public URL: https://durham-repository.worktribe.com/output/1383017
• Publisher URL: https://www.ine.pt/revstat/tables.html