D. Vangumalli
Aggregate selection, individual selection, and cluster selection: an empirical evaluation and implications for systems research
Vangumalli, D.; Nikolopoulos, K.; Litsiou, K.
Abstract
Data analysts when forecasting large number of time series, they regularly employ one of the following methodological approaches: either select a single forecasting method for the entire dataset (aggregate selection), or use the best forecasting method for each time series (individual selection). There is evidence in the predictive analytics literature that the former is more robust than the latter, as in individual selection you tend to overfit models to the data. A third approach is to first identify homogeneous clusters within the dataset, and then select a single forecasting method for each cluster (cluster selection). To that end, we examine three machine learning clustering methods: k-medoids, k-NN and random forests. The evaluation is performed in the 645 yearly series of the M3 competition. The empirical evidence suggests: (a) random forests provide the best clusters for the sequential forecasting task, and (b) cluster selection has the potential to outperform aggregate selection.
Citation
Vangumalli, D., Nikolopoulos, K., & Litsiou, K. (2021). Aggregate selection, individual selection, and cluster selection: an empirical evaluation and implications for systems research. Cybernetics and Systems, 52(7), 553-578. https://doi.org/10.1080/01969722.2021.1902049
Journal Article Type | Article |
---|---|
Acceptance Date | Mar 8, 2021 |
Online Publication Date | Jun 14, 2021 |
Publication Date | 2021 |
Deposit Date | Mar 9, 2021 |
Publicly Available Date | Jun 14, 2022 |
Journal | Cybernetics and Systems |
Print ISSN | 0196-9722 |
Electronic ISSN | 1087-6553 |
Publisher | Taylor and Francis Group |
Peer Reviewed | Peer Reviewed |
Volume | 52 |
Issue | 7 |
Pages | 553-578 |
DOI | https://doi.org/10.1080/01969722.2021.1902049 |
Public URL | https://durham-repository.worktribe.com/output/1245753 |
Files
Accepted Journal Article
(1.7 Mb)
PDF
Publisher Licence URL
http://creativecommons.org/licenses/by-nc/4.0/
Copyright Statement
This is an Accepted Manuscript version of the following article, accepted for publication in Cybernetics & Systems. Vangumalli, D., Nikolopoulos, K. & Litsiou, K. (2021). Aggregate selection, individual selection, and cluster selection: an empirical evaluation and implications for systems research. Cybernetics & Systems: An International Journal 52(7): 553-578.. It is deposited under the terms of the Creative Commons Attribution-NonCommercial License (http://creativecommons.org/licenses/by-nc/4.0/), which permits non-commercial re-use, distribution, and reproduction in any medium, provided the original work is properly cited.
You might also like
Forecasting the success of International Joint Ventures
(2024)
Presentation / Conference Contribution
Insights into accuracy of social scientists' forecasts of societal change
(2023)
Journal Article
Fathoming empirical forecasting competitions’ winners
(2022)
Journal Article
Downloadable Citations
About Durham Research Online (DRO)
Administrator e-mail: dro.admin@durham.ac.uk
This application uses the following open-source libraries:
SheetJS Community Edition
Apache License Version 2.0 (http://www.apache.org/licenses/)
PDF.js
Apache License Version 2.0 (http://www.apache.org/licenses/)
Font Awesome
SIL OFL 1.1 (http://scripts.sil.org/OFL)
MIT License (http://opensource.org/licenses/mit-license.html)
CC BY 3.0 ( http://creativecommons.org/licenses/by/3.0/)
Powered by Worktribe © 2025
Advanced Search