Dr Georgios Karagiannis georgios.karagiannis@durham.ac.uk
Associate Professor
Parallel and Interacting Stochastic Approximation Annealing algorithms for global optimisation
Karagiannis, G.; Konomi, B.; Lin, G.; Liang, F.
Authors
B. Konomi
G. Lin
F. Liang
Abstract
We present the parallel and interacting stochastic approximation annealing (PISAA) algorithm, a stochastic simulation procedure for global optimisation, that extends and improves the stochastic approximation annealing (SAA) by using population Monte Carlo ideas. The efficiency of standard SAA algorithm crucially depends on its self-adjusting mechanism which presents stability issues in high dimensional or rugged optimisation problems. The proposed algorithm involves simulating a population of SAA chains that interact each other in a manner that significantly improves the stability of the self-adjusting mechanism and the search for the global optimum in the sampling space, as well as it inherits SAA desired convergence properties when a square-root cooling schedule is used. It can be implemented in parallel computing environments in order to mitigate the computational overhead. As a result, PISAA can address complex optimisation problems that it would be difficult for SAA to satisfactory address. We demonstrate the good performance of the proposed algorithm on challenging applications including Bayesian network learning and protein folding. Our numerical comparisons suggest that PISAA outperforms the simulated annealing, stochastic approximation annealing, and annealing evolutionary stochastic approximation Monte Carlo.
Citation
Karagiannis, G., Konomi, B., Lin, G., & Liang, F. (2016). Parallel and Interacting Stochastic Approximation Annealing algorithms for global optimisation. Statistics and Computing, 27(4), 927-945. https://doi.org/10.1007/s11222-016-9663-0
Journal Article Type | Article |
---|---|
Acceptance Date | Apr 26, 2016 |
Online Publication Date | May 18, 2016 |
Publication Date | Jul 1, 2016 |
Deposit Date | Nov 10, 2016 |
Publicly Available Date | Sep 8, 2017 |
Journal | Statistics and Computing |
Print ISSN | 0960-3174 |
Electronic ISSN | 1573-1375 |
Publisher | Springer |
Peer Reviewed | Peer Reviewed |
Volume | 27 |
Issue | 4 |
Pages | 927-945 |
DOI | https://doi.org/10.1007/s11222-016-9663-0 |
Public URL | https://durham-repository.worktribe.com/output/1372526 |
Files
Accepted Journal Article
(1.8 Mb)
PDF
Copyright Statement
The final publication is available at Springer via https://doi.org/10.1007/s11222-016-9663-0.
You might also like
Ice Model Calibration using Semi-continuous Spatial Data
(2022)
Journal Article
Calibrations and validations of biological models with an application on the renal fibrosis
(2020)
Journal Article
Downloadable Citations
About Durham Research Online (DRO)
Administrator e-mail: dro.admin@durham.ac.uk
This application uses the following open-source libraries:
SheetJS Community Edition
Apache License Version 2.0 (http://www.apache.org/licenses/)
PDF.js
Apache License Version 2.0 (http://www.apache.org/licenses/)
Font Awesome
SIL OFL 1.1 (http://scripts.sil.org/OFL)
MIT License (http://opensource.org/licenses/mit-license.html)
CC BY 3.0 ( http://creativecommons.org/licenses/by/3.0/)
Powered by Worktribe © 2024
Advanced Search