Karagiannis, G. and Konomi, B. and Lin, G. and Liang, F. (2016) 'Parallel and interacting stochastic approximation annealing algorithms for global optimisation.', Statistics and computing., 27 (4). pp. 927-945.
We present the parallel and interacting stochastic approximation annealing (PISAA) algorithm, a stochastic simulation procedure for global optimisation, that extends and improves the stochastic approximation annealing (SAA) by using population Monte Carlo ideas. The efficiency of standard SAA algorithm crucially depends on its self-adjusting mechanism which presents stability issues in high dimensional or rugged optimisation problems. The proposed algorithm involves simulating a population of SAA chains that interact each other in a manner that significantly improves the stability of the self-adjusting mechanism and the search for the global optimum in the sampling space, as well as it inherits SAA desired convergence properties when a square-root cooling schedule is used. It can be implemented in parallel computing environments in order to mitigate the computational overhead. As a result, PISAA can address complex optimisation problems that it would be difficult for SAA to satisfactory address. We demonstrate the good performance of the proposed algorithm on challenging applications including Bayesian network learning and protein folding. Our numerical comparisons suggest that PISAA outperforms the simulated annealing, stochastic approximation annealing, and annealing evolutionary stochastic approximation Monte Carlo.
|Full text:||(AM) Accepted Manuscript|
Download PDF (1729Kb)
|Publisher Web site:||https://doi.org/10.1007/s11222-016-9663-0|
|Publisher statement:||The final publication is available at Springer via https://doi.org/10.1007/s11222-016-9663-0.|
|Date accepted:||26 April 2016|
|Date deposited:||08 September 2017|
|Date of first online publication:||18 May 2016|
|Date first made open access:||08 September 2017|
Save or Share this output
|Look up in GoogleScholar|