Performance evaluation on optimisation of 200 dimensional numerical tests - results and issues

Abstract: Many tasks in science and technology require optimisation. Resolving such tasks could bring great benefits to community. Multidimensional problems where optimisation parameters are hundreds and more face unusual computational limitations. Algorithms, which perform well on low number of dimensions, when are applied to high dimensional space suffers insuperable difficulties. This article presents an investigation on 200 dimensional scalable, heterogeneous, real-value, numerical tests. For some of these tests optimal values are dependent on dimensions’ number and virtually unknown for variety of dimensions. Dependence on initialisation for successful identification of optimal values is analysed by comparison between experiments with start from random initial locations and start from one location. The aim is to: (1) assess dependence on initialisation in optimisation of 200 dimensional tests; (2) evaluate tests complexity and required for their resolving periods of time; (3) analyse adaptation to tasks with unknown solutions; (4) identify specific peculiarities which could support the performance on high dimensions (5) identify computational limitations which numerical methods could face on high dimensions. Presented and analysed experimental results can be used for further comparison and evaluation of real value methods

HEURISTICS OPTIMISATION OF NUMERICAL FUNCTIONS

The article presents an investigation of heuristic behaviour of search algorithms applied to numerical problems. The aim is to compare the abilities of Particle Swarm Optimisation, Differential Evolution and Free Search to adapt to variety of search spaces without the need for constant re-tuning of algorithms parameters. The article focuses on several advanced characteristics of Free Search and attempts to clarify specifics of its behaviour. The achieved experimental results are presented and discussed

Algorithms Applied to Global Optimisation – Visual Evaluation

Evaluation and assessment of various search and optimisation algorithms is subject of large research efforts. Particular interest of this study is global optimisation and presented approach is based on observation and visual evaluation of Real-Coded Genetic Algorithm, Particle Swarm Optimisation, Differential Evolution and Free Search, which are briefly described and used for experiments. 3D graphical views, generated by visualisation tool VOTASA, illustrate essential aspects of global search process such as divergence, convergence, dependence on initialisation and utilisation of accidental events. Discussion on potential benefits of visual analysis, supported with numerical results, which could be used for comparative assessment of other methods and directions for further research conclude presented study

Adaptive intelligence: essential aspects

The article discusses essential aspects of Adaptive Intelligence. Experimental results on optimisation of global test functions by Free Search, Differential Evolution, and Particle Swarm Optimisation clarify how these methods can adapt to multi-modal landscape and space dominated by sub-optimal regions, without supervisors’ control. The achieved results are compared and analysed

FREE SEARCH AND DIFFERENTIAL EVOLUTION TOWARDS DIMENSIONS NUMBER CHANGE

This paper presents an exploration of Free Search (FS) and modified Differential Evolution (DE) with enhanced adaptivity. The aim of the study is to identify how these methods can cope with changes of the number of variables of a hard design test, unaided. The results suggest that both methods can adapt successfully to the variation of the number of variables and constraint conditions. The results are presented. Contributions to the engineering design are replacement in high extent of human based search with machine based and movement of optimisation process from human guided to machine self guided search

FREE SEARCH – A NOVEL HEURISTIC METHOD

Key words to describe the work: Evolutionary computing, Artificial Intelligence, Free Search. Key Results: Inspired from the nature new population-based algorithm applied to numerical optimisation. How does the work advance the state-of-the-art?: Novel approach to stochastic processes. Reflects on an improvement of the optimisation effectiveness and robustness. Benefits optimisation and nature understanding Motivation (problems addressed): An improvement of optimisation process in terms of better performance and robustness, which can support wide range disciplines, we consider as a challenge for research

Free Search of real value or how to make computers think

This book introduces in detail Free Search - a novel advanced method for search and optimisation. It also deals with some essential questions that have been raised in a strong debate following the publication of this method in journal and conference papers. In the light of this debate, Free Search deserves serious attention, as it appears to be superior to other competitive methods in the context of the experimental results obtained. This superiority is not only quantitative in terms of the actual optimal value found but also qualitative in terms of independence from initial conditions and adaptation capabilities in an unknown environment

Differential Evolution with Enhanced Abilities for Adaptation Applied to Heterogeneous Numerical Optimization

This article presents an exploration of Differential Evolution (DE) algorithm with enhanced adaptability. The main purpose of this study is to identify how this search method can cope with changes of the number of variables of a hard design test, unaided. The results clearly show that this method successfully solves the explored functions