In this paper, a novel population-based, nature-inspired optimization paradigm is proposed, which is called Harris Hawks Optimizer (HHO). The main inspiration of HHO is the cooperative behavior and ...chasing style of Harris’ hawks in nature called surprise pounce. In this intelligent strategy, several hawks cooperatively pounce a prey from different directions in an attempt to surprise it. Harris hawks can reveal a variety of chasing patterns based on the dynamic nature of scenarios and escaping patterns of the prey. This work mathematically mimics such dynamic patterns and behaviors to develop an optimization algorithm. The effectiveness of the proposed HHO optimizer is checked, through a comparison with other nature-inspired techniques, on 29 benchmark problems and several real-world engineering problems. The statistical results and comparisons show that the HHO algorithm provides very promising and occasionally competitive results compared to well-established metaheuristic techniques. Source codes of HHO are publicly available at http://www.alimirjalili.com/HHO.html and http://www.evo-ml.com/2019/03/02/hho.
•A mathematical model is proposed to simulate the hunting behavior of Harris’ Hawks.•An optimization algorithm is proposed using the mathematical model.•The proposed HHO algorithm is tested on several benchmarks.•The performance of HHO is also examined on several engineering design problems.•The results show the merits of the HHO algorithm as compared to the existing algorithms.
In this article, an effective metaheuristic algorithm named multi-trial vector-based differential evolution (MTDE) is proposed. The MTDE is distinguished by introducing an adaptive movement step ...designed based on a new multi-trial vector approach named MTV, which combines different search strategies in the form of trial vector producers (TVPs). In the developed MTV approach, the TVPs are applied on their dedicated subpopulation, which are distributed by a winner-based distribution policy, and share their experiences efficiently by using a life-time archive. The MTV can be deployed by different types of TVPs, particularly, we use the MTV approach in the MTDE algorithm by three TVPs: representative based trial vector producer, local random based trial vector producer, and global best history based trial vector producer. Therefore, this study introduces the MTV approach to boost the performance of the MTDE and demonstrates its advantages in dealing with problems of different levels of complexity. The performance of the proposed MTDE algorithm is evaluated on CEC 2018 benchmark suite which include unimodal, multimodal, hybrid, and composition functions and four complex engineering design problems. The experimental and statistical results are compared with state-of-the-art metaheuristic algorithms: GWO, WOA, SSA, HHO, CoDE, EPSDE, QUATRE, and MKE. The results demonstrate that the MTDE algorithm shows improved performance and benefits from high accuracy of optimal solutions obtained.
•Introducing a multi trial vector approach (MTV) to combine various search strategies.•Introducing a life-time archiving and winner-based distributing in MTV approach.•Proposing an effective differential evolution (MTDE) algorithm using MTV approach.•Evaluating and comparing MTDE with state-of-the-art algorithms on CEC 2018.•MTDE algorithm is very competitive and superior to the compared algorithms.
•A novel optimization algorithm called Salp Swarm Optimizer (SSA) is proposed.•Multi-objective Salp Swarm Algorithm (MSSA) is proposed to solve multi-objective problems.•Both algorithms are tested on ...several mathematical optimization functions.•Two challenging engineering design problems are solved: airfoil design and marine propeller design.•The qualitative and quantitative results prove the efficiency of SSA and MSSA.
This work proposes two novel optimization algorithms called Salp Swarm Algorithm (SSA) and Multi-objective Salp Swarm Algorithm (MSSA) for solving optimization problems with single and multiple objectives. The main inspiration of SSA and MSSA is the swarming behaviour of salps when navigating and foraging in oceans. These two algorithms are tested on several mathematical optimization functions to observe and confirm their effective behaviours in finding the optimal solutions for optimization problems. The results on the mathematical functions show that the SSA algorithm is able to improve the initial random solutions effectively and converge towards the optimum. The results of MSSA show that this algorithm can approximate Pareto optimal solutions with high convergence and coverage. The paper also considers solving several challenging and computationally expensive engineering design problems (e.g. airfoil design and marine propeller design) using SSA and MSSA. The results of the real case studies demonstrate the merits of the algorithms proposed in solving real-world problems with difficult and unknown search spaces.
This work proposes a new multi-objective algorithm inspired from the navigation of grass hopper swarms in nature. A mathematical model is first employed to model the interaction of individuals in the ...swam including attraction force, repulsion force, and comfort zone. A mechanism is then proposed to use the model in approximating the global optimum in a single-objective search space. Afterwards, an archive and target selection technique are integrated to the algorithm to estimate the Pareto optimal front for multi-objective problems. To benchmark the performance of the algorithm proposed, a set of diverse standard multi-objective test problems is utilized. The results are compared with the most well-regarded and recent algorithms in the literature of evolutionary multi-objective optimization using three performance indicators quantitatively and graphs qualitatively. The results show that the proposed algorithm is able to provide very competitive results in terms of accuracy of obtained Pareto optimal solutions and their distribution.
Customer churn is one of the most challenging problems for telecommunication companies. In fact, this is because customers are considered as the real asset for the companies. Therefore, more ...companies are increasing their investments in developing practical solutions that aim at predicting customer churn before it happens. Identifying which customer is about to churn will significantly help the companies in providing solutions to keep their customers and optimize their marketing campaigns. In this work, an intelligent hybrid model based on Particle Swarm Optimization and Feedforward neural network is proposed for churn prediction. PSO is used to tune the weights of the input features and optimize the structure of the neural network simultaneously to increase the prediction power. In addition, the proposed model handles the imbalanced class distribution of the data using an advanced oversampling technique. Evaluation results show that the proposed model can significantly improve the coverage rate of churn customers in comparison with other state-of-the-art classifiers. Moreover, the model has high interpretability, where the assigned feature weights can give an indicator about the importance of their corresponding features in the classification process.
Whale optimization algorithm (WOA) is a recent nature-inspired metaheuristic that mimics the cooperative life of humpback whales and their spiral-shaped hunting mechanism. In this research, it is ...first argued that the exploitation tendency of WOA is limited and can be considered as one of the main drawbacks of this algorithm. In order to mitigate the problems of immature convergence and stagnation problems, the exploitative and exploratory capabilities of modified WOA in conjunction with a learning mechanism are improved. In this regard, the proposed WOA with associative learning approaches is combined with a recent variant of hill climbing local search to further enhance the exploitation process. The improved algorithm is then employed to tackle a wide range of numerical optimization problems. The results are compared with different well-known and novel techniques on multi-dimensional classic problems and new CEC 2017 test suite. The extensive experiments and statistical tests show the superiority of the proposed BMWOA compared to WOA and several well-established algorithms.
•Novel feature selection approaches based on Binary Dragonfly Algorithm (BDA) are proposed.•Eight time varying S-shaped and V-shaped transfer functions are proposed.•The leverage of using ...time-varying transfer functions on exploration and exploitation behaviors is investigated.•Extensive tests are made to assess the proposed algorithms on the datasets to prove their merits.
Display omitted
The Dragonfly Algorithm (DA) is a recently proposed heuristic search algorithm that was shown to have excellent performance for numerous optimization problems. In this paper, a wrapper-feature selection algorithm is proposed based on the Binary Dragonfly Algorithm (BDA). The key component of the BDA is the transfer function that maps a continuous search space to a discrete search space. In this study, eight transfer functions, categorized into two families (S-shaped and V-shaped functions) are integrated into the BDA and evaluated using eighteen benchmark datasets obtained from the UCI data repository. The main contribution of this paper is the proposal of time-varying S-shaped and V-shaped transfer functions to leverage the impact of the step vector on balancing exploration and exploitation. During the early stages of the optimization process, the probability of changing the position of an element is high, which facilitates the exploration of new solutions starting from the initial population. On the other hand, the probability of changing the position of an element becomes lower towards the end of the optimization process. This behavior is obtained by considering the current iteration number as a parameter of transfer functions. The performance of the proposed approaches is compared with that of other state-of-art approaches including the DA, binary grey wolf optimizer (bGWO), binary gravitational search algorithm (BGSA), binary bat algorithm (BBA), particle swarm optimization (PSO), and genetic algorithm in terms of classification accuracy, sensitivity, specificity, area under the curve, and number of selected attributes. Results show that the time-varying S-shaped BDA approach outperforms compared approaches.
•Gravitational Search Algorithm (GSA) was used as a search strategy in a Feature Selection approach.•Crossover and Mutation evolutionary operators were used to improve the quality of GSA.•KNN and ...Decision Tree classifiers were used as evaluators.•The results demonstrate the superiority of the proposed algorithm in solving FS problems.
Display omitted
With recent advancements in data collection tools and the widespread use of intelligent information systems, a huge amount of data streams with lots of redundant, irrelevant, and noisy features are collected and a large number of features (attributes) should be processed. Therefore, there is a growing demand for developing efficient Feature Selection (FS) techniques. Gravitational Search algorithm (GSA) is a successful population-based metaheuristic inspired by Newton’s law of gravity. In this research, a novel GSA-based algorithm with evolutionary crossover and mutation operators is proposed to deal with feature selection (FS) tasks. As an NP-hard problem, FS finds an optimal subset of features from a given set. For the proposed wrapper FS method, both K-Nearest Neighbors (KNN) and Decision Tree (DT) classifiers are used as evaluators. Eighteen well-known UCI datasets are utilized to assess the performance of the proposed approaches. In order to verify the efficiency of proposed algorithms, the results are compared with some popular nature-inspired algorithms (i.e. Genetic Algorithm (GA), Particle Swarm Optimizer (PSO), and Grey Wolf Optimizer (GWO)). The extensive results and comparisons demonstrate the superiority of the proposed algorithm in solving FS problems.
Text classification is one of the challenging computational tasks in machine learning community due to the increased amounts of natural language text documents available in the electronic forms. In ...this process, feature selection (FS) is an essential phase because thousands of possible feature sets may be considered in text classification. This paper proposes an enhanced binary grey wolf optimizer (GWO) within a wrapper FS approach to tackle Arabic text classification problems. The proposed binary GWO is utilized to play the role of a wrapper-based feature selection technique. The performance of the proposed method using different learning models, including decision trees,
K
-nearest neighbour, Naive Bayes, and SVM classifiers, are investigated. Three Arabic public datasets, namely Alwatan, Akhbar-Alkhaleej, and Al-jazeera-News, are utilized to evaluate the efficacy of different BGWO-based wrapper methods. Results and analysis show that SVM-based feature selection technique with the proposed binary GWO optimizer with elite-based crossover scheme has enhanced efficacy in dealing with Arabic text classification problems compared to other peers.
Searching for the optimal subset of features is known as a challenging problem in feature selection process. To deal with the difficulties involved in this problem, a robust and reliable optimization ...algorithm is required. In this paper, Grasshopper Optimization Algorithm (GOA) is employed as a search strategy to design a wrapper-based feature selection method. The GOA is a recent population-based metaheuristic that mimics the swarming behaviors of grasshoppers. In this work, an efficient optimizer based on the simultaneous use of the GOA, selection operators, and Evolutionary Population Dynamics (EPD) is proposed in the form of four different strategies to mitigate the immature convergence and stagnation drawbacks of the conventional GOA. In the first two approaches, one of the top three agents and a randomly generated one are selected to reposition a solution from the worst half of the population. In the third and fourth approaches, to give a chance to the low fitness solutions in reforming the population, Roulette Wheel Selection (RWS) and Tournament Selection (TS) are utilized to select the guiding agent from the first half. The proposed GOA_EPD approaches are employed to tackle various feature selection tasks. The proposed approaches are benchmarked on 22 UCI datasets. The comprehensive results and various comparisons reveal that the EPD has a remarkable impact on the efficacy of the GOA and using the selection mechanism enhanced the capability of the proposed approach to outperform other optimizers and find the best solutions with improved convergence trends. Furthermore, the comparative experiments demonstrate the superiority of the proposed approaches when compared to other similar methods in the literature.
PDF
