Novel multiobjective TLBO algorithms for the feature subset selection problem

Kiziloz, Hakan Ezgi
Deniz, Ayca
Dokeroglu, Tansel
Coşar, Ahmet
Teaching Learning Based Optimization (TLBO) is a new metaheuristic that has been successfully applied to several intractable optimization problems in recent years. In this study, we propose a set of novel multiobjective TLBO algorithms combined with supervised machine learning techniques for the solution of Feature Subset Selection (FSS) in Binary Classification Problems (FSS-BCP). Selecting the minimum number of features while not compromising the accuracy of the results in FSS-BCP is a multiobjective optimization problem. We propose TLBO as a FSS mechanism and utilize its algorithm-specific parameterless concept that does not require any parameters to be tuned during the optimization. Most of the classical metaheuristics such as Genetic and Particle Swarm Optimization algorithms need additional efforts for tuning their parameters (crossover ratio, mutation ratio, velocity of particle, inertia weight, etc.), which may have an adverse influence on their performance. Comprehensive experiments are carried out on the well-known machine learning datasets of UCI Machine Learning Repository and significant improvements have been observed when the proposed multiobjective TLBO algorithms are compared with state-of-the-art NSGA-II, Particle Swarm Optimization, Tabu Search, Greedy Search, and Scatter Search algorithms.
Citation Formats
H. E. Kiziloz, A. Deniz, T. Dokeroglu, and A. Coşar, “Novel multiobjective TLBO algorithms for the feature subset selection problem,” NEUROCOMPUTING, vol. 306, pp. 94–107, 2018, Accessed: 00, 2020. [Online]. Available: