Hybrid Feature Selection Approach Based on Firefly Algorithm and Simulated Annealing for Cancer Datasets

Authors

DOI:

https://doi.org/10.31663/utjes.14.1.541

Keywords:

Optimizaiton, Metaheuristics, Firefly Algorithm, Simulated Annealing algorithm, Hybrid approach, Feature selection, Cancer datasets

Abstract

The recent tendency of research is to hybridize two or more metaheuristics algorithms to find superior solutions in the field of feature selection problems. The Firefly Algorithm (FA) is a population-based optimization algorithm that attempts to replicate the normal behavior of firefly insects in seeking food. FA is broadly used in numerous engineering fields, but it endures from certain restrictions. This study emphasis emphasizes hybridizing FA with the Simulated Annealing algorithm (SA) as a strong local search algorithm to overcome FA limits and improve the overall performance in feature selection. In other words, a high-level relay hybrid (HRH) model is proposed in which self-contained optimization (i.e., FA and SA) are implemented in sequence. Obviously, metaheuristic algorithms (like FA) are not suitable for fine adjustment structures that are so near to optimal solutions, whereas local search algorithms (like SA) are the opposite. Accordingly, in the proposed FASA+FS model, the best regions are located by FA and then inputted to SA, respectively.

References

Aljarah, I., Habib, M., Faris, H., Al-Madi, N., Heidari, A. A., Mafarja, M., Elaziz, M. A., & Mirjalili, S. (2020). A dynamic locality multi-objective salp swarm algorithm for feature selection. Computers and Industrial Engineering, 147. https://doi.org/10.1016/j.cie.2020.106628

Busetti, F. (2003). Simulated annealing overview. World Wide Web URL Www. Geocities. Com/ …, 1.

Guyon, I., & De, A. M. (2003). An Introduction to Variable and Feature Selection André Elisseeff. In Journal of Machine Learning Research (Vol. 3).

Ibrahim, H. T., Mazher, W. J., & Jassim, E. M. (2023). Modified Harris Hawks optimizer for feature selection and support vector machine kernels. Indonesian Journal of Electrical Engineering and Computer Science, 29(2). https://doi.org/10.11591/ijeecs.v29.i2.pp942-953

Ibrahim, H. T., Mazher, W. J., Ucan, O. N., & Bayat, O. (2019). A grasshopper optimizer approach for feature selection and optimizing SVM parameters utilizing real biomedical data sets. Neural Computing and Applications, 31(10). https://doi.org/10.1007/s00521-018-3414-4

Kabir, M., Shahjahan, M., & Murase, K. (2013). Ant Colony Optimization Toward Feature Selection. In Ant Colony Optimization - Techniques and Applications. https://doi.org/10.5772/51707

Kaya Keles, M., Kilic, U., & Keles, A. E. (2021). Proposed Artificial Bee Colony Algorithm as Feature Selector to Predict the Leadership Perception of Site Managers. Computer Journal, 64(3). https://doi.org/10.1093/comjnl/bxaa163

Kennedy, J., & Eberhart, R. (n.d.). Particle swarm optimization. Proceedings of ICNN’95 - International Conference on Neural Networks, 4, 1942–1948. https://doi.org/10.1109/ICNN.1995.488968

Khushaba, R. N., Al-Ani, A., & Al-Jumaily, A. (2008). Differential Evolution based feature subset selection. Proceedings - International Conference on Pattern Recognition. https://doi.org/10.1109/icpr.2008.4761255

Mafarja, M. M., & Mirjalili, S. (2017). Hybrid Whale Optimization Algorithm with simulated annealing for feature selection. Neurocomputing, 260. https://doi.org/10.1016/j.neucom.2017.04.053

Ministry of Health. (2017). Data of Iraqi Cancer Registry for 2010-2012 years. Iraqi Cancer Board, Ministry of Health.

Mohammadiyan, N. E., & Ghadi, A. (2017). Enhancing the accuracy of firefly algorithm by using the reproduction mechanism. 2017 18th IEEE/ACIS International Conference on Software Engineering, Artificial Intelligence, Networking and Parallel/Distributed Computing (SNPD), 1–6. https://doi.org/10.1109/SNPD.2017.8048202

Oh, I. S., Lee, J. S., & Moon, B. R. (2004). Hybrid genetic algorithms for feature selection. IEEE Transactions on Pattern Analysis and Machine Intelligence, 26(11). https://doi.org/10.1109/TPAMI.2004.105

Pan, X., Xue, L., Lu, Y., & Sun, N. (2019). Hybrid particle swarm optimization with simulated annealing. Multimedia Tools and Applications, 78(21). https://doi.org/10.1007/s11042-018-6602-4

Sun, L., Si, S., Zhao, J., Xu, J., Lin, Y., & Lv, Z. (2023). Feature selection using binary monarch butterfly optimization. Applied Intelligence, 53(1). https://doi.org/10.1007/s10489-022-03554-9

Talbi, E. G. (2002). A taxonomy of hybrid metaheuristics. Journal of Heuristics, 8(5). https://doi.org/10.1023/A:1016540724870

Talbi, E.-G. (2009). Metaheuristics: From Desing to Implementation. Published by John Wiley & Sons, Inc., Hoboken, New Jersey and Canada. https://www.wiley.com/en-us/Metaheuristics%3A+From+Design+to+Implementation+-p-9780470278581

Tariq Ibrahim, H., Jalil Mazher, W., Ucan, O. N., & Bayat, O. (2017). Feature Selection using Salp Swarm Algorithm for Real Biomedical Datasets. In IJCSNS International Journal of Computer Science and Network Security (Vol. 17, Issue 12).

Yang, X.-She. (2010). Nature-inspired metaheuristic algorithms. Luniver Press. https://books.google.com/books/about/Nature_inspired_Metaheuristic_Algorithms.html?id=iVB_ETlh4ogC

Zawbaa, H. M., Emary, E., & Parv, B. (2016). Feature selection based on antlion optimization algorithm. Proceedings of 2015 IEEE World Conference on Complex Systems, WCCS 2015. https://doi.org/10.1109/ICoCS.2015.7483317

Zhang, L., Liu, L., Yang, X. S., & Dai, Y. (2016). A novel hybrid firefly algorithm for global optimization. PLoS ONE, 11(9). https://doi.org/10.1371/journal.pone.0163230

ZorarpacI, E., & Özel, S. A. (2016). A hybrid approach of differential evolution and artificial bee colony for feature selection. Expert Systems with Applications, 62. https://doi.org/10.1016/j.eswa.2016.06.004

Downloads

Published

2024-08-06

Issue

Section

Articles

How to Cite

Hybrid Feature Selection Approach Based on Firefly Algorithm and Simulated Annealing for Cancer Datasets. (2024). University of Thi-Qar Journal for Engineering Sciences, 14(1), 1-9. https://doi.org/10.31663/utjes.14.1.541