Uğur ERKAN, Samet MEMİŞ, Serdar ENGİNOĞLU

A new classification method using soft decision-making based on an aggregation operator of fuzzy parameterized fuzzy soft matrices

Recently, a precise and stable machine learning algorithm, i.e. eigenvalue classification method (EigenClass), has been developed by using the concept of generalised eigenvalues in contrast to common approaches, such as k-nearest neighbours, support vector machines, and decision trees. In this paper, we offer a new classification algorithm called fuzzy parameterized fuzzy soft aggregation classifier (FPFS-AC) to combine the modelling ability of soft decision-making (SDM) and classification success of generalised eigenvalues. FPFS-AC constructs a decision matrix by employing the similarity measures of fuzzy parameterized fuzzy soft matrices (fpfs-matrices) and a generalised eigenvalue-based similarity measure. Then, it applies an SDM method based on the aggregation operator of fpfs-matrices to a decision matrix and classifies the given test sample. Afterwards, we perform an experimental study using 15 UCI datasets to manifest the success of our approach and compare FPFS-AC with the well-known and state-of-the-art classifiers (kNN, SVM, fuzzy kNN, EigenClass, and BM-fuzzy kNN) in terms of accuracy, precision, recall, macro F-score, micro F-score, and running time. Moreover, we statistically analyse the experimentally obtained data. Experimental and statistical results show that FPFS-AC outperforms the state-of-the-art classifiers in all the datasets concerning the five performance metrics.

PDF

___

[1] Mehryar M, Rostamizadeh A, Talwalkar A. Foundations of Machine Learning. In: Bach F (editor). Introduction: Learning Scenarios, 2nd ed. London, England; The MIT Press, 2018. p. 6.
[2] Fix E, Hodges JL. Discriminatory analysis, nonparametric discrimination: Consistency properties. Texas, USA: USAF School of Aviation Medicine, Randolph Field, 1951.
[3] Cover TM, Hart PE. Nearest neighbor pattern classification. IEEE Transactions on Information Theory 1967; 13: 21-27. doi: 10.1109/TIT.1967.1053964
[4] Cortes C, Vapnik V. Support-vector networks. Machine learning 1995; 20 (3): 273-297. doi: 10.1007/BF00994018
[5] Zadeh LA. Fuzzy sets. Information and Control 1965; 8: 338-353. doi: 10.1016/S0019-9958(65)90241-X
[6] Keller JM, Gray MR, Givens JA. A fuzzy k-nearest neighbor algorithm. IEEE Transactions on Systems, Man, and Cybernetics 1985; 15: 580-585. doi: 10.1109/TSMC.1985.6313426.
[7] Erkan U. A precise and stable machine learning algorithm: Eigenvalue classification (EigenClass). Neural Computing and Applications 2021; 33 (10): 5381-5392. doi: 10.1007/s00521-020-05343-2
[8] Kumbure MM, Luukka P, Collan M. A new fuzzy k-nearest neighbor classifier based on the Bonferroni mean. Pattern Recognition Letters 2020; 140: 172-178. doi: 10.1016/j.patrec.2020.10.005
[9] Molodtsov D. Soft set theory-first results. Computers and Mathematics with Applications 1999; 37 (4-5): 19-31.
[10] Enginoğlu S, Memiş S. A configuration of some soft decision-making algorithms via fpfs-matrices. Cumhuriyet Science Journal 2018; 39 (4): 871-881. doi: 10.17776/csj.409915
[11] Enginoğlu S, Memiş S. Comment on fuzzy soft sets [The Journal of Fuzzy Mathematics 9(3), 2001, 589-602]. International Journal of Latest Engineering Research and Applications 2018; 3 (9): 1-9.
[12] Enginoğlu S, Memiş S. A review on an application of fuzzy soft set in multicriteria decision making problem [P. K. Das, R. Borgohain, International Journal of Computer Applications 38 (2012) 33-37]. In: International Conference on Mathematical Studies and Applications 2018; Karaman, Turkey; 2018, pp. 173-178.
[13] Enginoğlu S, Memiş S. A review on some soft decision-making methods. In: International Conference on Mathematical Studies and Applications 2018; Karaman, Turkey; 2018, pp. 437-442.
[14] Enginoğlu S, Ay M, Çağman N, Tolun V. Classification of the monolithic columns produced in troad and mysia region ancient granite quarries in northwestern anatolia via soft decision-making. Bilge International Journal of Science and Technology Research 2019; 3(Special Issue): 21-34. doi: 10.30516/bilgesci.646126
[15] Enginoğlu and Öngel T. Configurations of several soft decision-making methods to operate in fuzzy parameterized fuzzy soft matrices space. Eskişehir Technical University Journal of Science and Technology A-Applied Sciences and Engineering 2020; 21 (1): 58-71. doi: 10.18038/estubtda.562578
[16] Aydın T, Enginoğlu S. Configurations of SDM methods proposed between 1999 and 2012: A follow-up study. In: 4th International Conference on Mathematics “An İstanbul Meeting for World Mathematicians”; Istanbul, Turkey; 2020, pp. 192-211.
[17] Enginoğlu S, Aydın T, Memiş S, Arslan B. Operability-oriented configurations of the soft decision-making methods proposed between 2013 and 2016 and their comparisons. Journal of New Theory 2021; 34: 82-114.
[18] Enginoğlu S, Memiş S, Öngel T. A fast and simple soft decision-making algorithm: EMO18o. In: International Conference on Mathematical Studies and Applications 2018; Karaman, Turkey; 2018, pp. 179-186.
[19] Enginoğlu S, Memiş S, Arslan B. A fast and simple soft decision-making algorithm: EMA18an. In: International Conference on Mathematical Studies and Applications 2018; Karaman, Turkey; 2018, pp. 428-436.
[20] Enginoğlu S, Memiş S, Öngel T. Comment on soft set theory and uni-int decision-making [European Journal of Operational Research, (2010) 207, 848-855]. Journal of New Results in Science 2018; 7 (3): 28-43.
[21] Enginoğlu S, Memiş S, Arslan B. Comment (2) on soft set theory and uni-int decision-making [European Journal of Operational Research, (2010) 207, 848-855]. Journal of New Theory 2018; 25: 84-102.
[22] Sezgin A, Çağman N, Çıtak F. α-inclusions applied to group theory via soft set and logic. Communications Faculty of Sciences University of Ankara Series A1 Mathematics and Statistics 2019; 68 (1): 334-352.
[23] Özlü S, Sezgin A. Soft covered ideals in semigroups. Acta Universitatis Sapientiae, Mathematica 2020; 12 (2): 317-346. doi:10.2478/ausm-2020-0023
[24] Şenel G, Lee JG, Hur K. Advanced soft relation and soft mapping. International Journal of Computational Intelligence Systems 2021; 14 (1): 461-470. doi: 10.2991/ijcis.d.201221.001
[25] Enginoğlu S, Çağman N, Karataş S, Aydın T. On soft topology, El-Cezerî Journal of Science and Engineering 2015; 2 (3): 23-38. doi: 10.31202/ecjse.67135
[26] Riaz M, Hashm R, Farooq A. Fuzzy parameterized fuzzy soft metric spaces. Journal of Mathematical Analysis 2018; 9: 25-36.
[27] Aydın T, Enginoğlu S. Some results on soft topological notions. Journal of New Results in Science 2021; 10 (1): 65-75.
[28] Molodtsov DA. The Theory of Soft Sets. Moscow, Russia: URSS Publishers, 2004 (in Russian).
[29] Çağman N, Enginoğlu S. Soft set theory and uni-int decision making. European Journal of Operational Research 2010; 207: 848-855. doi: 10.1016/j.ejor.2010.05.004.
[30] Karaaslan F, Deli İ. Soft neutrosophic classical sets and their applications in decision-making. Palestine Journal of Mathematics 2020; 9 (1): 312-326.
[31] Garg H, Arora R. Algorithms based on COPRAS and aggregation operators with new information measures for possibility intuitionistic fuzzy soft decision-making. Mathematical Problems in Engineering 2020; 2020: Article ID 1563768, 1-20. doi: 10.1155/2020/1563768
[32] Maji PK, Biswas R, Roy AR. Fuzzy soft sets. The Journal of Fuzzy Mathematics 2001; 9 (3): 589-602.
[33] Çağman N, Enginoğlu S, Çıtak F. Fuzzy soft set theory and its applications. Iranian Journal of Fuzzy Systems 2011; 8: 137-147.
[34] Çağman N, Çıtak F, Enginoğlu S. FP-soft set theory and its applications. Annals of Fuzzy Mathematics and Informatics 2011; 2: 219-226.
[35] Çağman N, Çıtak F, Enginoğlu S. Fuzzy parameterized fuzzy soft set theory and its applications. Turkish Journal of Fuzzy Systems 2010; 1 (1): 21-35.
[36] Çağman N, Enginoğlu S. Soft matrix theory and its decision making. Computers and Mathematics with Applications 2010; 59: 3308-3314. doi: 10.1016/j.camwa.2010.03.015.
[37] Çağman N, Enginoğlu S. Fuzzy soft matrix theory and its application in decision making. Iranian Journal of Fuzzy Systems 2012; 9: 109-119.
[38] Enginoğlu S, Çağman N. Fuzzy parameterized fuzzy soft matrices and their application in decision-making. TWMS Journal of Applied and Engineering Mathematics 2020; 10: 1105-1115.
[39] Khameneh AZ, Kılıçman A. Multi-attribute decision-making based on soft set theory: A systematic review. Soft Computing 2019; 23 (16): 6899-6920. doi: 10.1007/s00500-018-3330-7
[40] Mushrif MM, Senqupta S, Ray AK. Texture classification using a novel, soft-set theory based classification algorithm. In: 7th Asian Conference on Computer Vision; Hyderabad, India; 2006, pp. 246-254. doi: 10.1007/11612032_26
[41] Handaga B, Onn H, Herawan T. FSSC: An algorithm for classifying numerical data using fuzzy soft set theory. International Journal of Fuzzy System Applications 2012; 3 (4): 29-46. doi: 10.4018/ijfsa.2012100102
[42] Lashari SA, Ibrahim R, Senan N. Medical data classification using similarity measure of fuzzy soft set based distance measure. Journal of Telecommunication, Electronic and Computer Engineering 2017; 9 (2-9): 95-99.
[43] Yanto ITR, Seadudin RR, Lashari SA, Haviluddin. A numerical classification technique based on fuzzy soft set using hamming distance. In: Third International Conference on Soft Computing and Data Mining; Johor, Malaysia; 2018, pp. 252-260. doi: 10.1007/978-3-319-72550-5_25
[44] Enginoğlu S, Memiş S, Çağman N. A generalisation of fuzzy soft max-min decision-making method and its application to a performance-based value assignment in image denoising. El-Cezerî Journal of Science and Engineering 2018; 6 (3): 466-481. doi: 10.31202/ecjse.551487
[45] Enginoğlu S, Memiş S, Karaaslan F. A new approach to group decision-making method based on TOPSIS under fuzzy soft environment. Journal of New Results in Science 2019; 8 (2): 42-52.
[46] Enginoğlu S, Memiş S. A new approach to the criteria-weighted fuzzy soft max-min decision-making method and its application to a performance-based value assignment problem. Journal of New Results in Science 2020; 9 (1): 19-36.
[47] Enginoğlu S, Aydın, T., Memiş S. Arslan, B. SDM methods’ configurations (2017-2019) and their application to a performance-based value assignment problem: A follow up study. Annals of Optimization Theory and Practice 2021; 4 (1): 41-85. doi: 10.22121/AOTP.2021.287404.1069
[48] Memiş S, Enginoğlu S, Erkan U. Numerical data classification via distance-based similarity measures of fuzzy parameterized fuzzy soft matrices. IEEE Access 2021; 9: 88583-88601. doi: 10.1109/ACCESS.2021.3089849
[49] Memiş S, Enginoğlu S. An application of fuzzy parameterized fuzzy soft matrices in data classification. In: International Conferences on Science and Technology; Natural Science and Technology ICONST-NST 2019; Prizren, Kosovo; 2019. pp. 68-77.
[50] Memiş S, Enginoğlu S, Erkan U. A data classification method in machine learning based on normalised hamming pseudo-similarity of fuzzy parameterized fuzzy soft matrices. Bilge International Journal of Science and Technology Research 2019; 3 (Special Issue): 1-8. doi: 10.30516/bilgesci.643821
[51] Dua D, Graff C. UCI Machine Learning Repository, University of California, Irvine, School of Information and Computer Sciences 2019.
[52] Friedman M. A comparison of alternative tests of significance for the problem of m rankings. Annals of Mathematical Statistics 1940; 11 (1): 86-92.
[53] Nemenyi PB. Distribution-free multiple comparisons. PhD, Princeton University, Princeton, New Jersey, USA, 1963.
[54] Stone M. Cross-validatory choice and assessment of statistical predictions. Journal of the Royal Statistical Society. Series B (Methodological) 1974; 36: 111-147. doi: 10.1111/j.2517-6161.1974.tb00994.x
[55] Xiong Z. Cui Y. Liu Z. Zhao Y. Hu M. Hu J. Evaluating explorative prediction power of machine learning algorithms for materials discovery using k-fold forward cross-validation. Computational Materials Science 2020; 171: 109203. doi: 10.1016/j.commatsci.2019.109203
[56] Demšar J. Statistical comparisons of classifiers over multiple data sets. Journal of Machine Learning Research 2006; 7: 1-30.
[57] Enginoğlu S, Arslan B. Intuitionistic fuzzy parameterized intuitionistic fuzzy soft matrices and their application in decision-making. Computational and Applied Mathematics 2020; 39: Article Number: 325. doi: 10.1007%2Fs40314- 020-01325-1
[58] Aydın T, Enginoğlu S. Interval-valued intuitionistic fuzzy parameterized interval-valued intuitionistic fuzzy soft sets and their application in decision-making. Journal of Ambient Intelligence and Humanized Computing 2021; 12 (1): 1541-1558. doi: 10.1007/s12652-020-02227-0
[59] Cuong BC. Picture fuzzy sets. Journal of Computer Science and Cybernetics 2014; 30 (4): 409-420. doi: 10.15625/1813-9663/30/4/5032
[60] Memiş S. A study on picture fuzzy sets. In: 7th IFS and Contemporary Mathematics Conference; Mersin, Turkey; 2021. pp. 125-132.