×

Solving multi-class problems with linguistic fuzzy rule based classification systems based on pairwise learning and preference relations. (English) Zbl 1209.68412

Summary: This paper deals with multi-class classification for linguistic fuzzy rule based classification systems. The idea is to decompose the original data-set into binary classification problems using the pairwise learning approach (confronting all pair of classes), and to obtain an independent fuzzy system for each one of them. Along the inference process, each fuzzy rule based classification system generates an association degree for both of its corresponding classes and these values are encoded into a fuzzy preference relation.
Our analysis is focused on the final step that returns the predicted class-label. Specifically, we propose to manage the fuzzy preference relation using a non-dominance criterion on the different alternatives, contrasting the behaviour of this model with both the classical weighted voting scheme and a decision rule that combines the fuzzy relations of preference, conflict and ignorance by means of a voting strategy.
Our experimental study is carried out using two different linguistic fuzzy rule learning methods for which we show that the non-dominance criterion is a good alternative in comparison with the previously mentioned aggregation mechanisms. This empirical analysis is supported through the corresponding statistical analysis using non-parametrical tests.

MSC:

68T05 Learning and adaptive systems in artificial intelligence

Software:

KEEL; UCI-ml
PDFBibTeX XMLCite
Full Text: DOI

References:

[1] Akbarzadeh-Totonchi, M. R.; Moshtagh-Khorasani, M., A hierarchical fuzzy rule-based approach to aphasia diagnosis, Journal of Biomedical Informatics, 40, 5, 465-475 (2007)
[2] Alcalá-Fdez, J.; Sánchez, L.; García, S.; del Jesus, M.; Ventura, S.; Garrell, J.; Otero, J.; Romero, C.; Bacardit, J.; Rivas, V.; Fernández, J.; Herrera, F., KEEL: a software tool to assess evolutionary algorithms to data mining problems, Soft Computing, 13, 3, 307-318 (2009)
[3] Allwein, E. L.; Schapire, R. E.; Singer, Y., Reducing multiclass to binary: a unifying approach for margin classifiers, Journal of Machine Learning Research, 1, 113-141 (2000) · Zbl 1013.68175
[4] A. Asuncion, D.J. Newman, UCI machine learning repository, University of California, Irvine, School of Information and Computer Sciences. URL: \( \langle;\) http://www.ics.uci.edu/∼;mlearn/MLRepository.html \(\rangle;\); A. Asuncion, D.J. Newman, UCI machine learning repository, University of California, Irvine, School of Information and Computer Sciences. URL: \( \langle;\) http://www.ics.uci.edu/∼;mlearn/MLRepository.html \(\rangle;\)
[5] Cordón, O.; del Jesus, M. J.; Herrera, F., A proposal on reasoning methods in fuzzy rule-based classification systems, International Journal of Approximate Reasoning, 20, 1, 21-45 (1999)
[6] Cordón, O.; Gomide, F.; Herrera, F.; Hoffmann, F.; Magdalena, L., Ten years of genetic fuzzy systems: current framework and new trends, Fuzzy Sets and Systems, 141, 1, 5-31 (2004) · Zbl 1050.93513
[7] Demšar, J., Statistical comparisons of classifiers over multiple data sets, Journal of Machine Learning Research, 7, 1-30 (2006) · Zbl 1222.68184
[8] Dietterich, T. G., An experimental comparison of three methods for constructing ensembles of decision trees: bagging, boosting, and randomization, Machine Learning, 40, 139-157 (2000)
[9] Fernández, A.; del Jesus, M. J.; Herrera, F., On the 2-tuples based genetic tuning performance for fuzzy rule based classification systems in imbalanced data-sets, Information Sciences, 180, 18, 1268-1291 (2010)
[10] Fernández, A.; García, S.; del Jesus, M. J.; Herrera, F., A study of the behaviour of linguistic fuzzy rule based classification systems in the framework of imbalanced data-sets, Fuzzy Sets and Systems, 159, 18, 2378-2398 (2008)
[11] Fürnkranz, J., Round robin classification, Journal of Machine Learning Research, 2, 721-747 (2002) · Zbl 1033.68086
[12] Fürnkranz, J.; Hüllermeier, E.; Vanderlooy, S., Binary decomposition methods for multipartite ranking, (Buntine, W. L.; Grobelnik, M.; Mladenic, D.; Shawe-Taylor, J., ECML/PKDD (1) of Lecture Notes in Computer Science, Vol. 5781 (2009), Springer), 359-374
[13] García, S.; Fernández, A.; Luengo, J.; Herrera, F., A study of statistical techniques and performance measures for genetics-based machine learning: accuracy and interpretability, Soft Computing, 13, 10, 959-977 (2009)
[14] García, S.; Fernández, A.; Luengo, J.; Herrera, F., Advanced nonparametric tests for multiple comparisons in the design of experiments in computational intelligence and data mining: experimental analysis of power, Information Sciences, 180, 10, 2044-2064 (2010)
[15] García, S.; Herrera, F., An extension on “statistical comparisons of classifiers over multiple data sets” for all pairwise comparisons, Journal of Machine Learning Research, 9, 2677-2694 (2008) · Zbl 1225.68178
[16] González, A.; Pérez, R., A learning system of fuzzy control rules, (Herrera, F.; Verdegay, J. L., Genetic Algorithms and Soft Computing (1996), Physica-Verlag: Physica-Verlag New York), 202-225
[17] González, A.; Pérez, R., Completeness and consistency conditions for learning fuzzy rules, Fuzzy Sets and Systems, 96, 37-51 (1998)
[18] González, A.; Pérez, R., SLAVE: a genetic learning system based on an iterative approach, IEEE Transactions on Fuzzy Systems, 7, 176-191 (1999)
[19] González, A.; Pérez, R., Selection of relevant features in a fuzzy genetic learning algorithm, IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics, 31, 3, 417-425 (2001)
[20] Hastie, T.; Tibshirani, R., Classification by pairwise coupling, The Annals of Statistics, 26, 2, 451-471 (1998) · Zbl 0932.62071
[21] Herrera, F., Genetic fuzzy systems: taxonomy, current research trends and prospects, Evolutionary Intelligence, 1, 27-46 (2008)
[22] Hühn, J. C.; Hüllermeier, E., FR3: a fuzzy rule learner for inducing reliable classifiers, IEEE Transactions on Fuzzy Systems, 17, 1, 138-149 (2009)
[23] Hüllermeier, E.; Brinker, K., Learning valued preference structures for solving classification problems, Fuzzy Sets and Systems, 159, 18, 2337-2352 (2008) · Zbl 1187.68394
[24] E. Hüllermeier, J. Fürnkranz, Comparison of ranking procedures in pairwise preference learning. In: Proceedings of the 10th International Conference on Information Processing and Management of Uncertainty in Knowledge-Based Systems IPMU04, Vol. 11, 2004.; E. Hüllermeier, J. Fürnkranz, Comparison of ranking procedures in pairwise preference learning. In: Proceedings of the 10th International Conference on Information Processing and Management of Uncertainty in Knowledge-Based Systems IPMU04, Vol. 11, 2004.
[25] Hüllermeier, E.; Vanderlooy, S., Combining predictions in pairwise classification: an optimal adaptive voting strategy and its relation to weighted voting, Pattern Recognition, 43, 1, 128-142 (2010) · Zbl 1191.68578
[26] Ishibuchi, H.; Nakashima, T., Effect of rule weights in fuzzy rule-based classification systems, IEEE Transactions on Fuzzy Systems, 9, 4, 506-515 (2001)
[27] Ishibuchi, H.; Nakashima, T.; Nii, M., Classification and Modeling with Linguistic Information Granules: Advanced Approaches to Linguistic Data Mining (2004), Springer-Verlag · Zbl 1060.68102
[28] Ishibuchi, H.; Yamamoto, T., Rule weight specification in fuzzy rule-based classification systems, IEEE Transactions on Fuzzy Systems, 13, 428-435 (2005)
[29] Ishibuchi, H.; Yamamoto, T.; Nakashima, T., Hybridization of fuzzy GBML approaches for pattern classification problems, IEEE Transactions on System, Man and Cybernetics B, 35, 2, 359-365 (2005)
[30] Marín-Blázquez, J.; Pérez, G. M., Intrusion detection using a linguistic hedged fuzzy-XCS classifier system, Soft Computing, 13, 3, 273-290 (2009)
[31] Orlovsky, S., Decision-making with a fuzzy preference relation, Fuzzy Sets and Systems, 1, 155-167 (1978) · Zbl 0396.90004
[32] Sheskin, D., Handbook of Parametric and Nonparametric Statistical Procedures (2006), Chapman & Hall/CRC
[33] Sun, Y.; Wong, A. C.; Kamel, M. S., Classification of imbalanced data: a review, International Journal of Pattern Recognition and Artificial Intelligence, 23, 4, 687-719 (2009)
[34] Tsang, C.; Kwong, S.; Wang, H., Genetic-fuzzy rule mining approach and evaluation of feature selection techniques for anomaly intrusion detection, Pattern Recognition, 40, 9, 2373-2391 (2007) · Zbl 1119.68189
[35] Venturini, G., SIA: a supervised inductive algorithm with genetic search for learning attributes based concepts, (Brazdil, P., Machine Learning ECML—93 of Lecture Notes in Artificial Intelligence, Vol. 667 (1993), Springer), 280-296
[36] Wu, H.; Mendel, J., Classification of battlefield ground vehicles using acoustic features and fuzzy logic rule-based classifiers, IEEE Transactions on Fuzzy Systems, 15, 1, 56-72 (2007)
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.