×

zbMATH — the first resource for mathematics

Fuzzy entropy and conditioning. (English) Zbl 0623.94005
A new nonprobabilistic entropy measure is introduced in the context of fuzzy sets or messages. Fuzzy units, or fits, replace bits in a new framework of fuzzy information theory. An appropriate measure of entropy or fuzziness of messages is shown to be a simple ratio of distances: the distances between the fuzzy message and its nearest and farthest nonfuzzy neighbors. Fuzzy conditioning is examined as the degree of subsethood (submessagehood) of one fuzzy set or message in another. This quantity is shown to behave as a conditional probability in many contexts. It is also shown that the entropy of A is the degree to which \(A\cup A^ c\) is a subset of \(A\cap A^ c\), an intuitive relationship that cannot occur in probability theory. This theory of subsethood is then shown to solve one of the major problems with Bayes-theorem learning and its variants - the problem of requiring that the space of alternatives be partitioned into disjoint exhaustive hypotheses. Any fuzzy subsets will do. However, a rough inverse relationship holds between number and fuzziness of partitions and the information gained from experience. All results reduce to fuzzy cardinality.

MSC:
94A17 Measures of information, entropy
94A15 Information theory (general)
94D05 Fuzzy sets and logic (in connection with information, communication, or circuits theory)
PDF BibTeX XML Cite
Full Text: DOI
References:
[1] Klement, E.P., Operations on fuzzy sets and fuzzy numbers related to triangular norms, (), 218-225 · Zbl 0547.04003
[2] Prade, H., A computational approach to approximate and plausible reasoning with applications to expert systems, IEEE trans. pattern anal. and machine intelligence, 7, 3, 260-283, (1985) · Zbl 0565.68089
[3] Zadeh, L.A., Similarity relations and fuzzy orderings, Inform. sci., 3, 177-206, (1971) · Zbl 0218.02058
[4] Kaufmann, A., ()
[5] Zadeh, L.A., A computational approach to fuzzy quantifiers in natural languages, Comput. math. appl., 9, 1, 149-184, (1983) · Zbl 0517.94028
[6] Zadeh, L.A., The role of fuzzy logic in the management of uncertainty in expert systems, Fuzzy sets and systems, 11, 199-227, (1983) · Zbl 0553.68049
[7] Dubois, D.; Prade, H., Fuzzy cardinality and the modeling of imprecise quantification, Fuzzy sets and systems, 16, 3, 199-235, (Aug. 1985)
[8] Kosko, B., Counting with fuzzy sets, IEEE trans. pattern anal. and machine intelligence, PAMI-8, no. 4, 556-557, (July 1986)
[9] De Luca, A.; Termini, S., A definition of a nonprobabilistic entropy in the setting of fuzzy sets theory, Inform. and control, 20, 301-312, (1972) · Zbl 0239.94028
[10] Yager, R.R., On the measure of fuzziness and negation, part I: membership in the unit interval, Internat. J. gen. systems, 5, 221-229, (1979) · Zbl 0429.04007
[11] Kohonen, T., Self-organization and associative memory, (1984), Springer Berlin · Zbl 0528.68062
[12] Zadeh, L.A., Fuzzy sets, Inform. and control, 8, 338-353, (1965) · Zbl 0139.24606
[13] Bandler, W.; Kohout, L., Fuzzy power sets and fuzzy implication operators, Fuzzy sets and systems, 4, 13-30, (1980) · Zbl 0433.03013
[14] Dempster, A.P., Upper and lower probabilities induced by a multivalued mapping, Ann. math. statist., 38, 325-339, (1967) · Zbl 0168.17501
[15] Dempster, A.P., A generalization of Bayesian inference, J. roy. statist. soc. ser. B, 30, 205-247, (1968) · Zbl 0169.21301
[16] Shafer, G., A mathematical theory of evidence, (1976), Princeton U.P Princeton, N.J · Zbl 0359.62002
[17] Rosenblatt, F., Principles of neurodynamics, (1962), Spartan New York · Zbl 0143.43504
[18] Minsky, M.; Papert, S., Perceptrons, (1969), M.I.T. Press Cambridge, Mass · Zbl 0197.43702
[19] Cohen, M.A.; Grossberg, S., Absolute stability of global pattern formation and parallel memory storage by competitive neural networks, IEEE trans. systems, man, and cybernet., SMC-13, 815-826, (Oct. 1983)
[20] Hecht-Nielsen, R., Performance limits of optical, electro-optical, and electronic artificial neural system processors, ()
[21] Hopfield, J.J., Neural networks and physical systems with emergent collective computational abilities, (), 2554-2558 · Zbl 1369.92007
[22] Abu-Mostafa, Y.S.; Jacques, J.St., Information capacity of the Hopfield model, EEE trans. inform. theory, IT-31, 4, 461-464, (July 1985)
[23] Doyle, J., Methodological simplicity in expert system construction: the case of judgments and reasoned assumptions, AI mag., 3, 2, 39-43, (1984)
[24] Cohen, P.R.; Sullivan, M., An endorsement-based plan recognition program, (), 475-479
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. It attempts to reflect the references listed in the original paper as accurately as possible without claiming the completeness or perfect precision of the matching.