Re: [UAI] Fuzzy sets vs. Bayesian Network: Fuzzy Control vs. Belief, Fuzzy Logic vs. Fuzzy Sets

From: grosof@us.ibm.com
Date: Mon Feb 28 2000 - 08:20:25 PST

  • Next message: David Madigan: "Re: [UAI] Graphical representation of CPTs in belief nets"

    Hi all, esp. Kathy and Scott,
    I share Kathy's views about the issues of fuzziness and engineering, as
    well as the interestingness of the interpretation of fuzzy membership as
    probabilistic likelihood that were expressed in her note (well done
    Kathy!). Personally, I (normatively/prescriptively) subscribe pretty much
    to this interpretation. To amplify a bit, fuzzy membership of x in Q can
    be viewed as probability (perhaps renormalized) that some person/oracle
    would say that x is in Q.
    I have always found fuzzy sets to be a useful and intuitive notion, they
    are a quite elegant and concise way to talk about (and with intensifiers
    like "very" etc., to define) collections of such likelihoods/probabilities.
    However, both this and a utility-ish interpretation of fuzziness leave two
    main issues quite open:
    - fuzzy *logic*'s semantical justification/intuitions
    - what is going on in the use of fuzzy logic for applications in *control*,
    e.g., in VCR's, elevators, trains, etc..

    Wrt fuzzy logic overall:
     I always have found problematic the justification of the min or product
    rules for the conjunction-combination operation in fuzzy logic, for a
    couple reasons:
    - each makes a very strong and rigid assumption about dependency (complete
    dependence for min, complete independence for product), when viewed in
    Bayesian terms.
    - there is no sensitivity to what propositions are being conjunctively
    combined, e.g., it could be P has membership of 0.4, not-P has membership
    0.6, and then the logical contradiction (P and not-P) is assigned non-zero
    membership: 0.4 (min rule) or 0.24 (product rule).
    Boolean tautologies are thus not respected.

    Wrt applications of fuzzy logic to control (where they have had a lot of
    practical success and popularity in the last decade or so):
    Here fuzziness is applied to beliefs about what actions to take.
    I have yet to see a terribly satisfactory or deep intuitive
    *Bayesian*-flavored account of fuzziness in this context, esp. of fuzzy
    logic in the ways it is usually applied to control applications. One way
    to think about this at a high-level would be to view fuzzy beliefs about
    the control variables in terms of an oracle/person who would say what is
    the probability, or expected utility, of the right thing to do, given
    various evidences. But needed is a detailed Bayesian interpretation of
    the kind of fuzzy logic rules that are typically found in successful
    practice, in relation to this high-level interpretation.

    I'm curious if anyone has knowledge/pointers about, or new ideas about,
    this direction of approach?

    Benjamin

    ---------------------- Forwarded by Benjamin Grosof/Watson/IBM on
    02/28/2000 10:14 AM ---------------------------

    Kathryn Blackmond Laskey <klaskey@gmu.edu>@CS.ORST.EDU on 02/28/2000
    02:37:39 PM

    Sent by: owner-uai@CS.ORST.EDU

    To: uai@CS.ORST.EDU
    cc:
    Subject: Re: [UAI] Fuzzy sets vs. Bayesian Network

    Scott,

    >> > First, remember that it's not the *probability* of being
    >> > tall or small. It's not a probability at all. It's something
    >> > else, sometimes called "possibility", which measures the
    >> > degree something is true (not its frequency, or even one's
    >> > belief that it's true).
    >> This is true, but allow me to remark that I haven't seen any better
    >> `definition' than ``it's something else''. No axiomatic foundations,
    such
    >> that you can never be sure whether it's your calculus or your algorithm
    >> that leads to bad results....
    >
    >Well, they do have a clear axiomatic foundation. I agree however
    >that the fuzzy types have not given a clear interpretation of what
    >possibility really *is*. What is this measure really measuring?
    >...
    >> > In a fuzzy set theory, the set of tall people
    >> > and the set of small people could well be not mutually
    >> > exclusive. I'm tall for a jockey, but pretty small for a
    >> > basketball player. It makes a difference what the sets
    >> > were constructed to represent.
    >...
    >So you think vagueness is "nothing more than incomplete
    >information"? It's easy to show that it has nothing to do with
    >incomplete information. I could have all the heights of every
    >single individual in the population down to the nanometer,
    >yet still not be sure whether someone deserves the appellation
    >of "tall". There are still borderline cases. Or did you mean to
    >say it is nothing more that incomplete *specification*? That's
    >the more common argument.

    Probability is appropriate for sets satisfying the "clarity test." That
    is, could a clairvoyant who knows the entire state of the world, past
    present and future, down to the wave function of every quark, unambiguously
    specify the value of the variable in question? For heights measured in
    centimeters, the answer is yes (leaving out quantum fuzziness, which is
    there but matters only in the fifteenth decimal place or so). For example,
    our clairvoyant can easily answer questions such as whether my son Robbie
    will be between 175 and 176 centimeters tall when he reaches his full adult
    height. Therefore, it is fully appropriate to use a probability density
    function on his adult height, (at least in the classical physics
    approximation where people have definite heights -- which will serve most
    of our modeling purposes just fine).

    However, as pointed out, even if we knew Robbie's adult height, we wouldn't
    know whether he will be tall or not. I agree with the fuzzy folks that
    there *is* something there that's important to capture. However, I've
    tried in vain to get a number of different people in the fuzzy community to
    tell me what a fuzzy membership actually means in operational terms. If
    I'm going to use something in a serious engineering application, as opposed
    to academic philosophizing, it is *very* useful to know what I'm doing in
    theory, even if I do put in plenty of engineering hacks. As my thesis
    advisor used to tell me, "First figure out what you would do if you could
    do it right, and then figure out how to approximate it." If I don't KNOW
    what the thing I'm trying to approximate with my engineering hacks would
    mean if I could do it right, I'm rather uncomfortable.

    For probability theory we have several competing ontologies that have clear
    operational meaning in the domains to which they apply. The most commonly
    cited are (1) propensities based on physical symmetries; (2) limiting
    frequencies of "random" events; (3) beliefs about uncertain phenomena. All
    of these give clear operational criteria for connecting the referents of
    the model to entities in the world and for recognizing when they do and
    don't apply. Moreover, on nearly all problems to which more than one of
    them is applicable, when applied by a competent modeler, they give nearly
    indistinguishable answers to most questions of practical modeling interest.

    I have heard exactly one proposed ontology for fuzzy membership functions
    (proposed by Judea Pearl, among others) that makes sense to me. Under this
    proposed ontology, the fuzzy membership of Robbie's adult height in the set
    "tall," in a given context, should be taken as proportional to the
    probability that a generic person in that context would use the label
    "tall" to describe Robbie. Thus, fuzzy memberships are likelihood
    functions. We can think of them as soft evidence applied to numerical
    crisp set height measurements.

    I might go beyond this and suggest an alternate criterion, that the fuzzy
    membership be proportional to the *utility* for an appropriately defined
    decision maker in that context of using the term "tall" to describe Robbie
    (this, for example, would allow us to weigh costs of inappropriate usage of
    the term).

    This proposed ontology makes a lot of sense at a surface level. However, I
    know it is not what most fuzzy set researchers think they are talking about
    when they use fuzzy memberships. I've never seen its mathematical
    implications worked out, or seen any discussions about whether or under
    what circumstances it gives rise to combination rules that look anything
    like what the fuzzy people now use.

    I therefore find myself in the difficult position of being highly
    sympathetic to the concerns that drove people to invent fuzzy sets in the
    first place, but extremely skeptical about whether what they've developed
    solves the problem they set out to solve in an acceptable way.

    Kathy Laskey



    This archive was generated by hypermail 2b29 : Mon Feb 28 2000 - 08:21:41 PST