I've struggle with Bayes off and on for a number of years. It drives me crazy as it's a simple algebraic formula with only 4 terms in it. How complicated can that be? Well, I think the Bayes Theorem is very subtle and profound. However, IMHO, it's been saddled with terrible names for the terms which I find confusing and unuseful.
The lecture videos really helped me a lot because Professor Thrun carefully explains each term very well.
I thought it might help to recast the descriptions of the terms. I'll also change the variable names as the usual A and B are meaningless to me. So, Bayes theorem in other variable names is:
P(T|C) * P(C)
P(C|T) = ---------------------------
P(T)
where
C is some sort of condition that is not directly observable, but somewhat detectable by test T.
T is some sort of diagnostic test for the condition that is not 100% reliable.
P(C|T) is known as the "posterior" (yucky name). Conceptually, it's the "answer". What people really care about is whether the Condition C is true, but all they know is the somewhat unreliable test T came back positive. They are not happy that all they have is this unreliable test T but it's the best indicator as whether condition C is true.
P(T|C) is known as the "likelihood" (that's vague and confusing to me!) Conceptually, it reflects how good the test T is. That is, given a condition C (that's hard to measure) how often does the test T come back true. (That's something that might be determined under laboratory conditions, so who knows how accurate that is.)
P(C) is known as the "prior". Conceptually it's how prevalent is condition C in the general population. In other words, if there was no test T what's the chances of getting condition C? Again, generally this is an estimate it's hard to measure, especially if C is rare.
P(T) is known as the "marginal likelihood" which has to be the worse name of them all! One important fact from the videos is that this probability is in practice hard to measure. Conceptually, it's how often is the test T true for all cases: true positives and false positives. (This is where the Total Probability (another awful name!) is a useful calculation.) From the video, I gather sometimes people give up on finding this probability altogether since it's so hard to measure.
So the Bayes equation is in my words is:
"What's probability that condition C is really true"
equals "How good is the test T" * "How common is the condition C"
divided by
"how often does the test T trigger (summed over all possible conditions)"
Some observations: *If the test (likelihood) is "better", then the test results (posterior) are more accurate *If the condition (prior) is more prevalent, then the test results (posterior) are more accurate *If the test triggers for whatever reason (marginal likelihood), then the test results (posterior) are less accurate *If the test is perfectly correlated to the condition (T => C and C => T), then the posterior is 1, which makes sense (the test is a perfect indicator of the condition.)
Another thought... I think the portion of the equation, the ratio P(C)/P(T) is significant and probably deserves a name.
I hope that helps. (some minor edits were added).