Conditional Probability

DEFINITION: Given a a Sample Space $\QTR{Large}{S}$ , a Sigma Algebra $\QTR{Large}{A}$, a Probability Measure $\QTR{Large}{P}$ on $\QTR{Large}{A}$, and Events MATH and MATH in $\QTR{Large}{A.}$ Assuming MATH



define the Conditional Probability of MATH given MATH

MATH


Figure
________________________________________________________________________

An Example:

The Events:

$\QTR{Large}{S~=~}$ {The days of October and November 2012}



$\QTR{Large}{O~=~}$ {The days of October 2012}



$\QTR{Large}{N~=~}$ {The days of November 2012}



MATHThe various days of the week in $\QTR{Large}{S}$

$\QTR{Large}{R~=~}$ {The days it rained in $\QTR{Large}{S}$ }


Finally, $\QTR{Large}{A}$ is the Sigma Algebra generated by the given Events.




The Probabilities:

Most are arithmetic;

MATH, MATH, MATH, MATH

MATH

MATH, MATH$\bigskip $

From weather data:

MATH, MATH

From Calculations:

MATH MATH

MATH MATH

Since MATHand MATH $\ $are disjoint,

MATH MATH

________________________________________

Definition:

Events MATHandMATH are said to be Independent if MATH or equivalently MATHor equivalently MATH

Examples:

  1. The Experiment is flip a coin twice MATHis get a Head the first time and MATHis get a Head the second time .


  2. The Experiment is choose a card from a standard deck, MATHis the card is a three and MATHthe card is a heart.


____________________________________________________________________________________________

Bayes Rule:

MATH

since MATH

What is the probability that it was a day in October given that we know it rained on that day?

MATH

An Aside: The Rule present above is special case of a more general Bayes Formula of that will come into play later in the semester. I will discuss it at that time but at this point it would be worthwhile to at least review the material in Grinstead and Snell's Introduction to Probability beginning on Page 145.

____________________________________________________________________________________

A more relevent example:


Figure

We are given a communications channel that transmits $\QTR{Large}{1}$s and $\QTR{Large}{0}$s with conditional probabilities MATH ,MATH ,MATH ,MATH.

That is, for example, given that we transmit a $\QTR{Large}{1}$ the probability that a $\QTR{Large}{1}$ will be received is MATH.


Question: Assume that we know that MATH given that we receive a $\QTR{Large}{1}$ what is the probability that a $\QTR{Large}{1}$ was transmitted., compute MATH?


MATH

and

MATH

MATH

so

MATH


Figure

________________________________________________________________________________________________________




Exercise, The not so wonderful strategy:


Figure

Assume MATH . Fill in the question marks, using the previous diagram.

Finally compute MATH

MATH