Lecture 4

Conditional Probability (Part 1)


Grace Tompkins

Last modified — 02 Oct 2026

Learning Outcomes

By the end of this lecture, students are anticipated to be able to:

  • Use intuition to conditional probabilities from sets
  • Calculate conditional probabilities using the definitions
  • Use the law of total probability

1 Conditional Probability

Conditional Probability

  • In general, the outcome of a random experiment can be any element of \(\Omega\).

  • Sometimes, we have “partial information” about which elements can occur.

  • Roll a die.

  • If \(A\) is the event of obtaining a “2”, then \(\mathbb{P}(A) = 1/6\).

  • But if the outcome is known to be even, then intuition suggests that \(\mathbb{P}(A) > 1/6\).

  • Conditional probability formalizes this intuition (and helps to avoid mistakes)

Conditional Probability

  • Two events play distinct roles in this example:

  • The event of interest \(A = \{ 2 \}\)

  • The conditioning event \[ B= \{\text{outcome is even}\} = \{2, 4, 6\} \]

  • The conditioning event captures the “partial information”

  • If we only consider the three possible outcomes in B (even numbers), only one of them is a 2. Therefore, the probability of rolling a 2 if you know the roll was even is indeed 1/3.

Conditional Probability



The probability of an event A, conditional on event B is written as

\[\mathbb{P}(A \ \vert\ B)\]

We read this as “the probability of \(A\) given \(B\)” or “the probability of \(A\) conditional on \(B\)”

Conditional Probability (Formal definition)

  • Let \(A, B \subseteq \Omega\) and assume \(\mathbb{P}(B) > 0\)
  • The conditional probability of \(A\) given \(B\) is \[\mathbb{P}\left(A \ \vert\ B \right) \, = \, \frac{ \mathbb{P}\left( A \cap B \right) }{ \mathbb{P}\left( B \right) }, \qquad \text{for } \mathbb{P}(B) > 0\]
  • Just as \(\mathbb{P}(\cdot)\) is a function, for any fixed \(B\), \(P \left(\ \cdot \ \ \vert\ B \right)\) is also a function. Its argument is any event \(A \subseteq \Omega\).

  • Moreover, \(\mathbb{P}\left(\ \cdot \ \ \vert\ B \right)\) satisfies the three Axioms of a Probability (i.e., is a probability).

Conditional Probability (Formal definition)

100 people were surveyed about their pets. 20 people had a cat, and 12 people had both a dog and a cat. What is the probability that a randomly selected person has a dog, given that they have a cat?

Useful Result:


As \(P(\cdot \ \vert\ B)\) is a probability, for any event \(A\):

  • \(\mathbb{P}(A \ \vert\ B) + \mathbb{P}( A^C \ \vert\ B) = 1\)
  • This implies:

\[\mathbb{P}( A^C \ \vert\ B) = 1 - \mathbb{P}(A \ \vert\ B)\]

Formalizing our intuition

Your friend flips two coins, looks at it, and tells you that the two faces are the same.

What is the probability that both coins show heads? Use the definition of conditional probability to solve this.

Formalizing our intuition

Multiplication Property

If \(\mathbb{P}(A_1) > 0\): \[ \mathbb{P}\left( A_{1} \cap A_{2}\right) = \mathbb{P}\left(A_{2}\ \vert\ A_{1}\right) \, \mathbb{P}\left( A_{1}\right). \] This is just a rearrangement of our definition!

If \(\mathbb{P}(A_1),\ \mathbb{P}(A_1 \cap A_2),\dots,\ P(A_1 \cap A_2 \cap \dots \cap A_{n-1}) > 0\), then \[\begin{aligned} \mathbb{P}\left( A_{1}\cap A_{2}\cap \cdots \cap A_{n}\right) &= \mathbb{P}\left( A_{n}\ \vert\ A_{1}\cap A_{2}\cap \cdots \cap A_{n-1}\right) \\ &\quad \times \mathbb{P}\left( A_{n-1}\ \vert\ A_{1}\cap A_{2}\cap \cdots \cap A_{n-2}\right) \\ & \quad \times \cdots \times\\ & \quad \times \mathbb{P}\left( A_{3}\ \vert\ A_{1}\cap A_{2}\right) \times \mathbb{P}\left( A_{2}\ \vert\ A_{1}\right) \times \mathbb{P}\left( A_{1}\right) \end{aligned}\]

Proof of multiplication property

Urns and Balls

  • An urn has 10 red balls and 40 black balls.

  • Three balls are randomly drawn without replacement.

Calculate the probability that:

  1. The 3rd ball is red given that the 1st is red and the 2nd is black.

  2. The first drawn ball is red, the 2nd is black and the 3rd is red.

Urns and Balls

The “Total Probability” Formula

We say that \(B_{1}, \ldots, B_{n}\) is a partition of \(\Omega\) if

  1. They are disjoint \[ B_{i}\cap B_{j} \, = \, \varnothing \quad \mbox{ for } i \ne j \, , \]

  2. They cover the whole sample space: \(\bigcup_{i=1}^{n} B_{i} \, = \, \Omega\)

A simple partition is any event \(A\) and its complement \(A^c\).

The “Total Probability” Formula

If \(B_{1}, \ldots, B_{n}\) is a partition of \(\Omega\), then, for any \(A \subset \Omega\), \[\mathbb{P}\left( A\right) =\sum_{i=1}^{n} \mathbb{P}\left( A\ \vert\ B_{i}\right) \, \mathbb{P}\left( B_{i}\right).\]

Proof of Total Probability

  • \(A = A \cap \Omega = A \cap \left( \bigcup _{i=1}^{n}B_{i}\right) = \bigcup_{i=1}^{n}\left( A \cap B_{i}\right)\)

  • The events \(\left( A \cap B_{i}\right)\) are disjoint.

  • Therefore, by Axiom 3, we have \[\begin{aligned} \mathbb{P}\left( A\right) & = \mathbb{P}\left( \bigcup_{i=1}^{n} A \cap B_{i} \right) \\ &=\sum_{i=1}^{n} \mathbb{P}\left( A\cap B_{i}\right) \\ &=\sum_{i=1}^{n} \mathbb{P}\left( A\ \vert\ B_{i}\right) \, \mathbb{P}\left( B_{i}\right). \end{aligned}\]

Flu Test

  • Suppose that every patient who visits the ER is given a flu test.
  • Suppose that 30% of patients have flu.
  • A patient with flu tests positive 90% of the time.
  • A patient without flu tests negative 80% of the time.

If a new patient walks into the ER, what is the probability that they test positive for the flu?

Checkpoint 1 is this Friday!

Your first checkpoint (one short question at the end of class ~ 15 minutes) is on Friday September 25th

It is a closed-book assessment based on the practice problems assigned for Sections 1.1 - 1.4 (all material so far up to the end of this lecture)

You may bring a non-graphing, non-programmable calculator and one cheat sheet, which you should add/edit to over time for all assessments. The cheat sheet must be:

  • 8.5 x 11 inches or smaller
  • Can write on both sides
  • HANDWRITTEN, not photocopied or printed (typed or drawn on tablet)
  • Write whatever you want on it

Cheat sheets and calculators that do not follow these rules will be confiscated - sorry!