140. Total Probability Theorem

Let 𝐵1,𝐵2,,𝐵𝑛 be a partition of the sample space Ω, meaning:

  1. 𝐵𝑖𝐵𝑗=𝑖𝑗 (disjoint)

  2. 𝑖=1𝑛𝐵𝑖=Ω (cover the whole space)

Then for any event A:

𝑃(𝐴)=𝑖=1𝑛𝑃(𝐴𝐵𝑖)=𝑖=1𝑛𝑃(𝐴|𝐵𝑖)𝑃(𝐵𝑖)

The total probability theorem arises by breaking an event into pieces using a partition, and each piece is expressed using the multiplication rule, which itself comes from the definition of conditional probability.

  1. Conditional Probability:
𝑃(𝐴|𝐵)=𝑃(𝐴𝐵)𝑃(𝐵)
  1. Multiplication Rule
𝑃(𝐴𝐵)=𝑃(𝐴|𝐵)𝑃(𝐵)
  1. Total Probability Theorem
𝑃(𝐴)=𝑖=1𝑛𝑃(𝐴|𝐵𝑖)𝑃(𝐵𝑖)