142. Independence

Two events are said to be independent if the occurrence of one event does not change our beliefs about the other

Events A and B are independent from each other if:

𝑃(𝐴𝐵)=𝑃(𝐴)𝑃(𝐵)

Implies:

𝑃(𝐵|𝐴)=𝑃(𝐵)𝑃(𝐴|𝐵)=𝑃(𝐴)

Applies even if 𝑃(𝐴)=0

142.1. Independence of Complements

If A and B are independent, then the following pairs are also independent:

Formally:

If

𝑃(𝐴𝐵)=𝑃(𝐴)𝑃(𝐵)

then:

𝑃(𝐴𝐵𝑐)=𝑃(𝐴)𝑃(𝐵𝑐)𝑃(𝐴𝑐𝐵)=𝑃(𝐴𝑐)𝑃(𝐵)𝑃(𝐴𝑐𝐵𝑐)=𝑃(𝐴𝑐)𝑃(𝐵𝑐)

Proof

Start with:

𝐴=(𝐴𝐵)(𝐴𝐵𝑐)

Since (𝐴𝐵) and (𝐴𝐵𝑐) are disjoint, by the Additivity Axiom:

𝑃(𝐴)=𝑃(𝐴𝐵)+𝑃(𝐴𝐵𝑐)=𝑃(𝐴)𝑃(𝐵)+𝑃(𝐴𝐵𝑐)

Rearanging:

𝑃(𝐴𝐵𝑐)=𝑃(𝐴)𝑃(𝐴)𝑃(𝐵)=𝑃(𝐴)(1𝑃(𝐵))=𝑃(𝐴)𝑃(𝐵𝑐)

Thus we are back at out definition of independence:

𝑃(𝐴𝐵𝑐)=𝑃(𝐴)𝑃(𝐵𝑐)

142.2. Conditional Independence

𝑃(𝐴𝐵|𝐶)=𝑃(𝐴|𝐶)𝑃(𝐵|𝐶)

142.3. Pairwise Independence

142.4. Reliability