Math101learn.math101.caIndependent Events
A precise treatment of independence, conditional probability, pairwise versus mutual independence, and common misconceptions.
Precise definition
Events $A$ and $B$ are independent when $P(A\cap B)=P(A)P(B)$. If $P(B)>0$, this is equivalent to $P(A\mid B)=P(A)$. Independence means learning one event occurred does not change the probability of the other under the model.
Notation and mathematical language
Disjoint events satisfy $P(A\cap B)=0$. Two disjoint events with positive probabilities are therefore not independent. For three events, pairwise independence does not guarantee mutual independence; mutual independence requires product rules for every subcollection of size at least two.
Conceptual picture
Independence is a property of a joint distribution, not of whether events look unrelated. Repeated trials may be modelled independent when the mechanism resets and no shared influence remains, but that assumption should be supported.
Conditions and key results
Conditional probabilities require positive conditioning probability. Sampling without replacement is generally dependent; with replacement can be independent under identical random draws. Empirical near-equality does not prove exact population independence.
A reliable strategy
- Define events and compute marginal and intersection probabilities from a joint table, tree, or model.
- Compare $P(A\cap B)$ with $P(A)P(B)$ or compare a conditional probability with its marginal.
- For more than two events, test the required intersections rather than only pairs.
- State whether independence is assumed by design, established mathematically, or only assessed from sample evidence.
Fully worked example
Interpretation and application
Independence assumptions enable probability products, randomized trials, reliability calculations, and statistical models. Hidden common causes, clustering, and time dependence can invalidate them and make uncertainty estimates too small.
Common mistakes
Verification and reasonableness
- Compute the same joint probability from a conditional tree and a product formula.
- Check complements: if $A,B$ are independent, so are $A^c,B$ and other complement pairs.
- Simulate or inspect stratified data for dependence, while distinguishing evidence from proof.
Practice
- If $P(A)=0.4,P(B)=0.5$ and events are independent, find $P(A\cap B)$.
- Can positive-probability disjoint events be independent?
- Does pairwise independence imply mutual independence?
Answers and brief solutions
- $0.2$.
- No.
- Not in general.
Further deduction
A standard pairwise-not-mutual example uses two independent fair coin bits $X,Y$ and $Z=X\oplus Y$. Each pair is independent, but knowing any two determines the third, and $P(X=0,Y=0,Z=0)=1/4\ne1/8$. This demonstrates why higher-order intersection conditions carry information absent from pairwise checks.
If $A$ and $B$ are independent, their indicators have covariance zero: $E[I_AI_B]-E[I_A]E[I_B]=P(A\cap B)-P(A)P(B)=0$. Zero covariance for arbitrary numeric variables does not imply independence, except under special families such as jointly normal variables. Event independence and uncorrelatedness should therefore not be generalized carelessly.
Related topics
Explore the idea
Probability sampler
Change one quantity at a time and connect what moves to Independent Events.
success other outcome
Try it yourself
Hints are part of learning. Open one whenever it makes the next step feel possible.
If independent events have probabilities 0.3 and 0.2, what is their intersection probability?
- Independence gives $P(A\cap B)=P(A)P(B)$.
- $0.3(0.2)=0.06$.
End of lesson
Nice work making it this far.
Understanding grows through return visits. Save this lesson, try the practice, or continue when you are ready.
