Bifalgorithm post · Brisk · Chapter 1
Why should independence be supported by evidence rather than assumed?
Why should independence be supported by evidence rather than assumed? (Brisk · Chapter 1) — "The shrewd reader may object that this was a startling coincidence…
Ideas in this flowchart
- Independence should be accepted only when data provides sufficient support, while allowing for ordinary sampling noise.
- A shrewd reader may object that the exact equality in the example is an unlikely coincidence.
- The objection raises whether independence is too theoretical to be relevant in practice.
- Finite samples inevitably produce random fluctuations in the observed data.
- An ordinary coin flipped 1,000 times is unlikely to produce exactly 500 heads, even if it is unbiased.
- Statistical methods determine how much observed data may deviate from expectations before raising a red flag.
- Events may still be judged independent when the observed contingency table is close enough to the ideal pattern.
- The burden of proof is on independence rather than on non-independence.
- We should not initially assume that the events under consideration are independent.
- We should remain suspicious that two events affect each other and conclude independence only when the data works out sufficiently evenly.
- The claim that Pr(A | B) equals Pr(A) is an exceptional statement that requires strong evidence.
