Foundations
- Mathematical Induction
- By Contradiction
- By Contra-positive: if a then b if not b then not a
- Falsity, by counter-example
- specifically, you can prove a universal statement false, or a existential statement true
a If and only if b is proven by two legs:
- Forward, if a then b
- Backward, if b then a either of these legs can be then proven by above induction, contradiction, by contrapositive, or by any combination.
Algebraic
- You can split summations (even infinite ones)
- Equivalently, Pushing log thru product makes it a sum
- Telescoping sums and products
- Useful when moveing
- Break up summations
- Summation of Squared Probability
- Tower property
- Linearity of expectation. You can switch expectation and summation
- Definition of expectation is an integral (or summation)
- Two RVs are identical if they have the same CDF.1
Calculus
- switch integrals
Inequalities
- Sum greater than max
- Max greater than averages
- Average greater than min. Combined:
always.