Foundations

  • Mathematical Induction
  • By Contradiction
  • By Contra-positive: if a then b if not b then not a
  • Falsity, by counter-example
    • specifically, you can prove a universal statement false, or a existential statement true

a If and only if b is proven by two legs:

  1. Forward, if a then b
  2. Backward, if b then a either of these legs can be then proven by above induction, contradiction, by contrapositive, or by any combination.

Algebraic

  • You can split summations (even infinite ones)
  • Equivalently, Pushing log thru product makes it a sum
  • Telescoping sums and products
    • Useful when moveing
  • Break up summations
  • Summation of Squared Probability
  • Tower property
  • Linearity of expectation. You can switch expectation and summation
  • Definition of expectation is an integral (or summation)
  • Two RVs are identical if they have the same CDF.1

Calculus

  • switch integrals

Inequalities

  • Sum greater than max
  • Max greater than averages
  • Average greater than min. Combined:

always.

Footnotes

  1. Why CDF? statistics - Why is there a preference to use the cumulative distribution function to characterise a random variable instead of the probability density function? - Mathematics Stack Exchange