CS 675 Deep Learning

Resources §

• GitHub - hindupuravinash/the-gan-zoo: A list of all named GANs!
• Machine Learning Mastery

Homeworks §

• CS 675 HW1 ← problem 3 only
• CS 675 HW2

Notes to Improve §

• Finish up MLE derivation & understanding for Probabilistic Generative Models
• Finish bias derivation in NN
• Finish optimizing the logistic regression ^02k7nz

Notes §

Background §

• deep learning is just a catalogue of tools, and finding which tool to use is the key intuition
• “cute solution” is not valued. Useful solution is valued.
• List of Machine Learning Datasets
• Norm (Math)
• Order Statistic
• Information Theory
• Eigenvector and Eigenvalue
• Matricies Differentiation

Classification §

• Linear Discriminant Model
• Probabilistic Generative Models
• Logistic Model
• Neural Networks, Backpropagation and Gradient Descent
• Better Gradient Descent Methods

Vision §

• Convolutional Neural Networks
• Object Detection