Guelph University
School of Engineering
ENG6600: Advanced Machine Learning
TOPIC #3, Optimization and Machine Learning

Lecture Notes:

Optimization Techniques (Gradient Descent) and Machine Learning "Part I", (PPT)

Optimization Techniques (Gradient Descent) and Machine Learning "Part I", (PDF)

Optimization Techniques (Gradient Descent) and Machine Learning "Part I", (mp4)

Optimization Techniques (Gradient Descent Example) and Machine Learning "Part II", (PPT)

Optimization Techniques (Gradient Descent Example) and Machine Learning "Part II", (PDF)

Optimization Techniques (Gradient Descent Example) and Machine Learning "Part II", (mp4)

Papers:

Optimization for Machine Learning I

Gradient Descent Explained

Why Optimization is Important for Machine Learning