PKU Class 2026 Fall: Optimization for Deep Learning
Instructor: Kun Yuan (kunyuan@pku.edu.cn)
Teaching assistants:
- Shuchen Zhu (shuchenzhu@stu.pku.edu.cn) Lead TA
- Ming Sun (2401111521@stu.pku.edu.cn)
- Feiyue Ye (2501111527@stu.pku.edu.cn)
Classroom: 3pm - 6pm Tuesday, 三教203
Office hour: 2pm - 3pm Tuesday, 静园六院220
References
Martin Jaggi and Nicolas Flammarion, Optimization for Machine Learning, EPFL Class CS-439
Chris De Sa, Advanced Machine Learning Systems, Cornell CS6787
Zaiwen Wen, Optimization Methods, PKU 2024 Fall
Kun Yuan, Introduction to LLM, PKU 2025 Spring
Materials
Lecture 1: Introduction
- Part I: Introduction to Deep Learning [Slides]
- Part II: Introduction to LLM [Slides]
Lecture 2: Linear Algebra
- Part I: Gradient and Hessian [Notes]
- Part II: Linear Transform; Eigenvalue and Eigenvector; Jacobian matrix; Chain Rule [Notes]