Table of contents
5 chapters · 12 sections
Functions of Several Variables
- 1.1Partial derivatives
- 1.2Gradient and directional derivatives
Jacobians & Hessians
- 2.1Jacobian matrix
- 2.2Hessian and curvature
- 2.3Taylor expansion in several variables
The Chain Rule
- 3.1Multivariable chain rule
- 3.2Computational graphs
Automatic Differentiation
- 4.1Forward mode
- 4.2Reverse mode (backpropagation)
Optimality
- 5.1Critical points
- 5.2Convex functions
- 5.3Constrained optimisation and Lagrange multipliers