Zahri-Edu › Math-University › Mathematics for Machine Learning & AI

AI 121

Probability & Statistics for Machine Learning

Maximum likelihood, Bayesian inference, the bias–variance trade-off, Gaussian models, information theory (entropy, KL divergence) and sampling.

In preparation

The lecture notes for this course are being written. Below is the planned table of contents; chapters will be published one by one.

Table of contents

5 chapters · 15 sections

1

Probability Review

  1. 1.1Random variables
  2. 1.2Joint distributions
  3. 1.3Gaussian distribution
2

Estimation

  1. 2.1Maximum likelihood
  2. 2.2Bayesian inference
  3. 2.3MAP estimation
3

Model Assessment

  1. 3.1Bias–variance decomposition
  2. 3.2Cross-validation
4

Information Theory

  1. 4.1Entropy
  2. 4.2Cross-entropy loss
  3. 4.3KL divergence
  4. 4.4Mutual information
5

Probabilistic Models

  1. 5.1Naive Bayes
  2. 5.2Gaussian mixtures and EM
  3. 5.3Sampling and Monte Carlo