All Courses
4 lessons

PyTorch

Swap NumPy for autograd and GPUs

Lessons

  1. 01

    PyTorch Basics

    Tensors, autograd, modules — the mental model.

    Easy
  2. 02

    Layer Normalization

    Per-sample normalization for transformers.

    Medium
  3. 03

    Batch Normalization

    The CNN-era normalization trick, fully unpacked.

    Medium
  4. 04

    RMS Normalization

    LayerNorm without mean subtraction — why it works.

    Medium