Techniqueintro
Learning rate schedule
Also called cosine annealing, learning rate decay, step decay, warm-up, warmup.
Varies the step size over training, including warmup, step decay and cosine annealing.
Varies the step size over training, including warmup, step decay and cosine annealing.
About this page
The build computes these levels from the evidence in the repository. Each row says what the next level needs. Read what the levels mean.
| Ladder | Level | What the next level needs |
|---|---|---|
| Human proof | H0 no proof |
|
| Lean | L0 no Lean part |
|
| Visual | V0 none |
|
| Writing | W0 stub |
|
Tag 2F4BBA Edit this page History Report an error