Skip to contentScience, DecodedContext Jamming
Scaling Laws for Neural Language Models
Jared Kaplan, Sam McCandlish, Tom Henighan, Tom B. Brown, Benjamin Chess, Rewon Child, Scott Gray, Alec Radford, Jeffrey Wu, Dario Amodei · 2020
Why this paper
It is the paper behind "scaling laws", and its central equations are a single power law you can read with Module 1. It is also a physicist’s paper: it hunts for the few variables that govern behaviour and then fits simple laws to them.
Pass 1 of 8
Research question
What question is the paper trying to answer? Write it as one sentence ending in a question mark.
Where to look: Abstract and the opening of the Introduction
Your read