Rosetta Stone · 25 of 30
Exponential
Function
In plain English
Repeated multiplication by e ≈ 2.718, extended smoothly to any x. is the function whose growth rate equals its current value, so anything that grows (or decays) in proportion to its size follows it. decays. Exponentials turn sums into products (), are always positive, and are the inverse of the natural log. In ML, is what softmax uses to turn arbitrary scores into positive weights.
As code
Math.exp(1); // 2.718…
Math.exp(-2); // 0.135… (decay)
// softmax numerator: every score becomes a positive weight
[2, 1, -1].map(Math.exp);See it
What it means, field by field
Inverse of ln; e^{iθ} links exponentials to rotation (Euler’s formula).
Radioactive decay N₀e^{−λt}; Boltzmann factor e^{−E/k_BT}; damping.
Unconstrained population growth N₀e^{rt}; drug clearance.
Softmax, attention weights, the sigmoid, and learning-rate decay schedules.
In a research paper
Each unit of time multiplies the population by the same factor e^r.
Common misreadings
Calling any fast growth "exponential". Polynomial and power-law growth are different and can look similar over short ranges.
Assuming exponential trends continue indefinitely. Real systems saturate (logistic curves).