ND Optimizer Arena · Fractal Basins & Orthogonal Spikes
Procedural loss field • clipped noisy grads • log-spectrum colouring • live 2–15D slices
Click to set start • slice updates with other dims.
Playback
▶︎ Play
Step
Reset
Regenerate
Optimizer
SGD
Momentum
RMSProp
Adam
AdamW
Muon
Learning rate
Eff:
0.20
Batch size
16
LR schedule
Constant
Step decay
Cosine
Exponential
Warmup + Cosine
Step size k:
40
Gamma:
0.5
Min factor:
0.1
Gamma:
0.995
Warmup frac:
0.10
Min factor:
0.1
Dimensions
n_dimensions
2D
Info
Steps:
0
/
640
Grad clip:
6.0
| h:
1e-3
All Time Best Loss:
--
Cur. Best Loss:
--
Cur. Loss:
--
Loss curve
Click to Set Starting Point