Gradient Descent Golf

Six holes on real loss surfaces, dealt fresh every day. Your clubs are optimisers: SGD, Momentum, Nesterov, RMSProp and Adam. Pick one, tune its learning rate, and the ball takes real gradient-descent steps across the terrain. Then watch four tuned rival optimisers race the same shot.

← LabLab blogHome