## General --- - [[Gradient Descent]] - [[Momentum Optimizer]] - [[RMSprop Optimizer]] - [[Adam Optimizer]] ## Learning Rate --- - [[Exponentially Weighted Averages]] - [[Learning Rate Decay]]