- derivative of $log(x)$ is $\frac{1}{x}$ - derivative of $\sigma(x) = \frac{1}{1 + e^{-x}}$ is $\sigma(x) (1 - \sigma(x))$