Activation Playground

Compare old and newer nonlinearities on the same axes. Move one input point and watch how the output and local slope change for each function.