Sigmoid

Now the activation function will start to get interesting. The main objective of a sigmoid is to keep the output data between 0 and 1. The equation of this function is:

$f\left(x\right)=\frac{1}{1+e^{-x}}$

1class SigmoidActivation():
2    def forward(X):
3        return 1/(1+np.e**(-X))