Activation functions for neural network layers. Activation functions perform final calculation of layer's outputs, and it determines the type of transformation performed by the layers.
Interface Summary Interface Description ActivationFunctionCommon base interface for all activation functions used in layers.
Class Summary Class Description LeakyReluLeaky Rectified Linear Activation and its Derivative. LinearLinear activation function and its derivative y = x y' = 1 MathFunctionsMisc math utility functions. ReluRectified Linear Activation and its Derivative. SigmoidSigmoid activation function TanhHyperbolic tangens activation function
Enum Summary Enum Description ActivationTypeSupported types of activation functions.