public final class MLCActivationType
extends java.lang.Object
An activation type that you specify for an activation descriptor.
| Modifier and Type | Field and Description |
|---|---|
static int |
Absolute
The absolute activation type.
|
static int |
CELU
The CELU activation type.
|
static int |
Clamp
The clamp activation type.
|
static int |
Count
Must be last
|
static int |
ELU
The parametric ELU activation type.
|
static int |
GELU
The GELU activation type.
|
static int |
HardShrink
The hard shrink activation type.
|
static int |
HardSigmoid
The hard sigmoid activation type.
|
static int |
HardSwish
The hardswish activation type.
|
static int |
Linear
The linear activation type.
|
static int |
LogSigmoid
The log sigmoid activation type.
|
static int |
None
The identity activation type.
|
static int |
ReLU
The ReLU activation type.
|
static int |
ReLUN
The ReLUN activation type.
|
static int |
SELU
The SELU activation type.
|
static int |
Sigmoid
The sigmoid activation type.
|
static int |
SoftPlus
The parametric soft plus activation type.
|
static int |
SoftShrink
The soft shrink activation type.
|
static int |
SoftSign
The parametric soft sign activation type.
|
static int |
Tanh
The hyperbolic tangent (TanH) activation type.
|
static int |
TanhShrink
The hyperbolic tangent (TanH) shrink activation type.
|
static int |
Threshold
The threshold activation type.
|
public static final int None
public static final int ReLU
This activation type implements the following function: \code f(x) = x >= 0 ? x : a * x \endcode
public static final int Linear
This activation type implements the following function: \code f(x) = a * x + b \endcode
public static final int Sigmoid
This activation type implements the following function: \code f(x) = 1 / (1 + e⁻ˣ) \endcode
public static final int HardSigmoid
This activation type implements the following function: \code f(x) = clamp((x * a) + b, 0, 1) \endcode
public static final int Tanh
This activation type implements the following function: \code f(x) = a * tanh(b * x) \endcode
public static final int Absolute
This activation type implements the following function: \code f(x) = fabs(x) \endcode
public static final int SoftPlus
This activation type implements the following function: \code f(x) = a * log(1 + e^(b * x)) \endcode
public static final int SoftSign
This activation type implements the following function: \code f(x) = x / (1 + abs(x)) \endcod
public static final int ELU
This activation type implements the following function: \code f(x) = x >= 0 ? x : a * (exp(x) - 1) \endcode
public static final int ReLUN
This activation type implements the following function: \code f(x) = min((x >= 0 ? x : a * x), b) \endcode
public static final int LogSigmoid
This activation type implements the following function: \code f(x) = log(1 / (1 + exp(-x))) \endcode
public static final int SELU
This activation type implements the following function: \code f(x) = scale * (max(0, x) + min(0, α * (exp(x) − 1))) \endcode where: \code α = 1.6732632423543772848170429916717 scale = 1.0507009873554804934193349852946 \endcode
public static final int CELU
This activation type implements the following function: \code f(x) = max(0, x) + min(0, a * (exp(x / a) − 1)) \endcode
public static final int HardShrink
This activation type implements the following function: \code f(x) = x, if x > a or x < −a, else 0 \endcode
public static final int SoftShrink
This activation type implements the following function: \code f(x) = x - a, if x > a, x + a, if x < −a, else 0 \endcode
public static final int TanhShrink
This activation type implements the following function: \code f(x) = x - tanh(x) \endcode
public static final int Threshold
This activation type implements the following function: \code f(x) = x, if x > a, else b \endcode
public static final int GELU
This activation type implements the following function: \code f(x) = x * CDF(x) \endcode
public static final int HardSwish
This activation type implements the following function: \code f(x) = 0, if x <= -3 f(x) = x, if x >= +3 f(x) = x * (x + 3)/6, otherwise \endcode
public static final int Clamp
This activation type implements the following function: \code f(x) = min(max(x, a), b) \endcode
public static final int Count