org.bytedeco.tensorrt.global

Enum nvinfer.RNNOperation

java.lang.Object

java.lang.Enum<nvinfer.RNNOperation>

org.bytedeco.tensorrt.global.nvinfer.RNNOperation

All Implemented Interfaces:

Serializable, Comparable<nvinfer.RNNOperation>

Enclosing class:

nvinfer

@Namespace(value="nvinfer1")
public static enum nvinfer.RNNOperation
extends Enum<nvinfer.RNNOperation>

\enum RNNOperation \brief Enumerates the RNN operations that may be performed by an RNN layer. __Equation definitions__ The equations below have the following naming convention: ~~~ t := current time step i := input gate o := output gate f := forget gate z := update gate r := reset gate c := cell gate h := hidden gate g[t] denotes the output of gate g at timestep t, e.g. f[t] is the output of the forget gate f. X[t] := input tensor for timestep t C[t] := cell state for timestep t H[t] := hidden state for timestep t W[g] := W (input) parameter weight matrix for gate g R[g] := U (recurrent) parameter weight matrix for gate g Wb[g] := W (input) parameter bias vector for gate g Rb[g] := U (recurrent) parameter bias vector for gate g Unless otherwise specified, all operations apply pointwise to elements of each operand tensor. ReLU(X) := max(X, 0) tanh(X) := hyperbolic tangent of X sigmoid(X) := 1 / (1 + exp(-X)) exp(X) := e^X A.B denotes matrix multiplication of A and B. A*B denotes pointwise multiplication of A and B. ~~~ __Equations__ Depending on the value of RNNOperation chosen, each sub-layer of the RNN layer will perform one of the following operations: ~~~ ::kRELU H[t] := ReLU(W[i].X[t] + R[i].H[t-1] + Wb[i] + Rb[i]) ::kTANH H[t] := tanh(W[i].X[t] + R[i].H[t-1] + Wb[i] + Rb[i]) ::kLSTM i[t] := sigmoid(W[i].X[t] + R[i].H[t-1] + Wb[i] + Rb[i]) f[t] := sigmoid(W[f].X[t] + R[f].H[t-1] + Wb[f] + Rb[f]) o[t] := sigmoid(W[o].X[t] + R[o].H[t-1] + Wb[o] + Rb[o]) c[t] := tanh(W[c].X[t] + R[c].H[t-1] + Wb[c] + Rb[c]) C[t] := f[t]*C[t-1] + i[t]*c[t] H[t] := o[t]*tanh(C[t]) ::kGRU z[t] := sigmoid(W[z].X[t] + R[z].H[t-1] + Wb[z] + Rb[z]) r[t] := sigmoid(W[r].X[t] + R[r].H[t-1] + Wb[r] + Rb[r]) h[t] := tanh(W[h].X[t] + r[t]*(R[h].H[t-1] + Rb[h]) + Wb[h]) H[t] := (1 - z[t])*h[t] + z[t]*H[t-1] ~~~

See Also:

IRNNv2Layer

Enum Constant Summary

Enum Constants

Enum Constant and Description
kGRU Three-gate network consisting of Gated Recurrent Units.
kLSTM Four-gate LSTM network w/o peephole connections.
kRELU Single gate RNN w/ ReLU activation function.
kTANH Single gate RNN w/ TANH activation function.

Field Summary

Fields

Modifier and Type	Field and Description
int	value

Method Summary

Modifier and Type	Method and Description
nvinfer.RNNOperation	intern()
String	toString()
static nvinfer.RNNOperation	valueOf(String name) Returns the enum constant of this type with the specified name.
static nvinfer.RNNOperation[]	values() Returns an array containing the constants of this enum type, in the order they are declared.

Methods inherited from class java.lang.Enum

clone, compareTo, equals, finalize, getDeclaringClass, hashCode, name, ordinal, valueOf

Methods inherited from class java.lang.Object

getClass, notify, notifyAll, wait, wait, wait

Enum Constant Detail

kRELU

public static final nvinfer.RNNOperation kRELU

Single gate RNN w/ ReLU activation function.

kTANH

public static final nvinfer.RNNOperation kTANH

Single gate RNN w/ TANH activation function.

kLSTM

public static final nvinfer.RNNOperation kLSTM

Four-gate LSTM network w/o peephole connections.

kGRU

public static final nvinfer.RNNOperation kGRU

Three-gate network consisting of Gated Recurrent Units.

Field Detail

value

public final int value

Method Detail

values

public static nvinfer.RNNOperation[] values()

Returns an array containing the constants of this enum type, in the order they are declared. This method may be used to iterate over the constants as follows:

for (nvinfer.RNNOperation c : nvinfer.RNNOperation.values())
    System.out.println(c);

Returns:

an array containing the constants of this enum type, in the order they are declared

valueOf

public static nvinfer.RNNOperation valueOf(String name)

Returns the enum constant of this type with the specified name. The string must match exactly an identifier used to declare an enum constant in this type. (Extraneous whitespace characters are not permitted.)

Parameters:

name - the name of the enum constant to be returned.

Returns:

the enum constant with the specified name

Throws:

IllegalArgumentException - if this enum type has no constant with the specified name

NullPointerException - if the argument is null

intern

public nvinfer.RNNOperation intern()

toString

public String toString()

Overrides:

toString in class Enum<nvinfer.RNNOperation>