Recurrent Neural Networks

miopenRNNMode_t

enum miopenRNNMode_t

RNN mode selection for rnn layer preference

Values:

miopenRNNRELU = 0

RNN with ReLU activation

miopenRNNTANH = 1

RNN with tanh activation

miopenLSTM = 2

LSTM

miopenGRU = 3

GRU

miopenRNNInputMode_t

enum miopenRNNInputMode_t

Recurrent Neural Network layer initial input mode

Values:

miopenRNNlinear = 0

Matrix multiplication at the input of the first layer

miopenRNNskip = 1

No operation is performed at the input of the first layer.

miopenRNNAlgo_t

enum miopenRNNAlgo_t

Recurrent Neural Network algorithm mode

Values:

miopenRNNdefault = 0

Supported

miopenRNNDirectionMode_t

enum miopenRNNDirectionMode_t

Recurrent Neural Network bi-directional behavior

Values:

miopenRNNunidirection = 0

Forward in time only.

miopenRNNbidirection = 1

Forward and backwards in time.

miopenRNNBiasMode_t

enum miopenRNNBiasMode_t

Recurrent Neural Network add on bias

Values:

miopenRNNNoBias = 0

No Biases will be applied to GEMM operations

miopenRNNwithBias = 1

Biases will be applied to GEMM operations

miopenRNNGEMMalgoMode_t

enum miopenRNNGEMMalgoMode_t

Recurrent Neural Network add on bias

Values:

miopenRNNAlgoGEMM = 0

miopenCreateRNNDescriptor

miopenStatus_t miopenCreateRNNDescriptor(miopenRNNDescriptor_t *rnnDesc)

Create a RNN layer Descriptor.

API for creating an uninitialized RNN layer descriptor.

Return
miopenStatus_t
Parameters
  • rnnDesc: Pointer to a tensor descriptor type

miopenGetRNNDescriptor

miopenStatus_t miopenGetRNNDescriptor(miopenRNNDescriptor_t rnnDesc, miopenRNNMode_t *rnnMode, miopenRNNAlgo_t *algoMode, miopenRNNInputMode_t *inputMode, miopenRNNDirectionMode_t *dirMode, miopenRNNBiasMode_t *biasMode, int *hiddenSize, int *layer)

Retrieves a RNN layer descriptor’s details.

Return
miopenStatus_t
Parameters
  • rnnDesc: RNN layer descriptor (input)
  • rnnMode: RNN mode (output)
  • algoMode: RNN algorithm mode (output)
  • inputMode: RNN data input mode (output)
  • dirMode: Uni or bi direction mode (output)
  • biasMode: Bias used (output)
  • hiddenSize: Size of hidden state (output)
  • layer: Number of stacked layers (output)

miopenDestroyRNNDescriptor

miopenStatus_t miopenDestroyRNNDescriptor(miopenRNNDescriptor_t rnnDesc)

Destroys the tensor descriptor object.

Return
miopenStatus_t
Parameters
  • rnnDesc: RNN tensor descriptor type (input)

miopenSetRNNDescriptor

miopenStatus_t miopenSetRNNDescriptor(miopenRNNDescriptor_t rnnDesc, const int hsize, const int nlayers, miopenRNNInputMode_t inMode, miopenRNNDirectionMode_t direction, miopenRNNMode_t rnnMode, miopenRNNBiasMode_t biasMode, miopenRNNAlgo_t algo, miopenDataType_t dataType)

Set the details of the RNN descriptor.

Interface for setting the values of the RNN descriptor object. This function requires specific algorithm selection.

Return
miopenStatus_t
Parameters
  • rnnDesc: RNN layer descriptor type (input)
  • hsize: Hidden layer size (input)
  • nlayers: Number of layers (input)
  • inMode: RNN first layer input mode (input)
  • direction: RNN direction (input)
  • rnnMode: RNN model type (input)
  • biasMode: RNN bias included (input)
  • algo: RNN algorithm selected (input)
  • dataType: Only fp32 currently supported for RNNs (input)

miopenGetRNNWorkspaceSize

miopenStatus_t miopenGetRNNWorkspaceSize(miopenHandle_t handle, const miopenRNNDescriptor_t rnnDesc, const int sequenceLen, const miopenTensorDescriptor_t *xDesc, size_t *numBytes)

Query the amount of memory required to execute the RNN layer.

This function calculates the amount of memory required to run the RNN layer given an RNN descriptor and a tensor descriptor.

Return
miopenStatus_t
Parameters
  • handle: MIOpen handle (input)
  • rnnDesc: RNN layer descriptor type (input)
  • sequenceLen: Number of iteration unrolls (input)
  • xDesc: An array of tensor descriptors. These are the input descriptors to each time step. The first dimension of each descriptor is the batch size and may decrease from element n to element n+1 and not increase in size. The second dimension is the same for all descriptors in the array and is the input vector length. (input)
  • numBytes: Number of bytes required for RNN layer execution (output)

miopenGetRNNTrainingReserveSize

miopenStatus_t miopenGetRNNTrainingReserveSize(miopenHandle_t handle, miopenRNNDescriptor_t rnnDesc, const int sequenceLen, const miopenTensorDescriptor_t *xDesc, size_t *numBytes)

Query the amount of memory required for RNN training.

This function calculates the amount of memory required to train the RNN layer given an RNN descriptor and a tensor descriptor.

Return
miopenStatus_t
Parameters
  • handle: MIOpen handle (input)
  • rnnDesc: RNN layer descriptor type (input)
  • sequenceLen: Number of iteration unrolls (input)
  • xDesc: An array of tensor descriptors. These are the input descriptors to each time step. The first dimension of each descriptor is the batch size and may decrease from element n to element n+1 and not increase in size. The second dimension is the same for all descriptors in the array and is the input vector length. (input)
  • numBytes: Number of bytes required for RNN layer execution (output)

miopenGetRNNParamsSize

miopenStatus_t miopenGetRNNParamsSize(miopenHandle_t handle, miopenRNNDescriptor_t rnnDesc, miopenTensorDescriptor_t xDesc, size_t *numBytes, miopenDataType_t dtype)

Query the amount of parameter memory required for RNN training.

This function calculates the amount of parameter memory required to train the RNN layer given an RNN descriptor and a tensor descriptor.

Return
miopenStatus_t
Parameters
  • handle: MIOpen handle (input)
  • rnnDesc: RNN layer descriptor type (input)
  • xDesc: A tensor descriptor (input)
  • numBytes: Number of bytes required for RNN layer execution (output)
  • dtype: MIOpen data type enum (input)

miopenGetRNNParamsDescriptor

miopenStatus_t miopenGetRNNParamsDescriptor(miopenHandle_t handle, miopenRNNDescriptor_t rnnDesc, miopenTensorDescriptor_t xDesc, miopenTensorDescriptor_t wDesc, miopenDataType_t dtype)

Obtain a weight tensor descriptor for RNNs.

This function populates a weight descriptor that describes the memory layout of the weight matrix.

Return
miopenStatus_t
Parameters
  • handle: MIOpen handle (input)
  • rnnDesc: Fully populated RNN layer descriptor type (input)
  • xDesc: A previously populated tensor descriptor (input)
  • wDesc: A previously allocated tensor descriptor (output)
  • dtype: MIOpen data type enum, currently only fp32 is supported (input)

miopenGetRNNInputTensorSize

miopenStatus_t miopenGetRNNInputTensorSize(miopenHandle_t handle, miopenRNNDescriptor_t rnnDesc, const int seqLen, miopenTensorDescriptor_t *xDesc, size_t *numBytes)

Obtain a the size in bytes of the RNN input tensor.

This function determines the size in bytes of the allocation needed for the input data tensor for an RNN layer. The number of bytes is derived from the array of tensor descriptors.

Return
miopenStatus_t
Parameters
  • handle: MIOpen handle (input)
  • rnnDesc: Fully populated RNN layer descriptor (input)
  • seqLen: Number of iteration unrolls (input)
  • xDesc: An array of tensor descriptors. These are the input descriptors to each time step. The first dimension of each descriptor is the batch size and may decrease from element n to element n+1 and not increase in size. The second dimension is the same for all descriptors in the array and is the input vector length. (input)
  • numBytes: Number of bytes required for input tensor (output)

miopenGetRNNHiddenTensorSize

miopenStatus_t miopenGetRNNHiddenTensorSize(miopenHandle_t handle, miopenRNNDescriptor_t rnnDesc, const int seqLen, miopenTensorDescriptor_t *xDesc, size_t *numBytes)

Obtain a the size in bytes of the RNN hidden tensor.

This function determines the size in bytes of the allocation needed for the hidden tensor over all layers

Return
miopenStatus_t
Parameters
  • handle: MIOpen handle (input)
  • rnnDesc: Fully populated RNN layer descriptor type (input)
  • seqLen: Number of iteration unrolls (input)
  • xDesc: An array of previously populated tensor descriptors (input)
  • numBytes: Number of bytes required for input tensor (output)

miopenGetRNNLayerParamSize

miopenStatus_t miopenGetRNNLayerParamSize(miopenHandle_t handle, miopenRNNDescriptor_t rnnDesc, const int layer, miopenTensorDescriptor_t xDesc, const int paramID, size_t *numBytes)

Gets the number of bytes of a parameter matrix.

For RNN vanilla miopenRNNRELU and miopenRNNTANH, paramID == 0 retrieves the weight matrix associated with the in input GEMM, while paramID == 1 retrieves the weight matrix associated with the hidden state GEMM.

For miopenLSTM paramID 0 to 3 refer to the weight matrices associated with the input GEMM, 4-7 are associated with matrices associated with the hidden state GEMM.

  • paramID 0 and 4 are for the input gate.
  • paramID 1 and 5 are for the forget gate.
  • paramID 2 and 6 are for the output gate.
  • paramID 3 and 7 are for the new memory gate.

For miopenGRU paramID 0 to 2 refer to the weight matrix offset associated with the input GEMM, while 3 through 5 are associated with the hidden state GEMM.

  • paramID 0 and 3 are for the update gate.
  • paramID 1 and 4 are for the reset gate.
  • paramID 2 and 5 are for the new memory gate.

For bi-directional RNNs the backwards in time direction is numbered as the layer directly after the forward in time direction.

Return
miopenStatus_t
Parameters
  • handle: MIOpen handle (input)
  • rnnDesc: RNN layer descriptor type (input)
  • layer: The layer number in the RNN stack (input)
  • xDesc: A tensor descriptor to input (input)
  • paramID: ID of the internal parameter tensor (input)
  • numBytes: The number of bytes of the layer’s parameter matrix (output)

miopenGetRNNLayerBiasSize

miopenStatus_t miopenGetRNNLayerBiasSize(miopenHandle_t handle, miopenRNNDescriptor_t rnnDesc, const int layer, const int biasID, size_t *numBytes)

Gets the number of bytes of a bias.

For RNN vanilla miopenRNNRELU and miopenRNNTANH, biasID == 0 retrieves the weight matrix associated with the in input GEMM, while biasID == 1 retrieves the bias associated with the hidden state GEMM.

For miopenLSTM biasID 0 to 3 refer to the biases associated with the input GEMM, 4-7 are associated with biases associated with the hidden state GEMM.

  • biasID 0 and 4 are for the input gate.
  • biasID 1 and 5 are for the forget gate.
  • biasID 2 and 6 are for the output gate.
  • biasID 3 and 7 are for the new memory gate.

For miopenGRU biasID 0 to 2 refer to the biases associated with the input GEMM, while 3 through 5 are associated with the hidden state GEMM.

  • biasID 0 and 3 are for the update gate.
  • biasID 1 and 4 are for the reset gate.
  • biasID 2 and 5 are for the new memory gate.

For bi-directional RNNs the backwards in time direction is numbered as the layer directly after the forward in time direction.

Return
miopenStatus_t
Parameters
  • handle: MIOpen handle (input)
  • rnnDesc: RNN layer descriptor type (input)
  • layer: The layer number in the RNN stack (input)
  • biasID: ID of the internal parameter tensor (input)
  • numBytes: The number of bytes of the layer’s bias (output)

miopenGetRNNLayerParam

miopenStatus_t miopenGetRNNLayerParam(miopenHandle_t handle, miopenRNNDescriptor_t rnnDesc, const int layer, miopenTensorDescriptor_t xDesc, miopenTensorDescriptor_t wDesc, const void *w, const int paramID, miopenTensorDescriptor_t paramDesc, void *layerParam)

Gets a weight matrix for a specific layer in an RNN stack.

This function retrieves the weight matrix data for a specific layer and parameter ID and copies the data into previously allocated device memory.

For RNN vanilla miopenRNNRELU and miopenRNNTANH, paramID == 0 retrieves the weight matrix associated with the in input GEMM, while paramID == 1 retrieves the weight matrix associated with the hidden state GEMM.

For miopenLSTM paramID 0 to 3 refer to the weight matrices associated with the input GEMM, 4-7 are associated with matrices associated with the hidden state GEMM.

  • paramID 0 and 4 are for the input gate.
  • paramID 1 and 5 are for the forget gate.
  • paramID 2 and 6 are for the output gate.
  • paramID 3 and 7 are for the new memory gate.

For miopenGRU paramID 0 to 2 refer to the weight matrix offset associated with the input GEMM, while 3 through 5 are associated with the hidden state GEMM.

  • paramID 0 and 3 are for the update gate.
  • paramID 1 and 4 are for the reset gate.
  • paramID 2 and 5 are for the new memory gate.

For bi-directional RNNs the backwards in time direction is numbered as the layer directly after the forward in time direction.

The output argument paramDesc is a previously created tensor descriptor that is populated to describe the memory layout of the parameter matrix. It is full packed and is used when calling to miopenSetRNNLayerParam()

The argument layerParam should either be nullptr, or have device memory allocated to allow copying of the entire layer parameter matrix into it. If layerParam is nullptr then only the paramDesc is populated and returned. The size in bytes of the layer parameter matrix can be determined by using miopenGetRNNLayerParamSize().

Note: When inputSkip mode is selected there is no input layer matrix operation, and therefore no associated memory. In this case miopenGetRNNLayerParam() will return a error status miopenStatusBadParm for input paramID associated with the input GEMM.

Return
miopenStatus_t
Parameters
  • handle: MIOpen handle (input)
  • rnnDesc: RNN layer descriptor type (input)
  • layer: The layer number in the RNN stack (input)
  • xDesc: A tensor descriptor to input (input)
  • wDesc: A tensor descriptor to the parameter tensor (input)
  • w: Pointer to memory containing parameter tensor (input)
  • paramID: ID of the internal parameter tensor (input)
  • paramDesc: Tensor descriptor for the fully packed output parameter tensor (output)
  • layerParam: Pointer to the memory location of the parameter tensor (output)

miopenGetRNNLayerBias

miopenStatus_t miopenGetRNNLayerBias(miopenHandle_t handle, miopenRNNDescriptor_t rnnDesc, const int layer, miopenTensorDescriptor_t xDesc, miopenTensorDescriptor_t wDesc, const void *w, const int biasID, miopenTensorDescriptor_t biasDesc, void *layerBias)

Gets a bias for a specific layer in an RNN stack.

This function retrieves the bias data for a specific layer and bias ID and copies the data into previously allocated device memory.

For RNN vanilla miopenRNNRELU and miopenRNNTANH, biasID == 0 retrieves the bias associated with the in input GEMM, while biasID == 1 retrieves the bias associated with the hidden state GEMM.

For miopenLSTM biasID 0 to 3 refer to the biases associated with the input GEMM, 4-7 are associated with biases associated with the hidden state GEMM.

  • biasID 0 and 4 are for the input gate.
  • biasID 1 and 5 are for the forget gate.
  • biasID 2 and 6 are for the output gate.
  • biasID 3 and 7 are for the new memory gate.

For miopenGRU biasID 0 to 2 refer to the biases associated with the input GEMM, while 3 through 5 are associated with the hidden state GEMM.

  • biasID 0 and 3 are for the update gate.
  • biasID 1 and 4 are for the reset gate.
  • biasID 2 and 5 are for the new memory gate.

For bi-directional RNNs the backwards in time direction is numbered as the layer directly after the forward in time direction.

The output argument biasDesc is a previously created tensor descriptor that is populated to describe the memory layout of the bias. It is full packed and is used when calling to miopenSetRNNLayerBias()

The argument layerBias should either be nullptr, or have device memory allocated to allow copying of the entire layer bias into it. If layerBias is nullptr then only the biasDesc is populated and returned. The size in bytes of the layer bias can be determined by using miopenGetRNNLayerBiasSize().

Note: When inputSkip mode is selected there is no input layer matrix operation, and therefore no associated memory. In this case miopenGetRNNLayerBias() will return a error status miopenStatusBadParm for input biasID associated with the input GEMM.

Return
miopenStatus_t
Parameters
  • handle: MIOpen handle (input)
  • rnnDesc: RNN layer descriptor type (input)
  • layer: The layer number in the RNN stack (input)
  • xDesc: A tensor descriptor to input (input)
  • wDesc: A tensor descriptor to the parameter tensor (input)
  • w: Pointer to memory containing parameter tensor (input)
  • biasID: ID of the internal parameter tensor (input)
  • biasDesc: Descriptor of the parameter tensor (output)
  • layerBias: Pointer to the memory location of the bias tensor (output)

miopenSetRNNLayerParam

miopenStatus_t miopenSetRNNLayerParam(miopenHandle_t handle, miopenRNNDescriptor_t rnnDesc, const int layer, miopenTensorDescriptor_t xDesc, miopenTensorDescriptor_t wDesc, void *w, const int paramID, miopenTensorDescriptor_t paramDesc, const void *layerParam)

Sets a weight matrix for a specific layer in an RNN stack.

This function sets the weight matrix data for a specific layer and parameter ID.

For RNN vanilla miopenRNNRELU and miopenRNNTANH, paramID == 0 sets the weight matrix associated with the in input GEMM, while paramID == 1 sets the weight matrix associated with the hidden state GEMM.

For miopenLSTM paramID 0 to 3 refer to the weight matrices associated with the input GEMM, 4-7 are associated with matrices associated with the hidden state GEMM.

  • paramID 0 and 4 are for the input gate.
  • paramID 1 and 5 are for the forget gate.
  • paramID 2 and 6 are for the output gate.
  • paramID 3 and 7 are for the new memory gate.

For miopenGRU paramID 0 to 2 refer to the weight matrix offset associated with the input GEMM, while 3 through 5 are associated with the hidden state GEMM.

  • paramID 0 and 3 are for the update gate.
  • paramID 1 and 4 are for the reset gate.
  • paramID 2 and 5 are for the new memory gate.

For bi-directional RNNs the backwards in time direction is numbered as the layer directly after the forward in time direction.

The input argument paramDesc is a previously populated tensor descriptor typically by first calling miopenGetRNNLayerParam().

Note: When inputSkip mode is selected there is no input layer matrix operation, and therefore no associated memory. In this case miopenSetRNNLayerParam() will return a error status miopenStatusBadParm for input paramID associated with the input GEMM.

Return
miopenStatus_t
Parameters
  • handle: MIOpen handle (input)
  • rnnDesc: RNN layer descriptor type (input)
  • layer: The layer number in the RNN stack (input)
  • xDesc: A tensor descriptor to input (input)
  • wDesc: A tensor descriptor to the parameter tensor (input)
  • w: Pointer to memory containing parameter tensor (input)
  • paramID: ID of the internal parameter tensor (input)
  • paramDesc: Descriptor of the parameter tensor (input)
  • layerParam: Pointer to the memory location of the parameter tensor (input)

miopenSetRNNLayerBias

miopenStatus_t miopenSetRNNLayerBias(miopenHandle_t handle, miopenRNNDescriptor_t rnnDesc, const int layer, miopenTensorDescriptor_t xDesc, miopenTensorDescriptor_t wDesc, void *w, const int biasID, miopenTensorDescriptor_t biasDesc, const void *layerBias)

Sets a bias for a specific layer in an RNN stack.

This function sets the bias data for a specific layer and bias ID.

For RNN vanilla miopenRNNRELU and miopenRNNTANH, biasID == 0 retrieves the weight matrix associated with the in input GEMM, while biasID == 1 retrieves the bias associated with the hidden state GEMM.

For miopenLSTM biasID 0 to 3 refer to the biases associated with the input GEMM, 4-7 are associated with the biases associated with the hidden state GEMM.

  • biasID 0 and 4 are for the input gate.
  • biasID 1 and 5 are for the forget gate.
  • biasID 2 and 6 are for the output gate.
  • biasID 3 and 7 are for the new memory gate.

For miopenGRU biasID 0 to 2 refer to the biases associated with the input GEMM, while 3 through 5 are associated with the hidden state GEMM.

  • biasID 0 and 3 are for the update gate.
  • biasID 1 and 4 are for the reset gate.
  • biasID 2 and 5 are for the new new memory gate.

For bi-directional RNNs the backwards in time direction is numbered as the layer directly after the forward in time direction.

The input argument biasDesc is a previously populated tensor descriptor typically by first calling miopenGetRNNLayeBias().

Note: When inputSkip mode is selected there is no input layer matrix operation, and therefore no associated memory. In this case miopenSetRNNLayerBias will return a error status miopenStatusBadParm for input biasID associated with the input GEMM.

Return
miopenStatus_t
Parameters
  • handle: MIOpen handle (input)
  • rnnDesc: RNN layer descriptor type (input)
  • layer: The layer number in the RNN stack (input)
  • xDesc: A tensor descriptor to input (input)
  • wDesc: A tensor descriptor to the bias tensor (input)
  • w: Pointer to memory containing bias tensor (input)
  • biasID: ID of the internal bias tensor (input)
  • biasDesc: Descriptor of the bias tensor (output)
  • layerBias: Pointer to the memory location of the bias tensor (output)

miopenGetRNNLayerParamOffset

miopenStatus_t miopenGetRNNLayerParamOffset(miopenRNNDescriptor_t rnnDesc, const int layer, miopenTensorDescriptor_t xDesc, const int paramID, miopenTensorDescriptor_t paramDesc, size_t *layerParamOffset)

Gets an index offset for a specific weight matrix for a layer in the RNN stack.

This function retrieves the index offset for a weight matrix in a layer.

For RNN vanilla miopenRNNRELU and miopenRNNTANH, paramID == 0 retrieves the weight matrix offset associated with the in input GEMM, while paramID == 1 retrieves the weight matrix offset associated with the hidden state GEMM.

For miopenLSTM paramID 0 to 3 refer to the weight matrix offsets associated with the input GEMM, 4-7 are associated with matrix offset associated with the hidden state GEMM.

  • paramID 0 and 4 are for the input gate.
  • paramID 1 and 5 are for the forget gate.
  • paramID 2 and 6 are for the output gate.
  • paramID 3 and 7 are for the new memory gate.

For miopenGRU paramID 0 to 2 refer to the weight matrix offset associated with the input GEMM, while 3 through 5 are associated with the hidden state GEMM.

  • paramID 0 and 3 are for the update gate.
  • paramID 1 and 4 are for the reset gate.
  • paramID 2 and 5 are for the new memory gate.

For bi-directional RNNs the backwards in time direction is numbered as the layer directly after the forward in time direction.

The output argument paramDesc is a previously created tensor descriptor that is populated to describe the memory layout of the parameter matrix. It is full packed and is used when calling to miopenSetRNNLayerParam().

The argument layerParamOffset should either be nullptr, or an address to place the offset. If layerParamOffset is nullptr then only the paramDesc is populated and returned.

Note: When inputSkip mode is selected there is no input layer matrix operation, and therefore no associated memory. In this case miopenGetRNNLayerParamOffset() will return a error status miopenStatusBadParm for input paramID associated with the input GEMM.

Return
miopenStatus_t
Parameters
  • rnnDesc: RNN layer descriptor type (input)
  • layer: The layer number in the RNN stack (input)
  • xDesc: A tensor descriptor to input (input)
  • paramID: ID of the internal parameter tensor (input)
  • paramDesc: Tensor descriptor for the fully packed output parameter tensor (output)
  • layerParamOffset: Location for the parameter offset (output)

miopenGetRNNLayerBiasOffset

miopenStatus_t miopenGetRNNLayerBiasOffset(miopenRNNDescriptor_t rnnDesc, const int layer, miopenTensorDescriptor_t xDesc, const int biasID, miopenTensorDescriptor_t biasDesc, size_t *layerBiasOffset)

Gets a bias index offset for a specific layer in an RNN stack.

This function retrieves the bias index offset for a specific layer and bias ID.

For RNN vanilla miopenRNNRELU and miopenRNNTANH, biasID == 0 retrieves the bias associated with the in input GEMM, while biasID == 1 retrieves the weight matrix associated with the hidden state GEMM.

For miopenLSTM biasID 0 to 3 refer to the bias offset associated with the input GEMM, 4-7 are the bias offsets associated with the hidden state GEMM.

  • biasID 0 and 4 are for the input gate.
  • biasID 1 and 5 are for the forget gate.
  • biasID 2 and 6 are for the output gate.
  • biasID 3 and 7 are for the new memory gate.

For miopenGRU biasID 0 to 2 refer to the biases associated with the input GEMM, while 3 through 5 are associated with the hidden state GEMM.

  • biasID 0 and 3 are for the update gate.
  • biasID 1 and 4 are for the reset gate.
  • biasID 2 and 5 are for the new memory gate.

For bi-directional RNNs the backwards in time direction is numbered as the layer directly after the forward in time direction.

The output argument biasDesc is a previously created tensor descriptor that is populated to describe the memory layout of the bias. It is full packed and is used when calling to miopenSetRNNLayerBias()

The argument layerBiasOffset should either be nullptr, or point to an output address. If layerBias is nullptr then only the biasDesc is populated and returned.

Note: When inputSkip mode is selected there is no input layer matrix operation, and therefore no associated memory. In this case miopenGetRNNLayerBiasOffset() will return a error status miopenStatusBadParm for input biasID associated with the input GEMM.

Return
miopenStatus_t
Parameters
  • rnnDesc: RNN layer descriptor type (input)
  • layer: The layer number in the RNN stack (input)
  • xDesc: A tensor descriptor to input (input)
  • biasID: ID of the internal parameter tensor (input)
  • biasDesc: Descriptor of the parameter tensor (output)
  • layerBiasOffset: Pointer to the memory location of the bias tensor (output)

miopenRNNForwardTraining

miopenStatus_t miopenRNNForwardTraining(miopenHandle_t handle, const miopenRNNDescriptor_t rnnDesc, const int sequenceLen, const miopenTensorDescriptor_t *xDesc, const void *x, const miopenTensorDescriptor_t hxDesc, const void *hx, const miopenTensorDescriptor_t cxDesc, const void *cx, const miopenTensorDescriptor_t wDesc, const void *w, const miopenTensorDescriptor_t *yDesc, void *y, const miopenTensorDescriptor_t hyDesc, void *hy, const miopenTensorDescriptor_t cyDesc, void *cy, void *workSpace, size_t workSpaceNumBytes, void *reserveSpace, size_t reserveSpaceNumBytes)

Execute forward training for recurrent layer.

Interface for executing the forward training pass on a RNN.

Return
miopenStatus_t
Parameters
  • handle: MIOpen handle (input)
  • rnnDesc: RNN layer descriptor type (input)
  • sequenceLen: Temporal iterations to unroll (input)
  • xDesc: An array of tensor descriptors. These are the input descriptors to each time step. The first dimension of each descriptor is the batch size and may decrease from element n to element n+1 and not increase in size. The second dimension is the same for all descriptors in the array and is the input vector length. (input)
  • x: Pointer to input tensor (input)
  • hxDesc: A hidden tensor descriptor that has as its first dimension of the number of layers if the direction mode is unidirectional and twice the number of layers if the direction mode is bidirectional. The second dimension of the descriptor must equal the largest first dimension of the xDesc tensor descriptor array. The third dimension equals the hiddenSize. (input)
  • hx: Pointer to the hidden layer input tensor. If hx is NULL, then the initial hidden state will be zero initialized. (input)
  • cxDesc: A cell tensor descriptor that has as its first dimension of the number of layers if the direction mode is unidirectional and twice the number of layers if the direction mode is bidirectional. The second dimension of the descriptor must equal the largest first dimension of the xDesc tensor descriptor array. The third dimension equals the hiddenSize. (input)
  • cx: Pointer to the cell layer input tensor. If cx is NULL, then the initial cell state will be zero initialized. (input)
  • wDesc: A weights tensor descriptor (input)
  • w: Pointer to input weights tensor (input)
  • yDesc: An array of fully packed tensor descriptors associated with the output from each time step. The first dimension of the tensor descriptors must equal the first dimension of the first descriptor (batch size) in the xDesc tensor array. The second dimension of the element of the descriptor array depends on the direction mode selected. If the direction mode is unidirectional, the second dimension is the hiddenSize. If direction mode is bidirectional the second dimension is twice the hiddenSize. (input)
  • y: Pointer to output tensor (output)
  • hyDesc: A hidden tensor descriptor that has as its first dimension of the number of layers if the direction mode is unidirectional and twice the number of layers if the direction mode is bidirectional. The second dimension of the descriptor must equal the largest first dimension of the xDesc tensor descriptor array. The third dimension equals the hiddenSize. (input)
  • hy: Pointer to the hidden layer output tensor. If hy is NULL, then the final hidden state will not be saved. (output)
  • cyDesc: A cell tensor descriptor that has as its first dimension of the number of layers if the direction mode is unidirectional and twice the number of layers if the direction mode is bidirectional. The second dimension of the descriptor must equal the largest first dimension of the xDesc tensor descriptor array. The third dimension equals the hiddenSize. (input)
  • cy: Pointer to the cell layer output tensor. If hy is NULL, then the final cell state will not be saved. (output)
  • workSpace: Pointer to memory allocated for forward training (input)
  • workSpaceNumBytes: Number of allocated bytes in memory for the workspace (input)
  • reserveSpace: Pointer to memory allocated for random states (input / output)
  • reserveSpaceNumBytes: Number of allocated bytes in memory for use in the forward (input)

miopenRNNBackwardData

miopenStatus_t miopenRNNBackwardData(miopenHandle_t handle, const miopenRNNDescriptor_t rnnDesc, const int sequenceLen, const miopenTensorDescriptor_t *yDesc, const void *y, const miopenTensorDescriptor_t *dyDesc, const void *dy, const miopenTensorDescriptor_t dhyDesc, const void *dhy, const miopenTensorDescriptor_t dcyDesc, const void *dcy, const miopenTensorDescriptor_t wDesc, const void *w, const miopenTensorDescriptor_t hxDesc, const void *hx, const miopenTensorDescriptor_t cxDesc, const void *cx, const miopenTensorDescriptor_t *dxDesc, void *dx, const miopenTensorDescriptor_t dhxDesc, void *dhx, const miopenTensorDescriptor_t dcxDesc, void *dcx, void *workSpace, size_t workSpaceNumBytes, void *reserveSpace, size_t reserveSpaceNumBytes)

Execute forward training for recurrent layer.

Interface for executing the forward training pass on a RNN.

Return
miopenStatus_t
Parameters
  • handle: MIOpen handle (input)
  • rnnDesc: RNN layer descriptor type (input)
  • sequenceLen: Temporal iterations to unroll (input)
  • yDesc: An array of tensor descriptors (input)
  • y: Pointer to input tensor (input)
  • dyDesc: An array of fully packed tensor descriptors associated with the output from each time step. The first dimension of the tensor descriptors must equal the first dimension of the first descriptor (batch size) in the xDesc tensor array. The second dimension of the element of the descriptor array depends on the direction mode selected. If the direction mode is unidirectional, the second dimension is the hiddenSize. If direction mode is bidirectional the second dimension is twice the hiddenSize. (input)
  • dy: Pointer to the hidden layer input tensor (input)
  • dhyDesc: A hidden tensor descriptor that has as its first dimension of the number of layers if the direction mode is unidirectional and twice the number of layers if the direction mode is bidirectional. The second dimension of the descriptor must equal the largest first dimension of the xDesc tensor descriptor array. The third dimension equals the hiddenSize. (input)
  • dhy: Pointer to the cell layer input tensor (input)
  • dcyDesc: A cell tensor descriptor that has as its first dimension of the number of layers if the direction mode is unidirectional and twice the number of layers if the direction mode is bidirectional. The second dimension of the descriptor must equal the largest first dimension of the xDesc tensor descriptor array. The third dimension equals the hiddenSize. (input)
  • dcy: Pointer to the cell layer input tensor. If dcy is NULL, then the initial delta cell state will be zero initialized. (input)
  • wDesc: A weights tensor descriptor (input)
  • w: Pointer to input weights tensor (input)
  • hxDesc: An input hidden tensor descriptor that has as its first dimension of the number of layers if the direction mode is unidirectional and twice the number of layers if the direction mode is bidirectional. The second dimension of the descriptor must equal the largest first dimension of the xDesc tensor descriptor array. The third dimension equals the hiddenSize. (input)
  • hx: Pointer to the hidden layer input tensor. If hx is NULL, then the initial hidden state will be zero initialized. (input)
  • cxDesc: A input cell tensor descriptor that has as its first dimension of the number of layers if the direction mode is unidirectional and twice the number of layers if the direction mode is bidirectional. The second dimension of the descriptor must equal the largest first dimension of the xDesc tensor descriptor array. The third dimension equals the hiddenSize. (input)
  • cx: Pointer to the hidden layer input tensor. If cx is NULL, then the initial cell state will be zero initialized. (input)
  • dxDesc: An array of tensor descriptors. These are the input descriptors to each time step. The first dimension of each descriptor is the batch size and may decrease from element n to element n+1 and not increase in size. The second dimension is the same for all descriptors in the array and is the input vector length. (input)
  • dx: Pointer to the cell layer output tensor (output)
  • dhxDesc: A hidden tensor descriptor that has as its first dimension of the number of layers if the direction mode is unidirectional and twice the number of layers if the direction mode is bidirectional. The second dimension of the descriptor must equal the largest first dimension of the xDesc tensor descriptor array. The third dimension equals the hiddenSize. (input)
  • dhx: Pointer to the delta hidden layer output tensor. If dhx is NULL the hidden gradient will not ouput. (output)
  • dcxDesc: A tensor descriptor that has as its first dimension of the number of layers if the direction mode is unidirectional and twice the number of layers if the direction mode is bidirectional. The second dimension of the descriptor must equal the largest first dimension of the xDesc tensor descriptor array. The third dimension equals the hiddenSize. (input)
  • dcx: Pointer to the cell layer output tensor. If dcx is NULL the cell gradient will not ouput. (output)
  • workSpace: Pointer to memory allocated for forward training (input)
  • workSpaceNumBytes: Number of allocated bytes in memory for the workspace (input)
  • reserveSpace: Pointer to memory allocated for random states (input / output)
  • reserveSpaceNumBytes: Number of allocated bytes in memory for use in the forward (input)

miopenRNNBackwardWeights

miopenStatus_t miopenRNNBackwardWeights(miopenHandle_t handle, const miopenRNNDescriptor_t rnnDesc, const int sequenceLen, const miopenTensorDescriptor_t *xDesc, const void *x, const miopenTensorDescriptor_t hxDesc, const void *hx, const miopenTensorDescriptor_t *yDesc, const void *y, const miopenTensorDescriptor_t dwDesc, void *dw, void *workSpace, size_t workSpaceNumBytes, const void *reserveSpace, size_t reserveSpaceNumBytes)

Execute forward training for recurrent layer.

Interface for executing the forward training pass on a RNN.

Return
miopenStatus_t
Parameters
  • handle: MIOpen handle (input)
  • rnnDesc: RNN layer descriptor type (input)
  • sequenceLen: Temporal iterations to unroll (input)
  • xDesc: An array of tensor descriptors. These are the input descriptors to each time step. The first dimension of each descriptor is the batch size and may decrease from element n to element n+1 and not increase in size. The second dimension is the same for all descriptors in the array and is the input vector length. (input)
  • x: Pointer to input tensor (input)
  • hxDesc: A hidden tensor descriptor that has as its first dimension of the number of layers if the direction mode is unidirectional and twice the number of layers if the direction mode is bidirectional. The second dimension of the descriptor must equal the largest first dimension of the xDesc tensor descriptor array. The third dimension equals the hiddenSize. (input)
  • hx: Pointer to the hidden layer input tensor. If hx is NULL, then the initial hidden state will be zero initialized. (input)
  • yDesc: An array of fully packed tensor descriptors associated with the output from each time step. The first dimension of the tensor descriptors must equal the first dimension of the first descriptor (batch size) in the xDesc tensor array. The second dimension of the element of the descriptor array depends on the direction mode selected. If the direction mode is unidirectional, the second dimension is the hiddenSize. If direction mode is bidirectional the second dimension is twice the hiddenSize. (input)
  • y: Pointer to the output tensor (input)
  • dwDesc: A weights tensor descriptor (input)
  • dw: Pointer to input weights tensor (input / output)
  • workSpace: Pointer to memory allocated for forward training (input)
  • workSpaceNumBytes: Number of allocated bytes in memory for the workspace (input)
  • reserveSpace: Pointer to memory allocated for random states (input)
  • reserveSpaceNumBytes: Number of allocated bytes in memory for use in the forward (input)

miopenRNNForwardInference

miopenStatus_t miopenRNNForwardInference(miopenHandle_t handle, miopenRNNDescriptor_t rnnDesc, const int sequenceLen, const miopenTensorDescriptor_t *xDesc, const void *x, const miopenTensorDescriptor_t hxDesc, const void *hx, const miopenTensorDescriptor_t cxDesc, const void *cx, const miopenTensorDescriptor_t wDesc, const void *w, const miopenTensorDescriptor_t *yDesc, void *y, const miopenTensorDescriptor_t hyDesc, void *hy, const miopenTensorDescriptor_t cyDesc, void *cy, void *workSpace, size_t workSpaceNumBytes)

Execute forward inference for RNN layer.

Interface for executing the forward inference pass on a RNN.

Return
miopenStatus_t
Parameters
  • handle: MIOpen handle (input)
  • rnnDesc: RNN layer descriptor type (input)
  • sequenceLen: Temporal iterations to unroll (input)
  • xDesc: An array of tensor descriptors. These are the input descriptors to each time step. The first dimension of each descriptor is the batch size and may decrease from element n to element n+1 and not increase in size. The second dimension is the same for all descriptors in the array and is the input vector length. (input)
  • x: Pointer to input tensor (input)
  • hxDesc: A hidden tensor descriptor that has as its first dimension of the number of layers if the direction mode is unidirectional and twice the number of layers if the direction mode is bidirectional. The second dimension of the descriptor must equal the largest first dimension of the xDesc tensor descriptor array. The third dimension equals the hiddenSize. (input)
  • hx: Pointer to the hidden layer input tensor. If hx is NULL, then the initial hidden state will be zero initialized. (input)
  • cxDesc: A cell tensor descriptor that has as its first dimension of the number of layers if the direction mode is unidirectional and twice the number of layers if the direction mode is bidirectional. The second dimension of the descriptor must equal the largest first dimension of the xDesc tensor descriptor array. The third dimension equals the hiddenSize. (input)
  • cx: Pointer to the cell layer input tensor. If cx is NULL, then the initial cell state will be zero initialized. (input)
  • wDesc: A weights tensor descriptor (input)
  • w: Pointer to input weights tensor (input)
  • yDesc: An array of fully packed tensor descriptors associated with the output from each time step. The first dimension of the tensor descriptors must equal the first dimension of the first descriptor (batch size) in the xDesc tensor array. The second dimension of the element of the descriptor array depends on the direction mode selected. If the direction mode is unidirectional, the second dimension is the hiddenSize. If direction mode is bidirectional the second dimension is twice the hiddenSize. (input)
  • y: Pointer to output tensor (output)
  • hyDesc: A hidden tensor descriptor that has as its first dimension of the number of layers if the direction mode is unidirectional and twice the number of layers if the direction mode is bidirectional. The second dimension of the descriptor must equal the largest first dimension of the xDesc tensor descriptor array. The third dimension equals the hiddenSize. (input)
  • hy: Pointer to the hidden layer output tensor. If hy is NULL, then the final hidden state will not be saved. (output)
  • cyDesc: A output cell tensor descriptor that has as its first dimension of the number of layers if the direction mode is unidirectional and twice the number of layers if the direction mode is bidirectional. The second dimension of the descriptor must equal the largest first dimension of the xDesc tensor descriptor array. The third dimension equals the hiddenSize. (input)
  • cy: Pointer to the cell layer output tensor. If cy is NULL, then the final cell state will not be saved. (output)
  • workSpace: Pointer to memory allocated for forward training (input)
  • workSpaceNumBytes: Number of allocated bytes in memory for the workspace (input)