-
enum DLP_POST_OP_TYPE#
Enumeration of post-operation types that can be applied to GEMM results.
This enum defines the different types of operations that can be performed on the output matrix after GEMM computation.
Post-operation types for GEMM results.
Enumerates supported post-operations that can be applied to GEMM output.
Values:
-
enumerator ELTWISE#
Element-wise operations (activations)
-
enumerator BIAS#
Bias addition operation
-
enumerator SCALE#
Scaling operation
-
enumerator MATRIX_ADD#
Matrix addition operation
-
enumerator MATRIX_MUL#
Matrix multiplication operation
-
enumerator ELTWISE#
-
enum DLP_ELT_ALGO_TYPE#
Enumeration of element-wise algorithm types supported in post-operations.
This enum defines the various activation functions and element-wise operations that can be applied as post-operations in GEMM computations.
Element-wise algorithm types for post-operations.
Enumerates supported activation and element-wise functions for GEMM post-ops.
Values:
-
enumerator RELU#
Rectified Linear Unit activation: max(0, x)
-
enumerator PRELU#
Parametric ReLU activation: max(alpha*x, x)
-
enumerator GELU_TANH#
GELU activation using tanh approximation
-
enumerator GELU_ERF#
GELU activation using error function
-
enumerator CLIP#
Clipping operation: min(max(x, min_val), max_val)
-
enumerator SWISH#
Swish activation: x * sigmoid(x)
-
enumerator TANH#
Hyperbolic tangent activation
-
enumerator SIGMOID#
Sigmoid activation: 1 / (1 + exp(-x))
-
enumerator MISH#
Mish activation: x * tanh(softplus(x))
-
enumerator RELU#
-
enum DLP_TYPE#
Enumeration of supported data types for parameter storage.
This enum defines the various data types that can be used for storing parameters in GEMM operations and post-operations.
Supported data types for GEMM and post-op parameters.
Enumerates all valid data types for parameter storage in GEMM/post-ops.
Values:
-
enumerator DLP_INVALID#
Invalid or unspecified type
-
enumerator DLP_S4#
Signed 4-bit integer
-
enumerator DLP_U4#
Unsigned 4-bit integer
-
enumerator DLP_F4#
4-bit floating point
-
enumerator DLP_S8#
Signed 8-bit integer
-
enumerator DLP_U8#
Unsigned 8-bit integer
-
enumerator DLP_S16#
Signed 16-bit integer
-
enumerator DLP_U16#
Unsigned 16-bit integer
-
enumerator DLP_F16#
16-bit floating point
-
enumerator DLP_BF16#
Brain floating point 16-bit
-
enumerator DLP_S32#
Signed 32-bit integer
-
enumerator DLP_U32#
Unsigned 32-bit integer
-
enumerator DLP_F32#
32-bit floating point
-
enumerator DLP_MAX#
Maximum value (enum boundary)
-
enumerator DLP_INVALID#
See Also
GEMM Operations - GEMM operations
Element-wise Operations - Element-wise operations
Utility Functions - Utility functions