The following table lists the quantization-supported operations and APIs for vai_q_onnx. Operations not in this list are skipped during quantization and remain untouched in the output model.
Operation Type | Description |
---|---|
Conv | |
ConvTranspose | |
Gemm | |
BatchNorm | Will be fused with previous "Conv" op |
Add | |
Concat | |
Relu | |
Reshape | |
Transpose | |
Squeeze | |
Resize | |
MaxPool | |
GlobalAveragePool | |
AveragePool | |
MatMul | |
Mul | |
Sigmoid | |
Softmax |