Vitis AI Optimizer Overview - 2.0 English

Vitis AI Optimizer User Guide (UG1333)

Document ID
Release Date
2.0 English

Vitis™ AI is a Xilinx® development kit for AI inference on Xilinx hardware platforms. Inference in machine learning is computation-intensive and requires high memory bandwidth to meet the low-latency and high-throughput requirements of various applications.

The Vitis AI optimizer provides the ability to optimize neural network models. Currently, the Vitis AI optimizer includes only one tool called the pruner. The Vitis AI pruner prunes redundant connections in neural networks and reduces the overall required operations. The pruned models produced by the Vitis AI pruner can be further quantized by the Vitis AI quantizer and deployed to an FPGA. For more information on the Vitis AI quantizer and deployment, see the Vitis AI User Guide (UG1414).

Figure 1. VAI Optimizer

The Vitis AI pruner supports four deep learning frameworks. The frameworks and their corresponding tool names (p stands for pruning) are listed in the following table:

Table 1. Vitis AI Pruner Frameworks and Tool Names
Framework Tool Name 1
TensorFlow vai_p_tensorflow (TF1.15), vai_p_tensorflow2 (TF2.x)
PyTorch vai_p_pytorch
Caffe vai_p_caffe
Darknet vai_p_darknet
  1. In the tool names, p stands for pruning.

The Vitis AI optimizer requires a commercial license to run. Contact to access the Vitis AI optimizer installation package and license.