If you have scripts to evaluate floating point models, like the models in Vitis AI Model Zoo, apply the following two changes to evaluate the quantized model:
- Prepend the float evaluation script with
from tensorflow.contrib import decent_qto register the quantize operation. - Replace the float model path in the scripts to quantization
output model
"quantize_results/quantize_eval_model.pb". - Run the modified script to evaluate the quantized model.