ResNet50 INT8 + YOLOX-M INT8 (external pre-processing via vvas_xabrscaler)
Note
Ensure
model-pathis set to point to your available model before running.
gst-launch-1.0 \
filesrc location=<INPUT>.bgr ! \
rawvideoparse format=bgr width=<INPUT_WIDTH> height=<INPUT_HEIGHT> ! \
tee name=t ! queue ! \
vvas_xabrscaler xclbin-location=/run/media/mmcblk0p1/x_plus_ml.xclbin alpha-r=123.675 alpha-g=116.280 alpha-b=103.530 beta-r=0.017124 beta-g=0.017507 beta-b=0.017429 ! \
vvas_xinfer config-file=/etc/vvas/configs/infer/resnet50_int8_onnxrt_extppe.json ! \
ma1.sink_master vvas_xmetaaffixer name=ma1 ma1.src_master ! \
fakesink -v \
t. ! queue ! \
ma1.sink_slave_0 ma1.src_slave_0 ! vvas_xmetaconvert config-location=/etc/vvas/configs/metaconvert/metaconvert_config.json ! \
vvas_xoverlay ! queue ! \
filesink location=out_1_resnet50_int8.bgr \
t. ! queue ! \
vvas_xinfer config-file=/etc/vvas/configs/infer/yoloxm_int8_onnxrt_intppe.json ! \
ma2.sink_master vvas_xmetaaffixer name=ma2 ma2.src_master ! \
fakesink -v \
t. ! queue ! \
ma2.sink_slave_0 ma2.src_slave_0 ! vvas_xmetaconvert config-location=/etc/vvas/configs/metaconvert/metaconvert_config.json ! \
vvas_xoverlay ! queue ! \
filesink location=out_2_yolox_int8.bgr
Four concurrent ResNet50 INT8 instances
Note
Ensure
model-pathis set to point to your available model before running.
gst-launch-1.0 filesrc location=<INPUT>.nv12 \
! rawvideoparse format=nv12 width=<INPUT_WIDTH> height=<INPUT_HEIGHT> \
! queue \
! vvas_xinfer config-file=/etc/vvas/configs/infer/resnet50_int8_onnxrt_intppe.json \
! queue \
! vvas_xmetaconvert config-location=/etc/vvas/configs/metaconvert/metaconvert_config.json \
! vvas_xoverlay \
! filesink location=gst_out_1_resnet50_int8.nv12 \
filesrc location=<INPUT>.nv12 \
! rawvideoparse format=nv12 width=<INPUT_WIDTH> height=<INPUT_HEIGHT> \
! queue \
! vvas_xinfer config-file=/etc/vvas/configs/infer/resnet50_int8_onnxrt_intppe.json \
! queue \
! vvas_xmetaconvert config-location=/etc/vvas/configs/metaconvert/metaconvert_config.json \
! vvas_xoverlay \
! filesink location=gst_out_2_resnet50_int8.nv12 \
filesrc location=<INPUT>.nv12 \
! rawvideoparse format=nv12 width=<INPUT_WIDTH> height=<INPUT_HEIGHT> \
! queue \
! vvas_xinfer config-file=/etc/vvas/configs/infer/resnet50_int8_onnxrt_intppe.json \
! queue \
! vvas_xmetaconvert config-location=/etc/vvas/configs/metaconvert/metaconvert_config.json \
! vvas_xoverlay \
! filesink location=gst_out_3_resnet50_int8.nv12 \
filesrc location=<INPUT>.nv12 \
! rawvideoparse format=nv12 width=<INPUT_WIDTH> height=<INPUT_HEIGHT> \
! queue \
! vvas_xinfer config-file=/etc/vvas/configs/infer/resnet50_int8_onnxrt_intppe.json \
! queue \
! vvas_xmetaconvert config-location=/etc/vvas/configs/metaconvert/metaconvert_config.json \
! vvas_xoverlay \
! filesink location=gst_out_4_resnet50_int8.nv12 -v