Demo 5: vck190_4mipi - 3.5 English - UG1354

Vitis AI Library User Guide (UG1354)
Document ID
UG1354
Release Date
2023-06-29
Version
3.5 English

AI Model and Performance

Table 1. AI Model and Performance of vck190_4mipi Demo
Channel Model Name Performance (fps)
0 sp_net 30
ssd_pedestrian_pruned_0_97
1 ssd_pedestrian_pruned_0_97 30
2 densebox_640_360 30
3 densebox_640_360 30

MIPI Camera Setup

  1. Download ZU4 SC image from here and follow the instructions on the Update System Controller uSD Card page to update the ZU4 SC.
  2. Download BoardUI tools from here.
    Note: Make sure you have accounts to download the above resources. You can use your AMD account or create a new one.
  3. Refer to Board jumper and switch settings to set up the board.
  4. Refer to Vadj Settings to set Vadj.
    Note: Make sure the Vadj 1.2V is set successfully.

Building and Running the Demo

Note: This demo requires a special VCK190 image. It integrates the C32B1CU3 DPU and the Hardware Scaler IP. You can download the VCK190 image from here. For more details, refer to Demo Platform for VCK190 Evaluation Kit.
  • Build the demo in the host and copy the program to the target board.
    cd Vitis-AI/examples/vai_library/apps/vck190_4mipi
bash build_4mipi_spnet.sh
scp -r vck190_4mipi root@IP_OF_BOARD:~/
  • Initialize the camera.
    # /etc/init.d/xserver-nodm stop
# sh quad_640x360_bgr.sh
  • Modify the camera ISP parameters.
    
v4l2-ctl -d /dev/v4l-subdev11 -c ar0231_green_balance=170
v4l2-ctl -d /dev/v4l-subdev12 -c ar0231_green_balance=170
v4l2-ctl -d /dev/v4l-subdev13 -c ar0231_green_balance=170
v4l2-ctl -d /dev/v4l-subdev14 -c ar0231_green_balance=170
v4l2-ctl -d /dev/v4l-subdev11 -c ar0231_blue_balance=500
v4l2-ctl -d /dev/v4l-subdev11 -c ar0231_red_balance=140
v4l2-ctl -d /dev/v4l-subdev11 -c ar0231_exposure=1000
v4l2-ctl -d /dev/v4l-subdev11 -c ar0231_digital_gain=800
v4l2-ctl -d /dev/v4l-subdev12 -c ar0231_blue_balance=500
v4l2-ctl -d /dev/v4l-subdev12 -c ar0231_red_balance=140
v4l2-ctl -d /dev/v4l-subdev12 -c ar0231_exposure=1000
v4l2-ctl -d /dev/v4l-subdev12 -c ar0231_digital_gain=800
v4l2-ctl -d /dev/v4l-subdev13 -c ar0231_blue_balance=500
v4l2-ctl -d /dev/v4l-subdev13 -c ar0231_red_balance=140
v4l2-ctl -d /dev/v4l-subdev13 -c ar0231_exposure=1000
v4l2-ctl -d /dev/v4l-subdev13 -c ar0231_digital_gain=800
v4l2-ctl -d /dev/v4l-subdev14 -c ar0231_blue_balance=500
v4l2-ctl -d /dev/v4l-subdev14 -c ar0231_red_balance=140
v4l2-ctl -d /dev/v4l-subdev14 -c ar0231_exposure=1000
v4l2-ctl -d /dev/v4l-subdev14 -c ar0231_digital_gain=800
  • Run the demo.
    sh run_4mipi_spnet.sh
    Figure 1. vck190_4mipi Demo Picture