Demo 5: vck190_4mipi - Demo 5: vck190_4mipi - 2.5 English - UG1354

Vitis AI Library User Guide (UG1354)
Document_ID
UG1354
Release_Date
2022-06-15
Version
2.5 English

AI Model and Performance

Table 1. AI Model and Performance of vck190_4mipi Demo
Channel Model Name Performance (fps)
0 sp_net 30
ssd_pedestrian_pruned_0_97
1 ssd_pedestrian_pruned_0_97 30
2 densebox_640_360 30
3 densebox_640_360 30

MIPI Camera Setup

  1. Download ZU4 SC image from here and follow https://www.xilinx.com/member/vck190_headstart/Update_System_Controller_uSD_Card_Instructions.pdf to update the ZU4 SC.
  2. Download BoardUI tools from here
    Note: Make sure you have accounts to download the above resources. You can use your Xilinx account or create a new one.
  3. Refer to https://xilinx.github.io/vck190-base-trd/2021.1/html/run/run-setup.html#:~:text=Board%20jumper%20and%20switch%20settings to set up the board.
  4. Refer to https://xilinx.github.io/vck190-base-trd/2021.1/html/run/run-setup.html#:~:text=Vadj%20settings to set Vadj.
    Note: Make sure the Vadj 1.2V is set successfully.

Building and Running the Demo

  • Build the demo in the host and copy the program to the target board.
    cd Vitis-AI/examples/Vitis-AI-Library/apps/vck190_4mipi
bash build_4mipi_spnet.sh
scp -r vck190_4mipi root@IP_OF_BOARD:~/
  • Initialize the camera.
    # /etc/init.d/xserver-nodm stop
# sh quad_640x360_bgr.sh
  • Modify the camera ISP parameters
    
v4l2-ctl -d /dev/v4l-subdev11 -c ar0231_green_balance=170
v4l2-ctl -d /dev/v4l-subdev12 -c ar0231_green_balance=170
v4l2-ctl -d /dev/v4l-subdev13 -c ar0231_green_balance=170
v4l2-ctl -d /dev/v4l-subdev14 -c ar0231_green_balance=170
v4l2-ctl -d /dev/v4l-subdev11 -c ar0231_blue_balance=500
v4l2-ctl -d /dev/v4l-subdev11 -c ar0231_red_balance=140
v4l2-ctl -d /dev/v4l-subdev11 -c ar0231_exposure=1000
v4l2-ctl -d /dev/v4l-subdev11 -c ar0231_digital_gain=800
v4l2-ctl -d /dev/v4l-subdev12 -c ar0231_blue_balance=500
v4l2-ctl -d /dev/v4l-subdev12 -c ar0231_red_balance=140
v4l2-ctl -d /dev/v4l-subdev12 -c ar0231_exposure=1000
v4l2-ctl -d /dev/v4l-subdev12 -c ar0231_digital_gain=800
v4l2-ctl -d /dev/v4l-subdev13 -c ar0231_blue_balance=500
v4l2-ctl -d /dev/v4l-subdev13 -c ar0231_red_balance=140
v4l2-ctl -d /dev/v4l-subdev13 -c ar0231_exposure=1000
v4l2-ctl -d /dev/v4l-subdev13 -c ar0231_digital_gain=800
v4l2-ctl -d /dev/v4l-subdev14 -c ar0231_blue_balance=500
v4l2-ctl -d /dev/v4l-subdev14 -c ar0231_red_balance=140
v4l2-ctl -d /dev/v4l-subdev14 -c ar0231_exposure=1000
v4l2-ctl -d /dev/v4l-subdev14 -c ar0231_digital_gain=800
  • Run the demo
    sh run_4mipi_spnet.sh
    Figure 1. vck190_4mipi Demo Picture