Demo 2: seg_and_pose_detect - 3.5 English

Vitis AI Library User Guide (UG1354)

Document ID
UG1354
Release Date
2023-06-29
Version
3.5 English

seg_and_pose_detect is a demo that includes MultiTask segmentation network processing and pose detection.

Target Application

  • ADAS/AD
  • Smartcity

AI Model, Performance, and Power

FPN
seg_and_pose_detect

960x540, 1ch, 30fps

Openpose
960x540, 1ch, 30fps
20W @ ZU9EG
N/A

Building and Running the Demo

Build the demo in the host and copy the program to the target board:

cd Vitis-AI/examples/vai_library/apps/seg_and_pose_detect
bash -x build.sh
scp seg_and_pose_detect_x seg_and_pose_detect_drm root@IP_OF_BOARD:~/

To use OpenCV display, run the following command:

#./seg_and_pose_detect_x seg_960_540.avi pose_960_540.avi -t 4 -t 4 >/dev/null 2>&1
If you want to use DRM display, connect to the board using SSH and run the following command:
#./seg_and_pose_detect_drm seg_960_540.avi pose_960_540.avi -t 4 -t 4 >/dev/null 2>&1
Note:
  1. Download the video file package from here.
  2. Due to limitations of the Docker environment, the MultiTask demos cannot run in DRM mode for Data Center targets.
Figure 1. Segmentation and Pose Detection Demo Picture