The ZCU104 evaluation board uses the mid-range ZU7ev UltraScale+ device. Dual B4096F DPU cores are implemented in program logic and delivers 2.4 TOPS INT8 peak performance for deep learning inference acceleration.
Refer to the following table for the throughput performance (in frames/sec or fps) for various neural network samples on ZCU104 with DPU running at 300 MHz.
No | Neural Network | Input Size | GOPS | Performance (fps) (Single thread) | Performance (fps) (Multiple thread) |
---|---|---|---|---|---|
1 | bcc_pt | 800x1000 | 268.9 | 3.5 | 7.9 |
2 | centerpoint_0_pt centerpoint_1_pt | 2560x40x4 | 54 | 16.8 | 20.7 |
3 | densebox_320_320 | 320x320 | 0.49 | 428.6 | 1558.9 |
4 | densebox_640_360 | 360x640 | 1.1 | 214.7 | 755.6 |
5 | efficientNet-edgetpu-L_tf | 300x300 | 19.36 | 29.6 | 62.5 |
6 | efficientNet-edgetpu-M_tf | 240x240 | 7.34 | 73.1 | 146.8 |
7 | efficientNet-edgetpu-S_tf | 224x224 | 4.72 | 100.7 | 207.1 |
8 | ENet_cityscapes_pt | 512x1024 | 8.6 | 9.5 | 38 |
9 | face_landmark | 96x72 | 0.14 | 871.7 | 1555.5 |
10 | face-quality | 80x60 | 0.06 | 2171.2 | 6863.8 |
11 | face-quality_pt | 80x60 | 0.06 | 2150.4 | 6843.7 |
12 | facerec_resnet20 | 112x96 | 3.5 | 173.5 | 306.4 |
13 | facerec-resnet20_mixed_pt | 112x96 | 3.5 | 173.5 | 306.1 |
14 | facerec_resnet64 | 112x96 | 11 | 75.3 | 144.7 |
15 | facereid-large_pt | 96x96 | 0.5 | 876.1 | 2004.1 |
16 | facereid-small_pt | 80x80 | 0.09 | 1887.9 | 5589.2 |
17 | fpn | 256x512 | 8.9 | 35.3 | 149.3 |
18 | FPN_Res18_Medical_segmentation | 320x320 | 45.3 | 12.8 | 33.5 |
19 | FPN-resnet18_covid19-seg_pt | 352x352 | 22.7 | 38 | 79.7 |
20 | FPN-resnet18_Endov | 240x320 | 13.75 | 37.4 | 129.1 |
21 | hourglass-pe_mpii | 256x256 | 10.2 | 18.6 | 75.2 |
22 | inception_resnet_v2_tf | 299x299 | 26.4 | 23.8 | 44.7 |
23 | inception_v1 | 224x224 | 3.2 | 189.5 | 402.4 |
24 | inception_v1_tf | 224x224 | 3 | 188.8 | 408.9 |
25 | inception_v2 | 224x224 | 4 | 139.5 | 275.7 |
26 | inception_v2_tf | 224x224 | 3.88 | 96.1 | 193.9 |
27 | inception_v3 | 299x299 | 11.4 | 62.3 | 121.1 |
28 | inception_v3_pt | 299x299 | 5.7 | 62.3 | 121.1 |
29 | inception_v3_tf | 299x299 | 11.5 | 61.5 | 120.4 |
30 | inception_v3_tf2 | 299x299 | 11.5 | 61.7 | 120.8 |
31 | inception_v4 | 299x299 | 24.5 | 30.4 | 58.7 |
32 | inception_v4_2016_09_09_tf | 299x299 | 24.6 | 30.4 | 58.7 |
33 | medical_seg_cell_tf2 | 128x128 | 5.3 | 163.6 | 340.1 |
34 | MLPerf_resnet50_v1.5_tf | 224x224 | 8.19 | 75.5 | 146.7 |
35 | mlperf_ssd_resnet34_tf | 1200x1200 | 433 | 1.8 | 5.2 |
36 | mobilenet_1_0_224_tf2 | 224x224 | 1.1 | 305.8 | 745.8 |
37 | mobilenet_edge_0_75_tf | 224x224 | 0.62 | 249.3 | 574.7 |
38 | mobilenet_edge_1_0_tf | 224x224 | 0.99 | 208.4 | 456 |
39 | mobilenet_v1_0_25_128_tf | 128x128 | 0.027 | 1136.2 | 4058.4 |
40 | mobilenet_v1_0_5_160_tf | 160x160 | 0.15 | 731.9 | 2214.8 |
41 | mobilenet_v1_1_0_224_tf | 224x224 | 1.1 | 311.2 | 758.3 |
42 | mobilenet_v2 | 224x224 | 0.6 | 262 | 606.4 |
43 | mobilenet_v2_1_0_224_tf | 224x224 | 0.6 | 256.4 | 580.8 |
44 | mobilenet_v2_1_4_224_tf | 224x224 | 1.2 | 186.9 | 399.4 |
45 | mobilenet_v2_cityscapes_tf | 1024x2048 | 132.74 | 1.6 | 4.6 |
46 | MT-resnet18_mixed_pt | 512x320 | 13.65 | 32.3 | 91 |
47 | multi_task | 288x512 | 14.8 | 38.7 | 108.6 |
48 | multi_task_v3_pt | 320x512 | 25.44 | 17.2 | 54.1 |
49 | openpose_pruned_0_3 | 368x368 | 49.9 | 3.9 | 11 |
50 | personreid-res18_pt | 176x80 | 1.1 | 369.3 | 678.4 |
51 | personreid-res50_pt | 256x128 | 5.4 | 102.4 | 199.2 |
52 | plate_detection | 320x320 | 0.49 | 514.4 | 1862 |
53 | plate_num | 96x288 | 1.75 | 162.8 | 440.1 |
54 | pmg_pt | 224x224 | 2.28 | 152.9 | 311.5 |
55 | pointpainting- pointpainting_nuscenes_40000_64_0_pt pointpainting_nuscenes_40000_64_1_pt | 40000x64x16 | 112 | 1.3 | 4.7 |
56 | pointpillars_kitti_12000_0_pt pointpillars_kitti_12000_1_pt | 12000x100x4 | 10.8 | 20.1 | 49 |
57 | pointpillars_nuscenes_40000_64_0_pt pointpillars_nuscenes_40000_64_1_pt | 40000x64x5 | 108 | 2.3 | 9.2 |
58 | rcan_pruned_tf | 360x640 | 86.95 | 8 | 15.3 |
59 | refinedet_baseline | 480x360 | 123 | 9 | 18.4 |
60 | RefineDet-Medical_EDD_tf | 320x320 | 9.8 | 67.6 | 169.5 |
61 | refinedet_pruned_0_8 | 360x480 | 25 | 34.1 | 74.5 |
62 | refinedet_pruned_0_92 | 360x480 | 10.1 | 66.3 | 154.6 |
63 | refinedet_pruned_0_96 | 360x480 | 5.1 | 91.6 | 226.6 |
64 | refinedet_VOC_tf | 320x320 | 81.9 | 10.8 | 25.7 |
65 | reid | 80x160 | 0.95 | 370 | 692.2 |
66 | resnet18 | 224x224 | 3.7 | 192.1 | 412.8 |
67 | resnet50 | 224x224 | 7.7 | 76.7 | 150.4 |
68 | resnet50_pt | 224x224 | 4.1 | 73 | 142.7 |
69 | resnet50_tf2 | 224x224 | 7.7 | 74.9 | 146.6 |
70 | resnet_v1_101_tf | 224x224 | 14.4 | 45.1 | 88.2 |
71 | resnet_v1_152_tf | 224x224 | 21.8 | 30.9 | 60.4 |
72 | resnet_v1_50_tf | 224x224 | 7 | 84 | 163.3 |
73 | resnet_v2_101_tf | 299x299 | 26.78 | 21.7 | 45.5 |
74 | resnet_v2_152_tf | 299x299 | 40.47 | 15.3 | 31.2 |
75 | resnet_v2_50_tf | 299x299 | 13.1 | 36.3 | 83 |
76 | retinaface | 360x640 | 1.11 | 129.2 | 474 |
77 | salsanext_pt | 64x2048 | 20.4 | 5.5 | 21.3 |
78 | salsanext_v2_pt | 64x2048 | 32 | 4.1 | 11.8 |
79 | SemanticFPN_cityscapes_pt | 256x512 | 10 | 34.9 | 158.4 |
80 | SemanticFPN_Mobilenetv2_pt | 512x1024 | 5.4 | 10.3 | 53.6 |
81 | semantic_seg_citys_tf2 | 512x1024 | 54 | 7.3 | 25 |
82 | sp_net | 128x224 | 0.55 | 535.2 | 1312.8 |
83 | squeezenet | 227x227 | 0.76 | 276.3 | 978.9 |
84 | squeezenet_pt | 224x224 | 0.82 | 226.7 | 733.2 |
85 | ssd_adas_pruned_0_95 | 360x480 | 6.3 | 90.5 | 239.7 |
86 | ssd_inception_v2_coco_tf | 300x300 | 9.6 | 40.9 | 86.4 |
87 | ssdlite_mobilenet_v2_coco_tf | 300x300 | 1.5 | 100.6 | 270 |
88 | ssd_mobilenet_v1_coco_tf | 300x300 | 2.5 | 111.6 | 301.3 |
89 | ssd_mobilenet_v2 | 360x480 | 6.6 | 24.8 | 106.2 |
90 | ssd_mobilenet_v2_coco_tf | 300x300 | 3.8 | 82.3 | 191.6 |
91 | ssd_pedestrian_pruned_0_97 | 360x360 | 5.9 | 79.4 | 216 |
92 | ssd_resnet_50_fpn_coco_tf | 640x640 | 178.4 | 2.9 | 5.2 |
93 | ssd_traffic_pruned_0_9 | 360x480 | 11.6 | 57.5 | 150.4 |
94 | tiny_yolov3_vmss | 416x416 | 5.46 | 122 | 328.1 |
95 | unet_chaos-CT_pt | 512x512 | 23.3 | 23 | 58.8 |
96 | vgg_16_tf | 224x224 | 31 | 21.3 | 36.9 |
97 | vgg_19_tf | 224x224 | 39.3 | 18.4 | 32.4 |
98 | vpgnet_pruned_0_99 | 480x640 | 2.5 | 95.1 | 297.2 |
99 | yolov2_voc | 448x448 | 34 | 27.9 | 57.4 |
100 | yolov2_voc_pruned_0_66 | 448x448 | 11.6 | 66.5 | 153.2 |
101 | yolov2_voc_pruned_0_71 | 448x448 | 9.9 | 76.4 | 180.5 |
102 | yolov2_voc_pruned_0_77 | 448x448 | 7.8 | 89 | 216.6 |
103 | yolov3_adas_pruned_0_9 | 256x512 | 5.5 | 94.9 | 231.7 |
104 | yolov3_bdd | 288x512 | 53.7 | 13.2 | 26.7 |
105 | yolov3_voc | 416x416 | 65.4 | 13.5 | 27.2 |
106 | yolov3_voc_tf | 416x416 | 65.6 | 14 | 28.1 |
107 | yolov4_leaky_spp_m | 416x416 | 60.1 | 14 | 28.3 |
108 | yolov4_leaky_spp_m_pruned_0_36 | 416x416 | 38.2 | 19.1 | 38.7 |