The ZCU104 evaluation board uses the mid-range ZU7ev UltraScale+ device. Dual B4096F DPU cores are implemented in program logic and delivers 2.4 TOPS INT8 peak performance for deep learning inference acceleration.
Refer to the following table for the throughput performance (in frames/sec or fps) for various neural network samples on ZCU104 with DPU running at 300 MHz.
| No | Neural Network | Input Size | GOPS | Performance (fps) (Single thread) | Performance (fps) (Multiple thread) |
|---|---|---|---|---|---|
| 1 | bcc_pt | 800x1000 | 268.9 | 3.3 | 7.6 |
| 2 | centerpoint_0_ptcenterpoint_1_pt | 2560x40x4 | 54 | 16.9 | 20.7 |
| 3 | densebox_320_320 | 320x320 | 0.49 | 441.4 | 1596.4 |
| 4 | densebox_640_360 | 360x640 | 1.1 | 217.5 | 761.5 |
| 5 | efficientNet-edgetpu-L_tf | 300x300 | 19.36 | 33.3 | 71.1 |
| 6 | efficientNet-edgetpu-M_tf | 240x240 | 7.34 | 83.2 | 167.6 |
| 7 | efficientNet-edgetpu-S_tf | 224x224 | 4.72 | 119.4 | 247.2 |
| 8 | ENet_cityscapes_pt | 512x1024 | 8.6 | 9.5 | 39 |
| 9 | face_landmark | 96x72 | 0.14 | 940.7 | 1595.2 |
| 10 | face-quality | 80x60 | 0.06 | 2663.6 | 7365.3 |
| 11 | face-quality_pt | 80x60 | 0.06 | 2623.5 | 7321.1 |
| 12 | facerec_resnet20 | 112x96 | 3.5 | 175.9 | 310 |
| 13 | facerec-resnet20_mixed_pt | 112x96 | 3.5 | 177.8 | 313 |
| 14 | facerec_resnet64 | 112x96 | 11 | 75.6 | 145.2 |
| 15 | facereid-large_pt | 96x96 | 0.5 | 936 | 2050.3 |
| 16 | facereid-small_pt | 80x80 | 0.09 | 2162.8 | 5659.8 |
| 17 | fpn | 256x512 | 8.9 | 35.4 | 146 |
| 18 | FPN_Res18_Medical_segmentation | 320x320 | 45.3 | 13.2 | 34.5 |
| 19 | FPN-resnet18_covid19-seg_pt | 352x352 | 22.7 | 38.1 | 79.8 |
| 20 | FPN-resnet18_Endov | 240x320 | 13.75 | 37.8 | 129.6 |
| 21 | hourglass-pe_mpii | 256x256 | 10.2 | 15.1 | 64.8 |
| 22 | inception_resnet_v2_tf | 299x299 | 26.4 | 23.9 | 45 |
| 23 | inception_v1 | 224x224 | 3.2 | 192.5 | 405.9 |
| 24 | inception_v1_tf | 224x224 | 3 | 195.4 | 410.3 |
| 25 | inception_v2 | 224x224 | 4 | 140.7 | 276.3 |
| 26 | inception_v2_tf | 224x224 | 3.88 | 97.6 | 195.1 |
| 27 | inception_v3 | 299x299 | 11.4 | 62.7 | 122 |
| 28 | inception_v3_pt | 299x299 | 5.7 | 62.7 | 122.2 |
| 29 | inception_v3_tf | 299x299 | 11.5 | 62.6 | 121.7 |
| 30 | inception_v3_tf2 | 299x299 | 11.5 | 62.2 | 122 |
| 31 | inception_v4 | 299x299 | 24.5 | 30.5 | 59 |
| 32 | inception_v4_2016_09_09_tf | 299x299 | 24.6 | 30.5 | 59.1 |
| 33 | medical_seg_cell_tf2 | 128x128 | 5.3 | 165 | 342.2 |
| 34 | MLPerf_resnet50_v1.5_tf | 224x224 | 8.19 | 76.2 | 148 |
| 35 | mlperf_ssd_resnet34_tf | 1200x1200 | 433 | 1.9 | 5.2 |
| 36 | mobilenet_1_0_224_tf2 | 224x224 | 1.1 | 316.7 | 763.7 |
| 37 | mobilenet_edge_0_75_tf | 224x224 | 0.62 | 254.5 | 578.7 |
| 38 | mobilenet_edge_1_0_tf | 224x224 | 0.99 | 212.2 | 461.8 |
| 39 | mobilenet_v1_0_25_128_tf | 128x128 | 0.027 | 1247.5 | 4084.2 |
| 40 | mobilenet_v1_0_5_160_tf | 160x160 | 0.15 | 777.8 | 2249.5 |
| 41 | mobilenet_v1_1_0_224_tf | 224x224 | 1.1 | 321.3 | 774.8 |
| 42 | mobilenet_v2 | 224x224 | 0.6 | 267.3 | 611.5 |
| 43 | mobilenet_v2_1_0_224_tf | 224x224 | 0.6 | 261.2 | 588.8 |
| 44 | mobilenet_v2_1_4_224_tf | 224x224 | 1.2 | 192.2 | 406.3 |
| 45 | mobilenet_v2_cityscapes_tf | 1024x2048 | 132.74 | 1.8 | 5.6 |
| 46 | MT-resnet18_mixed_pt | 512x320 | 13.65 | 32.7 | 92 |
| 47 | multi_task | 288x512 | 14.8 | 39.6 | 108.9 |
| 48 | multi_task_v3_pt | 320x512 | 25.44 | 17.3 | 54.4 |
| 49 | openpose_pruned_0_3 | 368x368 | 49.9 | 4 | 11 |
| 50 | personreid-res18_pt | 176x80 | 1.1 | 379.5 | 688.6 |
| 51 | personreid-res50_pt | 256x128 | 5.4 | 103.6 | 201.2 |
| 52 | plate_detection | 320x320 | 0.49 | 529.3 | 1971.3 |
| 53 | plate_num | 96x288 | 1.75 | 212.1 | 492.4 |
| 54 | pmg_pt | 224x224 | 2.28 | 154.7 | 313.6 |
| 55 | pointpainting-pointpainting_nuscenes_40000_64_0_ptpointpainting_nuscenes_40000_64_1_pt | 40000x64x16 | 112 | 1.3 | 4.7 |
| 56 | pointpillars_kitti_12000_0_ptpointpillars_kitti_12000_1_pt | 12000x100x4 | 10.8 | 20.2 | 49.7 |
| 57 | pointpillars_nuscenes_40000_64_0_ptpointpillars_nuscenes_40000_64_1_pt | 40000x64x5 | 108 | 2.3 | 9.4 |
| 58 | rcan_pruned_tf | 360x640 | 86.95 | 8.1 | 15.3 |
| 59 | refinedet_baseline | 480x360 | 123 | 9.1 | 18.4 |
| 60 | RefineDet-Medical_EDD_tf | 320x320 | 9.8 | 69.7 | 169.7 |
| 61 | refinedet_pruned_0_8 | 360x480 | 25 | 34.1 | 73.1 |
| 62 | refinedet_pruned_0_92 | 360x480 | 10.1 | 65.9 | 152.1 |
| 63 | refinedet_pruned_0_96 | 360x480 | 5.1 | 90.4 | 220.2 |
| 64 | refinedet_VOC_tf | 320x320 | 81.9 | 10.7 | 25.9 |
| 65 | reid | 80x160 | 0.95 | 380.9 | 704 |
| 66 | resnet18 | 224x224 | 3.7 | 195.7 | 415.4 |
| 67 | resnet50 | 224x224 | 7.7 | 85.6 | 166.2 |
| 68 | resnet50_pt | 224x224 | 4.1 | 75.7 | 147.3 |
| 69 | resnet50_tf2 | 224x224 | 7.7 | 83.9 | 163.2 |
| 70 | resnet_v1_101_tf | 224x224 | 14.4 | 45.5 | 88.8 |
| 71 | resnet_v1_152_tf | 224x224 | 21.8 | 31.1 | 60.7 |
| 72 | resnet_v1_50_tf | 224x224 | 7 | 85.2 | 165 |
| 73 | resnet_v2_101_tf | 299x299 | 26.78 | 21.8 | 46 |
| 74 | resnet_v2_152_tf | 299x299 | 40.47 | 15.4 | 31.6 |
| 75 | resnet_v2_50_tf | 299x299 | 13.1 | 37.2 | 84.2 |
| 76 | retinaface | 360x640 | 1.11 | 130 | 483 |
| 77 | salsanext_pt | 64x2048 | 20.4 | 5.5 | 21.3 |
| 78 | salsanext_v2_pt | 64x2048 | 32 | 4.2 | 11.7 |
| 79 | SemanticFPN_cityscapes_pt | 256x512 | 10 | 35 | 159.1 |
| 80 | SemanticFPN_Mobilenetv2_pt | 512x1024 | 5.4 | 10.4 | 53.6 |
| 81 | semantic_seg_citys_tf2 | 512x1024 | 54 | 7.3 | 25.4 |
| 82 | sp_net | 128x224 | 0.55 | 582.9 | 1355 |
| 83 | squeezenet | 227x227 | 0.76 | 279.4 | 986.8 |
| 84 | squeezenet_pt | 224x224 | 0.82 | 305 | 1068.2 |
| 85 | ssd_adas_pruned_0_95 | 360x480 | 6.3 | 91.4 | 238.1 |
| 86 | ssd_inception_v2_coco_tf | 300x300 | 9.6 | 40.7 | 87.9 |
| 87 | ssdlite_mobilenet_v2_coco_tf | 300x300 | 1.5 | 106.2 | 276.4 |
| 88 | ssd_mobilenet_v1_coco_tf | 300x300 | 2.5 | 110 | 308 |
| 89 | ssd_mobilenet_v2 | 360x480 | 6.6 | 25 | 106 |
| 90 | ssd_mobilenet_v2_coco_tf | 300x300 | 3.8 | 79.2 | 194.4 |
| 91 | ssd_pedestrian_pruned_0_97 | 360x360 | 5.9 | 79.8 | 215.7 |
| 92 | ssd_resnet_50_fpn_coco_tf | 640x640 | 178.4 | 2.9 | 5.2 |
| 93 | ssd_traffic_pruned_0_9 | 360x480 | 11.6 | 57.7 | 150.4 |
| 94 | tiny_yolov3_vmss | 416x416 | 5.46 | 122.8 | 329.2 |
| 95 | unet_chaos-CT_pt | 512x512 | 23.3 | 23 | 59.3 |
| 96 | vgg_16_tf | 224x224 | 31 | 21.4 | 37.1 |
| 97 | vgg_19_tf | 224x224 | 39.3 | 18.5 | 32.6 |
| 98 | vpgnet_pruned_0_99 | 480x640 | 2.5 | 98.5 | 300.6 |
| 99 | yolov2_voc | 448x448 | 34 | 27.9 | 57.2 |
| 100 | yolov2_voc_pruned_0_66 | 448x448 | 11.6 | 66.7 | 153.6 |
| 101 | yolov2_voc_pruned_0_71 | 448x448 | 9.9 | 76.6 | 180.9 |
| 102 | yolov2_voc_pruned_0_77 | 448x448 | 7.8 | 89.5 | 217.3 |
| 103 | yolov3_adas_pruned_0_9 | 256x512 | 5.5 | 95.5 | 233.6 |
| 104 | yolov3_bdd | 288x512 | 53.7 | 13.2 | 26.6 |
| 105 | yolov3_voc | 416x416 | 65.4 | 13.4 | 26.9 |
| 106 | yolov3_voc_tf | 416x416 | 65.6 | 14 | 28.1 |
| 107 | yolov4_leaky_spp_m | 416x416 | 60.1 | 14 | 28.3 |
| 108 | yolov4_leaky_spp_m_pruned_0_36 | 416x416 | 38.2 | 19.2 | 38.8 |
| 109 | ultrafast_pt | 288x800 | 8.4 | 35.3 | 76.2 |
| 110 | HardNet_MSeg_pt | 352x352 | 22.78 | 24.7 | 53.1 |
| 111 | drunet_pt | 528x608 | 2.59 | 48 | 117.9 |
| 112 | person-orientation_pruned_558m_pt | 224x112 | 0.558 | 647.1 | 1310.8 |
| 113 | ofa_resnet50_0_9B_pt | 160x160 | 0.9 | 182 | 339.2 |
| 114 | SESR_S_pt | 360x640 | 7.48 | 85.4 | 138.5 |
| 115 | c2d2_lite | 512x512 | 6.86 | 3.2 | 3.6 |
| 116 | ofa_depthwise_res50_pt | 176x176 | 1.25 | 105.4 | 348.4 |
| 117 | FairMot_pt | 640x480 | 36 | 23.1 | 51.9 |
| 118 | mobilenet_v3_small_1_0_tf2 | 224x224 | 0.132 | 1.5 | 5.8 |
| 119 | clocs | 12000x100x4 | 41 | 2.9 | 10.5 |
| 120 | tsd_yolox_pt | 640x640 | 73 | 13.8 | 27.7 |
| 121 | fadnet_pruned | 576x960 | 154 | 2.3 | 6.4 |
| 122 | ssr_pt | 256x256 | 39.72 | 6.1 | 11.9 |
| 123 | fadnet | 576x960 | 441 | 1.5 | 3.8 |