The ReLU Type option determines the specific ReLU activation functions that can be used with the DPUCZDX8G. ReLU and ReLU6 are supported by default. Selection of the option “ReLU + LeakyReLU + ReLU6“ will enable LeakyReLU as an activation function.
Note: For
this implementation, the LeakyReLU coefficient is fixed to 0.1 which is approximated
as 26/256 = 0.1015625
| DPUCZDX8G Architecture | Extra LUTs from Conv | Extra LUTs from ALU |
|---|---|---|
| B512 | 465 | 493 |
| B800 | 502 | 747 |
| B1024 | 636 | 643 |
| B1152 | 1038 | 896 |
| B1600 | 831 | 658 |
| B2304 | 460 | 439 |
| B3136 | 812 | 1051 |
| B4096 | 746 | 947 |