This section provides the L2 performance benchmarks and Quality of Results (QoR) for the AI Engine (AIE) digital signal processing (DSP) library elements with various configurations. The results are extracted from a hardware emulation based simulations.
The device used for AIE benchmarking is the xcvc1902-vsva2197-2MP-e-S, and the device used for AIE-ML is the xcve2802-vsvh1760-2MP-e-S.
The metrics reported for each case are:
- Latency - The time delay between the first input sample and the first output sample. If there are multiple ports, the latency is recorded from the first input and first output port.
- Throughput - Input throughput calculated based on the number of samples per iteration and the time between each consecutive iteration.
- NUM_BANKS - Number of memory banks used by the design.
- NUM_AIE - Number of AIE tiles used by the design.
- DATA_MEMORY - Total data memory in bytes used by the design.
- PROGRAM_MEMORY - Program memory in bytes used by each kernel.
The AIE_VARIANT parameter refers to the type of AI Engine that is used for each particular case in the benchmark results. A value of 1 denotes the AIE, and a value of 2 denotes the AIE-ML.
The PROGRAM_MEMORY metrics are harvested for each kernel the design consists of. For example, a finite impulse response (FIR) configured to be implemented on two tiles (CASC_LEN=2) will have two sets of figures displayed in the following table (space delimited).