Optimal Environment Variable Settings for zentorch - 57300

ZenDNN User Guide (57300)
Document ID
57300
Release Date
2025-08-18
Revision
5.1 English

The following environment variable settings are optimal settings for zentorch, and should be used in addition to the environment variable settings.

  • CNN-based models
    • FP32 models
      • ZENDNN_MATMUL_ALGO=FP32:4
    • BF16 (AMP) models
      • ZENDNN_MATMUL_ALGO=BF16:4
  • NLP-based models
    • FP32 models
      • ZENDNN_MATMUL_ALGO=FP32:2
    • BF16 (AMP) models
      • ZENDNN_MATMUL_ALGO=BF16:4
  • LLM-based models
    • BF16 and WOQ (Per channel and Per group) models
      • ZENDNN_MATMUL_ALGO=BF16:0
  • For RecSys models
    • FP32, INT8 and BF16 models
      • ZENDNN_MATMUL_ALGO=FP32:2,INT8:2,BF16:2
    • BF16 (AMP) models
      • ZENDNN_MATMUL_ALGO=BF16:4