The following environment variable settings are optimal settings for zentf, and should be used in addition to the environment variable settings.
-
ZENDNN_ENABLE_MEMPOOL=2(for NLP and LLM models) -
ZENDNN_ENABLE_MEMPOOL=3(for CNN models) -
ZENDNN_ENABLE_MEMPOOL=0(any model with JAVA interface) -
ZENDNN_TENSOR_BUF_MAXSIZE_ENABLE=0 -
ZENDNN_CONV_ALGO=3 -
TF_NUM_INTEROP_THREADS=1(for Hugging Face NLP and LLM Models) -
TF_NUM_INTRAOP_THREADS=128(for Hugging Face NLP and LLM Models) -
OMP_PROC_BIND=FALSE