Installation - Installation - 57300

Follow these instructions to install.

1. Create a new Python environment.
   Note: To get started with Conda, refer to the Miniforge Installation Guide.

   Using Conda

   conda create -n vllm-env python=3.10 -y
   conda activate vllm-env

2. Build vLLM from Source.
   1. Follow instructions provided in the vLLM Installation Guide for detailed instructions.
      Important: Pre-built vLLM CPU binaries are available from 0.13.0. You must build vLLM from source to enable CPU support for the previously supported versions. The supported versions are: 0.20.0, 0.20.1, 0.20.2, 0.21.0, 0.22.0, 0.22.1, 0.23.0. Check out the appropriate release tag before building.
3. Install zentorch.

   Table 1. Compatibility Matrix: vLLM-PyTorch version-zentorch install method

   vLLM version	PyTorch version (auto-installed by vLLM)	zentorch install method
   0.20.0–0.23.0	2.11.0	PyPI or source

   If installing from PyPI (vLLM 0.20.0+):

   pip install zentorch==2.11.0.2

   From source (all supported versions): Refer to the zentorch Installation Guide for detailed instructions.