Installation - 57300

Follow these instructions to install.

1. Create a new Python environment.
   Note: To get started with Conda, refer to the Miniforge Installation Guide.

   Using Conda

   conda create -n vllm-env python=3.10

   conda activate vllm-env

2. Build vLLM from Source.
   1. Follow instructions provided in the vLLM Installation Guide.
      Note: Pre-built vLLM CPU binaries are not available. You must build vLLM from source to enable CPU support.
   2. Ensure you check out the v0.9.0 release tag or a later version before building.
3. Install zentorch. Refer to the zentorch Installation Guide for detailed instructions.
4. Install the requirements.

   pip install transformers==4.52.4