- Anaconda
- NVIDIA GPU
- GIT
- Run the following commands to activate conda:
conda create -n textgen python=3.10.9 conda activate textgen
- Install Pytorch:
pip3 install torch torchvision torchaudio --index-url https://download.pytorch.org/whl/cu117
- Clone the repo:
git clone https://github.com/oobabooga/text-generation-webui cd text-generation-webui
- Install the Python requirements:
python -m pip install -r requirements.txt python -m torch.utils.collect_env # optional, checks that you have CUDA enabled
- Start the server:
python server.py