Skip to content

Instantly share code, notes, and snippets.

@mrseanryan
Last active January 22, 2024 12:14
Show Gist options
  • Save mrseanryan/2dcdb8182c05d1ea116e6bd0b772ba3d to your computer and use it in GitHub Desktop.
Save mrseanryan/2dcdb8182c05d1ea116e6bd0b772ba3d to your computer and use it in GitHub Desktop.
Create script to start existing install of text-generation-webui
#!/bin/bash -e
GPU_GB=${1:-24}
pushd /home/ubuntu/text-generation-webui
GPU_CHOICE=A USE_CUDA118=FALSE LAUNCH_AFTER_INSTALL=TRUE INSTALL_EXTENSIONS=TRUE ./start_linux.sh --public-api --extensions openai --api-port 5000 --auto-devices --gpu-memory $GPU_GB
# --share
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment