Skip to content

Instantly share code, notes, and snippets.

@mrmaheshrajput

mrmaheshrajput/cpu-sentence-transformers.sh

Last active April 13, 2024 05:16
Show Gist options
  • Save mrmaheshrajput/303d92ff3e791da04c0ea649a8fe1373 to your computer and use it in GitHub Desktop.
Save mrmaheshrajput/303d92ff3e791da04c0ea649a8fe1373 to your computer and use it in GitHub Desktop.
Download ZIP
Raw
cpu-sentence-transformers.sh
echo("Creating layer/python directory")
mkdir -p layer/python
echo("Installing cpu only pytorch")
pip install \
--target layer/python torch torchvision torchaudio \
--extra-index-url https://download.pytorch.org/whl/cpu
echo("Installing sentence transformer dependencies")
pip install --target layer/python \
transformers tqdm scikit-learn scipy nltk sentencepiece
echo("Installing sentence-transformers without dependencies")
pip install --target layer/python --no-deps sentence-transformers
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment