Disclaimer: I'm not a data scientist or an expert with LLaMA models or LLMs thus I won't cover technical details about LLaMA models, Vicuna or the settings used in my tests. I just wanted to play with LLaMA models and share my setup and results with the community.
I also consider that you have some basic knowledge about using a terminal and running Python scripts.
I will also not cover the installation process of the tools and libraries used in this document but I will provide links to the documentation I used to make this work on my computer.
Finally, I'm not a native English speaker so please excuse my English mistakes 🙃
I wanted to try to run a LLaMA model on my computer. Since I had absolutely no knowledge about this I started by reading a lot of documentation and articles on the Internet.