GitHub - pawngrubber/rag-test

Get Started

Install requirements

python -m pip install -U pip setuptools
python -m pip install -r requirements.txt

Download Llama 3 8b Instruct Q4_K_S.gguf into this directory https://huggingface.co/QuantFactory/Meta-Llama-3-8B-Instruct-GGUF/resolve/main/Meta-Llama-3-8B-Instruct.Q4_K_S.gguf?download=true

Name		Name	Last commit message	Last commit date
Latest commit History 2 Commits
.gitignore		.gitignore
LICENSE		LICENSE
README.md		README.md
demo.py		demo.py
llm.py		llm.py
main.py		main.py
rag.py		rag.py
requirements.txt		requirements.txt
test.py		test.py
test_llm.py		test_llm.py