You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
CUDA SETUP: Loading binary /usr/local/lib/python3.10/dist-packages/bitsandbytes/libbitsandbytes_cuda118.so...
[2023-08-18 02:27:44,650] [INFO] [real_accelerator.py:133:get_accelerator] Setting ds_accelerator to cuda (auto detect)
2023-08-18 02:27:50.421384: W tensorflow/compiler/tf2tensorrt/utils/py_utils.cc:38] TF-TRT Warning: Could not find TensorRT
Traceback (most recent call last):
File "/content/drive/.shortcut-targets-by-id/1-8pwxu1XoRTFqpdzvU1bdVqJa2Nr6xkj/llama-lora-fine-tuning/generate.py", line 10, in
from utils.prompter import Prompter
ModuleNotFoundError: No module named 'utils.prompter'
The text was updated successfully, but these errors were encountered:
my commonda to test the finetuned model
! CUDA_VISIBLE_DEVICES=0 python generate.py --base_model '/content/drive/MyDrive/Colab Notebooks/llama_finetuning/llama-lora-fine-tuning/llama-7b-hf' --lora_weights '/content/drive/MyDrive/Colab Notebooks/llama_finetuning/output'
error
CUDA SETUP: Loading binary /usr/local/lib/python3.10/dist-packages/bitsandbytes/libbitsandbytes_cuda118.so...
[2023-08-18 02:27:44,650] [INFO] [real_accelerator.py:133:get_accelerator] Setting ds_accelerator to cuda (auto detect)
2023-08-18 02:27:50.421384: W tensorflow/compiler/tf2tensorrt/utils/py_utils.cc:38] TF-TRT Warning: Could not find TensorRT
Traceback (most recent call last):
File "/content/drive/.shortcut-targets-by-id/1-8pwxu1XoRTFqpdzvU1bdVqJa2Nr6xkj/llama-lora-fine-tuning/generate.py", line 10, in
from utils.prompter import Prompter
ModuleNotFoundError: No module named 'utils.prompter'
The text was updated successfully, but these errors were encountered: