blood-mate-ai

Updates

• 2023.03.09 Meta AI's LLAMA 7B was used!
• 2023.03.11 LLAMA was not good enough.. Changed it to Meta AI's blenderbot 3B model.

Usage

0. Requirements

pip install transformers
pip install langdetect
conda install pytorch torchvision torchaudio pytorch-cuda=11.6 -c pytorch -c nvidia

1. Demo

python bot.py

Answering time is only 0.6 seconds.

Environments

OS: Windows 11
GPU: Nvidia RTX 4090 24GB 

TODO

• Korean chatbot
• Find out some other chatbot..
• Finetune with our blood-about dataset to help people