Fully local & open source AI Waifu. VTube Studio, Discord, Minecraft, custom made RAG (long term memory), alarm, and plenty more! Has a WebUI and hotkey shortcuts.
Uses Oobabooga, RVC, and Whisper to run AI.
Requires Windows 10/11 and a CUDA (NVidia) GPU with atleast 12GB+ of video memory.
v1.1
- Visual System
- Toggleable as a module
- Able to take new images or upload them directly for the AI to see
- Runs using Ooba, like with the text
- Can set the port to the existing, default one, or load another instance to dual wield
- Option to see images before being sent
- Can retake them
- Use C/X on the keyboard to confirm
- Automatically shrinks images to a proper size
- Fixed bits of the Minecraft module
- Configurable "MinecraftUsername" to set your AI's name (stops feedback loops)
- Configurable "MinecraftUsernameFollow" to set who your AI follows when doing "#follow"
---.---.---.---
V1.0
- Initial public release of Z-Waif. Contains:
- WebUI
- RAG
- Discord
- Semi-Minecraft Functionality
- VTuber Emotes
- Hotkeys
- Various other initial release items
Here is some documentation that you can look at. I am still in the process of making tutorials and documentation!
Credit to this other AI waifu project for making the original base code/skeleton used here!
- Make the RAG/Long Term Memory be multiprocessed for better performance
- Fix repetition issues at the end of speech to text Whisper by manually removing
- Look more into optimal LLMs and configs
- Fix issues where leaving the bot on for a while can cause a bit more lag between messages
- Fix issues where leaving the WebUI open a long time can freeze it and spike CPU usage
- Create more Youtube tutorials and other related content
- Create more documentation, both in the ReadMe and in the Google Doc