A light Docker build for KoboldCPP

1. Simply bring your own models into the /models folder
2. Start Docker
3. Start the build

chmod 555 build_kobold.sh
./build_kobold.sh

4. You can adjust the start_program.sh bash script. It simply contains the runtime settings passed into the koboldcpp.py Python module

Default module settings in the bash script now:

• model ggml-model-q4_0.bin
• launch
• threads 6
• contextsize 2048
• stream
• smartcontext
• usemirostat 2 0.5 0.1
• usemlock
• debugmode