You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Download and extract KoboldCpp inside that folder and rename it to koboldcpp. Or open the CMD inside that folder and use this command git clone https://github.com/LostRuins/koboldcpp.git. You must have Git for Windows installed for this.
Install the Python with Add python.exe to PATH or Add Python to environment variables checked.
Install the Visual Studio with the Desktop development with C++ workload.
Install the CUDA Toolkit. If it fails to install, uncheck CUDA\Visual Studio Integration and all the CUDA\Nsight * during the installation. Then open the installation package with 7zip and extract all 4 files that are inside the visual_studio_integration\CUDAVisualStudioIntegration\extras\visual_studio_integration\MSBuildExtensions to your Visual Studio Microsoft Visual Studio\2022\Community\MSBuild\Microsoft\VC\v170\BuildCustomizations folder.
Install the latest release of w64devkit and add its path to the Windows' PATH environment variable or to the "make.bat" below like so: set PATH=c:\path\to\w64devkit\bin;%PATH%
Create a new file called make.bat inside the first "KoboldCpp" folder (not inside the extracted/cloned folder).
You can copy the make.bat and paste as shortcut. Now you can add additional commands to cmake like --fresh to clean the cmake cache. Open the shortcut properties and add a space followed by --fresh at the end of the target path.
Make clean
Here is a make clean.bat to delete all the build files.
make clean.bat
@echooffcd /d "%~dp0\koboldcpp"
make -s clean
rm -vrf build
The text was updated successfully, but these errors were encountered:
For anyone who got stuck like I did, you have to install cmake from https://cmake.org/download/ and change cmake ".." -G "MinGW Makefiles" --fresh in the build script to path\to\bin\cmake.exe ".." -G "MinGW Makefiles" --fresh, (replacing path\to\bin\cmake.exe to the cmake distribution you downloaded) otherwise it tries to use a version of cmake bundled with Visual Studio, which results in an error about there being no generator called "MinGW Makefiles". After that I was able to build successfully.
Setup
KoboldCpp
.koboldcpp
. Or open the CMD inside that folder and use this commandgit clone https://github.com/LostRuins/koboldcpp.git
. You must have Git for Windows installed for this.Add python.exe to PATH
orAdd Python to environment variables
checked.Desktop development with C++
workload.CUDA\Visual Studio Integration
and all theCUDA\Nsight *
during the installation. Then open the installation package with 7zip and extract all 4 files that are inside thevisual_studio_integration\CUDAVisualStudioIntegration\extras\visual_studio_integration\MSBuildExtensions
to your Visual StudioMicrosoft Visual Studio\2022\Community\MSBuild\Microsoft\VC\v170\BuildCustomizations
folder.set PATH=c:\path\to\w64devkit\bin;%PATH%
make.bat
inside the first "KoboldCpp" folder (not inside the extracted/cloned folder).make.bat
py -m koboldcpp
as usual.Bonus
Run KoboldCpp
Open Kobo's launcher.
koboldcpp.bat
Help file
You can call Kobo for help!
koboldcpp --help.bat
Cache clean
You can copy the
make.bat
and paste as shortcut. Now you can add additional commands to cmake like--fresh
to clean the cmake cache. Open the shortcut properties and add a space followed by--fresh
at the end of the target path.Make clean
Here is a
make clean.bat
to delete all the build files.make clean.bat
The text was updated successfully, but these errors were encountered: