rixty/KoboldAI-Client
1
1
Fork 0
mirror of https://github.com/KoboldAI/KoboldAI-Client.git synced 2024-12-28 17:20:17 +01:00
Code Issues Projects Releases Wiki Activity

Updated readme with GPU/CUDA support instructions

Browse Source
This commit is contained in:
KoboldAI Dev 2021-05-03 00:56:29 -04:00
parent ace2b2db12
commit 2009f24345
1 changed files with 11 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

12
readme.txt
View File

@ -47,4 +47,14 @@ You can see your remaining budget for generated characters on their website unde
If you see strange numeric tags in the console output, then your console of choice does not have
color support enabled. On Windows 10, you can enable color support by lanching the registry editor
and adding the REG_DWORD key VirtualTerminalLevel to Computer\HKEY_CURRENT_USER\Console and setting
its value to 1.
its value to 1.
[ENABLE GPU FOR SUPPORTED VIDEO CARDS]
1. Install NVidia CUDA toolkit from https://developer.nvidia.com/cuda-10.2-download-archive
2. Visit PyTorch's website(https://pytorch.org/get-started/locally/) and select Pip under "Package"
and your version of CUDA under "Compute Platform" (I linked 10.2) to get the pip3 command.
3. Copy and paste pip3 command into command prompt to install torch with GPU support
Be aware that when using GPU mode, inference will be MUCH faster but if your GPU doesn't have enough
VRAM to load the model it will crash the application.