From 2009f24345bb6685e6c5436388b940fa72505c9f Mon Sep 17 00:00:00 2001 From: KoboldAI Dev Date: Mon, 3 May 2021 00:56:29 -0400 Subject: [PATCH] Updated readme with GPU/CUDA support instructions --- readme.txt | 12 +++++++++++- 1 file changed, 11 insertions(+), 1 deletion(-) diff --git a/readme.txt b/readme.txt index 759ee6bd..3871ba46 100644 --- a/readme.txt +++ b/readme.txt @@ -47,4 +47,14 @@ You can see your remaining budget for generated characters on their website unde If you see strange numeric tags in the console output, then your console of choice does not have color support enabled. On Windows 10, you can enable color support by lanching the registry editor and adding the REG_DWORD key VirtualTerminalLevel to Computer\HKEY_CURRENT_USER\Console and setting -its value to 1. \ No newline at end of file +its value to 1. + +[ENABLE GPU FOR SUPPORTED VIDEO CARDS] + +1. Install NVidia CUDA toolkit from https://developer.nvidia.com/cuda-10.2-download-archive +2. Visit PyTorch's website(https://pytorch.org/get-started/locally/) and select Pip under "Package" +and your version of CUDA under "Compute Platform" (I linked 10.2) to get the pip3 command. +3. Copy and paste pip3 command into command prompt to install torch with GPU support + +Be aware that when using GPU mode, inference will be MUCH faster but if your GPU doesn't have enough +VRAM to load the model it will crash the application. \ No newline at end of file