rixty/KoboldAI-Client
1
1
Fork 0
mirror of https://github.com/KoboldAI/KoboldAI-Client.git synced 2025-02-01 10:06:44 +01:00
Code Issues Projects Releases Wiki Activity

Compatibility Fixes

Browse Source 
Rather than coding a vars.custmodpath or vars.model in all the other parts of the code I opted to just set vars.custmodpath instead to make the behavior more consistent now that it always loads from the same location.
This commit is contained in:
henk717 2021-12-23 00:36:08 +01:00
parent f93d489971
commit 81120a0524
1 changed files with 4 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

5
aiserver.py
View File

@ -865,7 +865,10 @@ if(not vars.model in ["InferKit", "Colab", "OAI", "ReadOnly", "TPUMeshTransforme
if("/" not in vars.model and vars.model.lower().startswith("gpt2")): if("/" not in vars.model and vars.model.lower().startswith("gpt2")):
lowmem = {} lowmem = {}
# Is CUDA available? If so, use GPU, otherwise fall back to CPU # Make model path the same as the model name to make this consistent with the other loading method
vars.custmodpth = vars.model
# Download model from Huggingface if it does not exist, otherwise load locally
if(os.path.isdir(vars.model.replace('/', '_'))): if(os.path.isdir(vars.model.replace('/', '_'))):
with(maybe_use_float16()): with(maybe_use_float16()):