rixty/KoboldAI-Client
1
1
Fork 0
mirror of https://github.com/KoboldAI/KoboldAI-Client.git synced 2025-06-05 21:59:24 +02:00
Code Issues Projects Releases Wiki Activity

Fix for model loading by moving monkey patching functions into a run-once function

Browse Source 
Added folder navigation to custom model loading (Needs prittying)
This commit is contained in:
ebolam
2022-06-08 18:42:44 -04:00
parent 190869f0d3
commit 622a3fc8db
4 changed files with 357 additions and 287 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
utils.py
View File

@ -149,7 +149,7 @@ def decodenewlines(txt):
# Returns number of layers given an HF model config
#==================================================================#
def num_layers(config):
return config.num_layers if hasattr(config, "num_layers") else config.n_layer if hasattr(config, "n_layer") else config.num_hidden_layers
return config.num_layers if hasattr(config, "num_layers") else config.n_layer if hasattr(config, "n_layer") else config.num_hidden_layers if hasattr(config, 'num_hidden_layers') else None
#==================================================================#
# Downloads huggingface checkpoints using aria2c if possible