rixty/KoboldAI-Client
1
1
Fork 0
mirror of https://github.com/KoboldAI/KoboldAI-Client.git synced 2025-06-05 21:59:24 +02:00
Code Issues Projects Releases Wiki Activity

Added model_backend_type to allow the current menu to specify a class of backends rather than a specific backend.

Browse Source 
Added super basic hf backend (testing phase only)
This commit is contained in:
ebolam
2023-06-02 16:11:40 -04:00
parent 5c4d580aac
commit 339f501600
10 changed files with 184 additions and 15 deletions
Download Patch File Download Diff File Expand all files Collapse all files

1
modeling/inference_models/api/class.py
View File

@@ -19,6 +19,7 @@ from modeling.inference_model import (
)
model_backend_name = "KoboldAI API"
model_backend_type = "KoboldAI API" #This should be a generic name in case multiple model backends are compatible (think Hugging Face Custom and Basic Hugging Face)
class APIException(Exception):
"""To be used for errors when using the Kobold API as an interface."""