rixty/KoboldAI-Client
1
1
Fork 0
mirror of https://github.com/KoboldAI/KoboldAI-Client.git synced 2025-06-05 21:59:24 +02:00
Code Issues Projects Releases Wiki Activity
4,785 Commits 1 Branch 5 Tags
2edae09d063d00add98b78dd0b59be9d2c76296e
Commit Graph

4785 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Henk
85810cd3fd AutoGPTQ for Colab 2023-08-23 21:30:58 +02:00
Henk
c20ea949d7 Fix duplicate safetensors 2023-08-23 21:02:11 +02:00
Henk
91155ed2f3 HF dependencies 2023-08-23 20:34:40 +02:00
Llama
b1895de518 Merge pull request #63 from pi6am/feat/exllama-stoppers 
Add stopper hooks suppport to exllama
 2023-08-22 23:14:00 -07:00
Llama
b96d5d8646 Add stopper hooks suppport to exllama 2023-08-22 23:06:16 -07:00
Henk
f66173f2a0 Git gonna git 2023-08-22 20:43:44 +02:00
Henk
2b6dcbe55e New Horde Worker 2023-08-22 20:40:04 +02:00
Henk
3f438fda53 Scribe name instead of worker name 2023-08-22 18:56:23 +02:00
Henk
e5aca6fdad Cleaned horde 2023-08-22 18:43:29 +02:00
Henk
69c794506b HF 4.32 2023-08-22 17:48:00 +02:00
Henk
4b482a0619 Pending trick 2023-08-22 14:58:44 +02:00
Henk
b41bf99b55 Cleanup 2023-08-22 14:00:05 +02:00
Henk
179c4ad07f Restore UI 2023-08-22 13:58:02 +02:00
Henk
f570787077 Allow worker to stop 2023-08-22 13:38:28 +02:00
0cc4m
22fd49937a Merge pull request #62 from pi6am/fix/exllama-eos-space 
Strip the eos token from exllama generations.
 2023-08-22 08:06:02 +02:00
Henk
401cc1609a Kaiemb branch 2023-08-21 19:05:35 +02:00
db0
148a7c21b8 using stop() 2023-08-21 19:02:15 +02:00
Henk
d9815d4b1f New worker fixes 2023-08-21 17:52:21 +02:00
Henk
8abb5746f8 Add bridge back 2023-08-21 16:50:17 +02:00
Henk
7b8fba31f7 Git is stubborn 2023-08-21 16:46:02 +02:00
Henk
be8f527911 Horde URL fixes 2023-08-21 16:44:58 +02:00
Henk
a7251fa599 Bridge settings 2023-08-21 16:44:09 +02:00
Henk
e2d56db195 Fix bridge reference 2023-08-21 16:27:53 +02:00
db0
a655f8f066 adjust for stop mechanism 2023-08-21 15:56:27 +02:00
db0
45661ddc75 switch to AI Horde Worker 2023-08-21 15:52:17 +02:00
Henk
955db1567e Keep the usual temp folder instead of ours 2023-08-21 14:29:37 +02:00
Henk
57e5f51d63 AutoGPTQ for Colab 2023-08-21 14:08:14 +02:00
Henk
5917737676 Don't disable exllama 2023-08-21 13:17:30 +02:00
Henk
8daa2f1adc Update Optimum on Git HF 2023-08-21 02:01:34 +02:00
Henk
3dd0e91fbb Preliminary HF GPTQ changes 2023-08-21 01:58:52 +02:00
Llama
070cfd339a Strip the eos token from exllama generations. 
The end-of-sequence (</s>) token indicates the end of a generation.
When a token sequence containing </s> is decoded, an extra (wrong)
space is inserted at the beginning of the generation. To avoid this,
strip the eos token out of the result before returning it.
The eos token was getting stripped later, so this doesn't change
the output except to avoid the spurious leading space.
 2023-08-19 17:40:23 -07:00
Henk
6f557befa9 GPTQ --revision support 2023-08-19 15:17:29 +02:00
Henk
d93631c889 GPTQ improvements 2023-08-19 14:45:45 +02:00
Henk
13b68c67d1 Basic GPTQ Downloader 2023-08-19 13:02:50 +02:00
henk717
029e8736c0 Merge pull request #438 from one-some/another-api-fix 
More api fixes
 2023-08-19 02:43:38 +02:00
somebody
45486a47b0 WI: Fix UID keys being str 
...again
 2023-08-18 19:27:02 -05:00
Henk
80e784d3ea Polish 2023-08-19 01:39:31 +02:00
Henk
5ae64354ee NSFW menu updates 2023-08-19 01:20:09 +02:00
Henk
f8987cb2f0 Adventure ram update 2023-08-19 00:21:22 +02:00
Henk
79bc1d6610 First instruct batch 2023-08-18 23:15:21 +02:00
Henk
ff999657d2 Chat List Update 2023-08-18 22:42:15 +02:00
Llama
dda5acd5d5 Merge pull request #33 from henk717/united 
Merge united.
 2023-08-18 13:19:24 -07:00
Henk
87934ee393 AutoGPTQ Exllama compile 2023-08-18 21:49:05 +02:00
henk717
3f28503b87 Update huggingface.yml 2023-08-15 22:19:18 +02:00
somebody
213d7a55d4 Fixup 2023-08-14 13:30:22 -05:00
henk717
ebab774aab Add Holomax 2023-08-14 18:19:03 +02:00
somebody
19029939c2 API: somewhat-thoroughly automatically test WI api 2023-08-14 02:04:49 -05:00
somebody
4bd04d02ab Try to fix wi 2023-08-14 01:36:27 -05:00
somebody
b9da974eb7 GenericHFTorch: Change use_4_bit to quantization in __init__ 2023-08-14 00:56:40 -05:00
henk717
1c65528dbf Fix BnB on Colab 2023-08-14 03:28:29 +02:00