rixty/KoboldAI-Client
1
1
Fork 0
mirror of https://github.com/KoboldAI/KoboldAI-Client.git synced 2025-06-05 21:59:24 +02:00
Code Issues Projects Releases Wiki Activity
4,599 Commits 1 Branch 5 Tags
4c03402e335c8cb7f27315412a8b0e648b93a41c
Commit Graph

4599 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
YellowRoseCx
73c06bf0a5 add adventuremode stopper 
adds a stopper token for adventure mode when it detects the bot generating impersonating text after " > You"
 2023-06-15 16:02:20 -05:00
henk717
f863d5db2d Merge pull request #373 from ebolam/Model_Plugins 
Making model backends respond to a specific type in the aiserver menu for now
 2023-06-14 02:13:44 +02:00
ebolam
abe07a2e95 Fix for model loading from paths 2023-06-13 20:05:50 -04:00
0cc4m
0c7eaefb1a Fix AMD ROCm exllama inference 2023-06-13 10:11:29 +02:00
ebolam
e2801fb5c1 Merge branch 'henk717:united' into Model_Plugins 2023-06-12 17:36:06 -04:00
ebolam
dfb097d048 Moving basic hf to a new branch 2023-06-12 17:35:34 -04:00
0cc4m
ebf7e2cf57 Update GPTQ module to 0.0.6 2023-06-12 08:27:30 +02:00
0cc4m
0001ae00ab Add v2 with bias support (e.g. for Tulu-30b) 2023-06-12 07:18:22 +02:00
0cc4m
12df8220fb Add gpt_bigcode support, fix 8-bit GPTQ incoherence 2023-06-12 07:14:36 +02:00
0cc4m
47b371b9d3 Fix multigpu 2023-06-06 19:51:38 +02:00
0cc4m
39dfb18455 Replace exllama samplers with kobold's inbuilt ones 2023-06-06 19:21:34 +02:00
0cc4m
94520d5c80 Fix exllama model unload 2023-06-05 18:43:57 +02:00
henk717
22b2a3f327 Merge pull request #371 from LostRuins/concedo_united 
updated kobold lite to v37
 2023-06-04 17:01:51 +02:00
Concedo
49a64fb655 updated kobold lite to v37 2023-06-04 22:27:52 +08:00
0cc4m
b35f61e987 Basic exllama plugin 2023-06-04 15:40:12 +02:00
Henk
4d213ddc51 Update drive disconnect fix 2023-06-04 14:12:00 +02:00
0cc4m
c82625490a Rename gptq backend folder 2023-06-04 12:31:24 +02:00
0cc4m
05a0bfe6c4 Don't show HF support if no HF model files are found 2023-06-04 09:44:28 +02:00
0cc4m
eace95cc72 Pull upstream changes, fix conflict 2023-06-04 09:06:31 +02:00
0cc4m
974328ed22 Add 4bit requirements to requirements.txt 2023-06-04 09:02:15 +02:00
0cc4m
b7838c7dde Fall back to autogptq if available and model not supported by gptq-koboldai 2023-06-04 08:06:48 +02:00
ebolam
ac265723e4 Merge branch 'henk717:united' into Model_Plugins 2023-06-03 11:08:00 -04:00
henk717
0ac2800601 Merge pull request #370 from Zurnaz/tpu_bfloat16 
fix: tpu support models saved in bfloat16
 2023-06-03 14:06:21 +02:00
Bogdan Drema
18dc706944 fix: tpu support models saved in bfloat16 2023-06-03 12:21:52 +01:00
ebolam
36530b1743 Well, it generates "Something" 2023-06-02 16:19:41 -04:00
ebolam
339f501600 Added model_backend_type to allow the current menu to specify a class of backends rather than a specific backend. 
Added super basic hf backend (testing phase only)
 2023-06-02 16:11:40 -04:00
henk717
8008a1c0b0 Merge pull request #369 from ebolam/Model_Plugins 
Fix for --nobreakmodel forcing CPU
 2023-06-02 19:35:05 +02:00
ebolam
5c4d580aac Fix for --nobreakmodel forcing CPU 
Put importing of colab packages into a if function so it doesn't error out
 2023-06-02 12:58:59 -04:00
henk717
856f16c0b2 Merge pull request #368 from LightSaveUs/united 
Reverting the RTE
 2023-06-02 14:45:04 +02:00
Henk
acfcde765b Allow breakmodel on Colab 2023-06-02 01:26:40 +02:00
LightSaveUs
e2c422aef8 Reverting the RTE (6B) 
VE was right, concedo is right
 2023-06-01 17:43:44 +03:00
LightSaveUs
077d64f6df Reverting the RTE (13B) 
VE was right, concedo is right
 2023-06-01 17:42:35 +03:00
LightSaveUs
cdf4098c97 Reverting the RTE (Custom) 
VE was right, concedo is right
 2023-06-01 17:40:42 +03:00
Henk
7d84466d9d Clean-up trust remote code 2023-05-31 22:48:29 +02:00
somebody
f326fc07e8 Seems to work 2023-05-31 14:42:05 -05:00
somebody
24b0b32829 Maybe works now...? 2023-05-31 14:31:08 -05:00
somebody
d0d215bb37 I have no idea why this was removed i swear it was there 2023-05-31 10:59:03 -05:00
somebody
ac4384ef75 Auto _no_split_modules 2023-05-31 10:55:46 -05:00
Henk
bda8c931f8 Horde backend fix 2023-05-31 16:56:08 +02:00
Henk
953f615e3d Conda deactivation fix 2023-05-31 02:29:26 +02:00
0cc4m
cf886de18b Remove leftover values fro koboldai_settings.py 2023-05-30 19:15:20 +02:00
Henk
c1abbf1473 More aggressive isolation 2023-05-30 12:56:22 +02:00
somebody
146806eba1 Remove old function 2023-05-29 13:36:15 -05:00
somebody
58ffad237b OPT hack 2023-05-29 13:34:11 -05:00
0cc4m
f1171dd3c1 Merge remote-tracking branch 'origin/united' into 4bit-plugin 2023-05-29 07:51:01 +02:00
henk717
bcee7113e5 Merge pull request #366 from ebolam/Model_Plugins 
Anti-malware, nobreakmodel, and css fix
 2023-05-29 00:43:54 +02:00
0cc4m
e49d35afc9 Add 4bit plugin 2023-05-28 22:54:36 +02:00
somebody
ceaefa9f5e Not quite 2023-05-28 14:57:45 -05:00
somebody
ed0728188a More cleaning 2023-05-28 13:22:32 -05:00
somebody
14241fc156 Speed 2023-05-28 13:03:24 -05:00