rixty/KoboldAI-Client
1
1
Fork 0
mirror of https://github.com/KoboldAI/KoboldAI-Client.git synced 2025-06-05 21:59:24 +02:00
Code Issues Projects Releases Wiki Activity
4,533 Commits 1 Branch 5 Tags
e90903946dbdc76768753128fa6efd42b9ae0cec
Commit Graph

4533 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
somebody
c80de5120c Cleanup 2023-07-24 19:45:33 -05:00
somebody
ad4528b5a6 critical change 2023-07-24 17:17:57 -05:00
somebody
a73420c49c really really really sketchy breakmodel implementation 
im gonna go lie down for an extended period of time
 2023-07-24 17:15:59 -05:00
somebody
ec040620ec Merge branch 'united' of https://github.com/henk717/KoboldAI into qptq-lazy 2023-07-24 13:26:16 -05:00
somebody
34aa333c44 Last debug 2023-07-24 13:11:06 -05:00
somebody
43a4abaf63 Remove even more debug 2023-07-24 13:10:33 -05:00
somebody
929917efe9 Remove shrieking 2023-07-24 13:09:43 -05:00
somebody
4a6cccb002 Import fix 2023-07-24 13:09:15 -05:00
somebody
a6aafb2525 GPTQ: Patch QuantLinear to not use CPU RAM 2023-07-24 13:07:30 -05:00
somebody
9cc6972c1c Shh! 2023-07-24 11:30:33 -05:00
somebody
30640acca7 Editor: Don't allow editing or syncing during generation 
Only bad things can come from that!

Also filter out stream buffer when fixing dirty game text (just in
case!)
 2023-07-24 11:26:20 -05:00
somebody
fc7fa991d5 Streaming: Fix streaming not being cleaned up before commentator speaks 
super duper critical
 2023-07-24 10:57:24 -05:00
henk717
04a5e05692 Merge pull request #422 from one-some/fix-prioritization 
Fix prioritization (probably)
 2023-07-24 17:40:36 +02:00
somebody
2fb877db40 Backends: Probably fix sorting 2023-07-24 10:28:22 -05:00
somebody
81e4c8a807 Backends: Fix GPTQ priority 2023-07-24 10:25:44 -05:00
somebody
ba313883b6 Merge branch 'united' of https://github.com/henk717/KoboldAI into submit-ctx-menu 2023-07-24 10:09:38 -05:00
somebody
1df03d9a27 Basic 2023-07-23 20:54:04 -05:00
Henk
30495cf8d8 Fix GPT2 2023-07-24 02:05:07 +02:00
Henk
9fc9cb92f7 Fancy streaming by default 2023-07-24 01:39:16 +02:00
henk717
c60a29e544 Merge pull request #419 from one-some/streaming-fix-2 
Rework single-gen streaming
 2023-07-24 01:31:51 +02:00
Henk
70d2da55e5 Readme changes 2023-07-24 01:03:46 +02:00
somebody
1371150cbd Merge branch 'united' of https://github.com/henk717/KoboldAI into wi-fixes 2023-07-23 18:00:28 -05:00
somebody
f4593ed04b Streaming: Fix bad streamingwindow sync 
sometimes the good solution is the best solution
 2023-07-23 17:50:53 -05:00
somebody
8de610df8c Streaming: Rework single-gen streaming 
Now has its own packet and element seperate from actions. Fixes several
bugs related to desyncing. Also adds smooth typing effect
(fixes https://github.com/henk717/KoboldAI/issues/263)
 2023-07-23 17:32:52 -05:00
Henk
a963c97acb Make 4-bit the default part 2 2023-07-24 00:06:20 +02:00
Henk
3409853dfc Remove GPTQ for Colab 2023-07-23 23:26:35 +02:00
Henk
70dddf9fdc Prioritize GPTQ 2023-07-23 23:22:02 +02:00
henk717
ae9ec38ae2 Merge pull request #418 from one-some/united 
index prioritization
 2023-07-23 23:09:42 +02:00
Henk
0f913275a9 4-bit as Default 2023-07-23 23:08:11 +02:00
somebody
3aa677ce11 Indexed prioritization 
not a great way to get that data
 2023-07-23 16:04:23 -05:00
Henk
89637ae9d7 GPTQ Requirements 2023-07-23 22:51:47 +02:00
henk717
1facc73b66 Merge pull request #367 from 0cc4m/4bit-plugin 
GPTQ module
 2023-07-23 22:32:20 +02:00
0cc4m
73953068c0 Remove exllama backend, pending further fixes 2023-07-23 22:12:31 +02:00
0cc4m
973aea12ea Only import big python modules for GPTQ once they get used 2023-07-23 22:07:34 +02:00
0cc4m
49740aa5ab Fix ntk alpha 2023-07-23 21:56:48 +02:00
Henk
e33a58b74a Adventure stoppers = regex 2023-07-23 20:45:48 +02:00
henk717
d70481874c Merge pull request #334 from YellowRoseCx/YellowRoseCx-advpatch-1 
Add AdventureMode stopper
 2023-07-23 20:38:51 +02:00
henk717
66fb8b8937 Merge pull request #415 from one-some/fixes-forever 
Fixes forever
 2023-07-23 20:05:38 +02:00
henk717
b3b67bf50d Merge pull request #417 from LostRuins/concedo_united 
updated lite to v50
 2023-07-23 16:11:23 +02:00
Concedo
dd8e5f5d05 updated lite to v50 2023-07-23 21:40:08 +08:00
0cc4m
31a984aa3d Automatically install exllama module 2023-07-23 07:33:51 +02:00
0cc4m
a9aa04fd1b Merge remote-tracking branch 'upstream/united' into 4bit-plugin 2023-07-23 07:18:58 +02:00
0cc4m
09bb1021dd Fallback to transformers if hf_bleeding_edge not available 2023-07-23 07:16:52 +02:00
0cc4m
748e5ef318 Add sliders for exllama context size and related methods 2023-07-23 07:11:28 +02:00
somebody
3995b3f93b WI: Make delete button pretty 2023-07-22 18:18:21 -05:00
somebody
bd542336f9 WI: Make the noun thingey more intuitive 2023-07-22 18:12:30 -05:00
somebody
65cf6806a8 WI: Enter to save name 2023-07-22 18:04:35 -05:00
somebody
132ed1b507 UI: Make experimental tooltip more ominous 
The current tooltip made it sound more like "beta features" than "pre
pre pre pre alpha features"
 2023-07-22 17:53:28 -05:00
somebody
33cec5cc9c UI: Fix visual inconsistancies in sidebar 2023-07-22 17:45:02 -05:00
somebody
432418ed1e UI: Possibly more clear tooltips 2023-07-22 17:44:32 -05:00