somebody
929917efe9
Remove shrieking
2023-07-24 13:09:43 -05:00
somebody
4a6cccb002
Import fix
2023-07-24 13:09:15 -05:00
somebody
a6aafb2525
GPTQ: Patch QuantLinear to not use CPU RAM
2023-07-24 13:07:30 -05:00
somebody
9cc6972c1c
Shh!
2023-07-24 11:30:33 -05:00
somebody
30640acca7
Editor: Don't allow editing or syncing during generation
...
Only bad things can come from that!
Also filter out stream buffer when fixing dirty game text (just in
case!)
2023-07-24 11:26:20 -05:00
somebody
fc7fa991d5
Streaming: Fix streaming not being cleaned up before commentator speaks
...
super duper critical
2023-07-24 10:57:24 -05:00
henk717
04a5e05692
Merge pull request #422 from one-some/fix-prioritization
...
Fix prioritization (probably)
2023-07-24 17:40:36 +02:00
somebody
2fb877db40
Backends: Probably fix sorting
2023-07-24 10:28:22 -05:00
somebody
81e4c8a807
Backends: Fix GPTQ priority
2023-07-24 10:25:44 -05:00
somebody
ba313883b6
Merge branch 'united' of https://github.com/henk717/KoboldAI into submit-ctx-menu
2023-07-24 10:09:38 -05:00
somebody
1df03d9a27
Basic
2023-07-23 20:54:04 -05:00
Henk
30495cf8d8
Fix GPT2
2023-07-24 02:05:07 +02:00
Henk
9fc9cb92f7
Fancy streaming by default
2023-07-24 01:39:16 +02:00
henk717
c60a29e544
Merge pull request #419 from one-some/streaming-fix-2
...
Rework single-gen streaming
2023-07-24 01:31:51 +02:00
Henk
70d2da55e5
Readme changes
2023-07-24 01:03:46 +02:00
somebody
1371150cbd
Merge branch 'united' of https://github.com/henk717/KoboldAI into wi-fixes
2023-07-23 18:00:28 -05:00
somebody
f4593ed04b
Streaming: Fix bad streamingwindow sync
...
sometimes the good solution is the best solution
2023-07-23 17:50:53 -05:00
somebody
8de610df8c
Streaming: Rework single-gen streaming
...
Now has its own packet and element seperate from actions. Fixes several
bugs related to desyncing. Also adds smooth typing effect
(fixes https://github.com/henk717/KoboldAI/issues/263 )
2023-07-23 17:32:52 -05:00
Henk
a963c97acb
Make 4-bit the default part 2
2023-07-24 00:06:20 +02:00
Henk
3409853dfc
Remove GPTQ for Colab
2023-07-23 23:26:35 +02:00
Henk
70dddf9fdc
Prioritize GPTQ
2023-07-23 23:22:02 +02:00
henk717
ae9ec38ae2
Merge pull request #418 from one-some/united
...
index prioritization
2023-07-23 23:09:42 +02:00
Henk
0f913275a9
4-bit as Default
2023-07-23 23:08:11 +02:00
somebody
3aa677ce11
Indexed prioritization
...
not a great way to get that data
2023-07-23 16:04:23 -05:00
Henk
89637ae9d7
GPTQ Requirements
2023-07-23 22:51:47 +02:00
henk717
1facc73b66
Merge pull request #367 from 0cc4m/4bit-plugin
...
GPTQ module
2023-07-23 22:32:20 +02:00
0cc4m
73953068c0
Remove exllama backend, pending further fixes
2023-07-23 22:12:31 +02:00
0cc4m
973aea12ea
Only import big python modules for GPTQ once they get used
2023-07-23 22:07:34 +02:00
0cc4m
49740aa5ab
Fix ntk alpha
2023-07-23 21:56:48 +02:00
Henk
e33a58b74a
Adventure stoppers = regex
2023-07-23 20:45:48 +02:00
henk717
d70481874c
Merge pull request #334 from YellowRoseCx/YellowRoseCx-advpatch-1
...
Add AdventureMode stopper
2023-07-23 20:38:51 +02:00
henk717
66fb8b8937
Merge pull request #415 from one-some/fixes-forever
...
Fixes forever
2023-07-23 20:05:38 +02:00
henk717
b3b67bf50d
Merge pull request #417 from LostRuins/concedo_united
...
updated lite to v50
2023-07-23 16:11:23 +02:00
Concedo
dd8e5f5d05
updated lite to v50
2023-07-23 21:40:08 +08:00
0cc4m
31a984aa3d
Automatically install exllama module
2023-07-23 07:33:51 +02:00
0cc4m
a9aa04fd1b
Merge remote-tracking branch 'upstream/united' into 4bit-plugin
2023-07-23 07:18:58 +02:00
0cc4m
09bb1021dd
Fallback to transformers if hf_bleeding_edge not available
2023-07-23 07:16:52 +02:00
0cc4m
748e5ef318
Add sliders for exllama context size and related methods
2023-07-23 07:11:28 +02:00
somebody
3995b3f93b
WI: Make delete button pretty
2023-07-22 18:18:21 -05:00
somebody
bd542336f9
WI: Make the noun thingey more intuitive
2023-07-22 18:12:30 -05:00
somebody
65cf6806a8
WI: Enter to save name
2023-07-22 18:04:35 -05:00
somebody
132ed1b507
UI: Make experimental tooltip more ominous
...
The current tooltip made it sound more like "beta features" than "pre
pre pre pre alpha features"
2023-07-22 17:53:28 -05:00
somebody
33cec5cc9c
UI: Fix visual inconsistancies in sidebar
2023-07-22 17:45:02 -05:00
somebody
432418ed1e
UI: Possibly more clear tooltips
2023-07-22 17:44:32 -05:00
somebody
ccbfad1a13
UI: Make welcome text links have underlines
...
Would love to make em' a different color but that would require going
through all the themes and im laaaazy
2023-07-22 17:35:16 -05:00
somebody
c7b128829c
WI: Fix visual oddness with more than one row of tags
2023-07-22 17:30:43 -05:00
somebody
6b26cbbd0a
Backends: Fix ReadOnly
...
Since somewhere in the pipeline ReadOnly is ignored, the bug wasn't
actually apparent unless using things like the Robot Button in WI cards.
2023-07-22 17:20:40 -05:00
somebody
68c6030ab0
WI: Don't explode when user uploads image without a save
...
This is a band-aid on an underlying problem: there is no save directory
to put blobs like images in before the user saves the game. The way
forward is probably to have an in-memory (no disk, Colab privacy (thats
kind of an oxymoron)) folder or something. I want to expand the data
storage functionality into an api in the future so devs can seamlessly
do something like:
Data.get_file_contents("image/blahblah.png")
and they won't have to actually worry about stuff like this
2023-07-22 17:04:45 -05:00
somebody
cf27d44f62
WI: Tag polish
...
- make the button thingeys look more button-ey
- enter now saves the focused tag and focuses the placeholder tag
- reduced code duplication for primary vs secondary and normal vs
placeholder tags
2023-07-22 16:50:29 -05:00
Henk
7a5d813b92
Reimplement HF workaround only for llama
2023-07-22 16:59:49 +02:00
