Llama
b28cc01dba
Change the maximum memory length to be based on the token budget
...
The maximum memory length was hardcoded to 512 tokens independent of
the overall context token budget. This was restrictive when the token
budget was increased, and excessive when the budget was decreased.
Based on feedback, this change modifies the max memory length to be 50%
of the context length. I tested with a memory consisting of the first
five paragraphs of The Three Musketeers, and the change seemed
reasonable with context lengths of 512, 1024 and 2048.
In order to minimize changes, this commit only modifies
max_memory_length; max_prompt_length and max_authornote_length are still
hardcoded as 512 tokens. We might want to make the max prompt length
flexible in the future, but since the author's note is injected into
the story, it's probably fine to restrict its length since a long
author's note will likely derail the AI.
2023-01-06 00:36:32 -08:00
somebody
7ff6c409f7
Fix probabilities on UI1
2022-12-21 17:23:35 -06:00
ebolam
99135acdea
Don't save host flag
2022-12-21 14:09:09 -05:00
ebolam
1409682427
Fix for some UI1 syncing issues
2022-12-21 13:41:59 -05:00
ebolam
bc9249adfc
Added one time warning system (Currently used to warn users of new save format)
2022-12-21 12:22:26 -05:00
ebolam
7521091e7c
Changed alt_multi_gen to experimental and UI2 only
2022-12-21 10:25:50 -05:00
ebolam
cd24766bf0
Fix for horde bridge folder rename
2022-12-21 08:38:44 -05:00
ebolam
c0f5a712ed
updating submodule
2022-12-21 08:14:13 -05:00
ebolam
5df401f56e
Fix for Original UI model load status box not disapearing after loading
...
Fix for gpt2 model load error
Moved horde bridge to a thread using modified bridge code (will be broken until push is accepted into db0's git)
2022-12-20 20:35:21 -05:00
ebolam
72281ea082
Fix for default model settings
2022-12-20 18:43:14 -05:00
ebolam
0744dea49d
Fix for pictures
2022-12-20 11:41:59 -05:00
ebolam
0983042953
Merge branch 'UI2' of https://github.com/ebolam/KoboldAI into UI2
2022-12-18 13:32:46 -05:00
ebolam
b5c39cf012
Minor fix
2022-12-18 13:32:41 -05:00
ebolam
8105de58a2
Set auto spacing to true by default
2022-12-18 11:14:56 -05:00
ebolam
c46dd588be
Fix for resetting models
2022-12-18 11:11:51 -05:00
somebody
2a556ea346
small commentator + WI image overhaul
2022-12-17 16:23:39 -06:00
ebolam
df23399a4a
Merge pull request #346 from one-some/ui2-fix-topk
...
Fix top-k and shortcuts
2022-12-16 21:18:36 -05:00
ebolam
c3438268e9
Fix for Original UI to use new save formats/code
2022-12-16 21:17:25 -05:00
somebody
9e6dcc7d6a
Fix top-k
2022-12-16 19:56:36 -06:00
ebolam
802bef8c37
Bug fix for probabilities (fixes issue 344)
2022-12-16 20:05:15 -05:00
ebolam
eabbd73bf3
Potential fix for setting action data crash (Issue 343)
2022-12-16 20:02:29 -05:00
ebolam
72c0a54f4e
Fix for probabilities code
2022-12-16 19:50:13 -05:00
ebolam
248994a610
Copy Paste Fix
2022-12-15 21:11:46 -05:00
ebolam
8dba339155
tweaked simple mode settings
2022-12-14 18:43:47 -05:00
ebolam
a7a6c10f6e
Added in image generation for actions (clicking on text will swap image to that generation)
2022-12-14 14:29:51 -05:00
ebolam
50f9508ee7
Merge branch 'UI2' of https://github.com/ebolam/KoboldAI into UI2
2022-12-14 09:21:40 -05:00
ebolam
a27651ef1b
Fix for world info duplication on loading story
...
Fix for dragging world info on top of new world info crashing
2022-12-14 09:15:59 -05:00
somebody
ff02a5444d
A bit more polish
2022-12-12 22:38:31 -06:00
somebody
3b23d1f9c8
And the rest
2022-12-12 19:19:28 -06:00
somebody
62d4ed8f3e
Add object_type as a WI parameter
2022-12-12 19:18:48 -06:00
somebody
3f037cda1f
Merge branch 'UI2' of https://github.com/ebolam/KoboldAI into ui2-story-review
2022-12-10 10:56:11 -06:00
somebody
68217a766b
Don't make story.json a directory
...
The price of programming while sleepy
2022-12-10 10:52:59 -06:00
somebody
0b9fe1c71f
Allow dicts to be synced, auto-upgrade story directories on load
2022-12-09 23:31:49 -06:00
somebody
d31ab1d648
Work on commentators
2022-12-09 23:31:28 -06:00
somebody
59864705f0
Recover easier from save shenanigans
2022-12-09 16:49:25 -06:00
somebody
f4c51b13e8
More details on load failure
2022-12-09 15:38:27 -06:00
ebolam
65c654cb2e
Update for slow text generation
2022-12-09 14:43:12 -05:00
ebolam
a140ce1f85
Fix for United Merge error
...
Test of tortoise TTS code (framework for any slower TTS engine)
2022-12-07 15:12:57 -05:00
ebolam
fcacd53b62
Fix for long prompt audio generation
2022-12-06 18:58:27 -05:00
ebolam
430be39fca
Final working token probability storage/transmit to UI.
2022-12-06 17:49:36 -05:00
ebolam
42026af675
Better probability support (multi-option without token streaming not working)
2022-12-06 14:33:59 -05:00
ebolam
645bdfe77d
Fix for initial audio generation to not generate the prompt first (should be last to gen)
2022-12-06 10:40:08 -05:00
ebolam
93890b9034
Alt generate mode is enabled. Each generation will be sequential allowing for lower VRAM usage at potentially slower generation time
2022-12-06 10:06:24 -05:00
ebolam
4b51d0abd8
Fix for long text
2022-12-06 08:45:27 -05:00
ebolam
dee494a301
Fix for empty text and audio generation
2022-12-06 08:12:43 -05:00
ebolam
1f62f154a5
Added functional audio generation (requires ffmpeg installed or ffmpeg.exe in koboldai directory)
...
added load v1 story conversion to saved v2 story if loaded from disk
2022-12-05 20:52:38 -05:00
ebolam
a8f8129c97
Fix for duplicate world info bug
2022-12-05 18:48:10 -05:00
ebolam
84cfba782c
Merge branch 'UI2' of https://github.com/ebolam/KoboldAI into UI2
2022-12-05 13:53:17 -05:00
ebolam
280c35b452
Added start to alternative multi-gen (linear instead of parallel). Non-functional
...
Continued stub for in UI soft prompt training.
Removed old xls to preset file code
2022-12-05 13:50:49 -05:00
somebody
9d228e6614
Add genre UI
2022-12-04 21:18:45 -06:00
