Cohee
51b3b8bfaa
Add smooth streaming
2024-04-02 14:56:15 +03:00
Cohee
c3129da879
[skip ci] Lint fix
2024-02-07 19:28:34 +02:00
khanon
60044c18a4
Implement Token Probabilities UI using logprobs
2024-01-25 18:34:46 -06:00
Cohee
b0a4341571
Merge pull request #1574 from artisticMink/feature/before-combine-event
...
Allow extensions to alter the context order.
2023-12-20 15:46:34 +02:00
maver
8d63ce5559
Log Novel Ai prompt to console
...
When prompt logging is enabled.
2023-12-19 19:27:24 +01:00
Cohee
08ea2095f8
Refactor Novel logit bias
2023-12-18 17:32:10 +02:00
Cohee
b0e7b73a32
Fix streaming processor error handler hooks
2023-12-08 02:01:08 +02:00
valadaptive
cdcd913805
Don't stream events if the API returned a 4xx code
2023-12-07 18:00:36 -05:00
valadaptive
5540c165cf
Refactor server-sent events parsing
...
Create one server-sent events stream class which implements the entire
spec (different line endings, chunking, etc) and use it in all the
streaming generators.
2023-12-07 18:00:36 -05:00
Cohee
939e938ba2
Disallow multiswipe for quiet gens
2023-12-03 20:56:25 +02:00
Cohee
1786b0d340
#1403 Add Aphrodite multi-swipe
2023-12-03 20:40:09 +02:00
Cohee
676cc7731e
#1436 Add unlock to response length
2023-12-03 18:30:21 +02:00
Cohee
64a3564892
lint: Comma dangle
2023-12-02 22:06:57 +02:00
Cohee
c63cd87cc0
lint: Require semicolons
2023-12-02 21:11:06 +02:00
valadaptive
a37f874e38
Require single quotes
2023-12-02 13:04:51 -05:00
valadaptive
b023312117
Enable no-useless-escape lint
2023-12-02 10:32:26 -05:00
Cohee
61908935f5
Stop string for user-continue. Trim spaces after name2
2023-11-22 16:16:48 +02:00
Cohee
f4630f9808
Add lastMessage macro. Substitute params in CFG negative prompts
2023-11-16 16:58:49 +02:00
RossAscends
a5fd33d08a
Kobold sampler restyle
2023-11-08 23:24:28 +09:00
Cohee
b2629d9718
Refactor status checks and indicators.
2023-11-08 02:52:03 +02:00
Cohee
2018a6d94a
#1325 Increase precision for Novel typical sampler
2023-11-06 23:43:30 +02:00
Cohee
78e1df28c1
#1325 Increase precision on freq/pres pen for Novel
2023-11-06 23:03:22 +02:00
Cohee
41211137fe
#1325 Revert precision changes on some KAI/NAI sliders
2023-11-06 22:58:04 +02:00
Cohee
03e513a3e4
Fix slider formatting
2023-10-26 15:17:16 +03:00
Cohee
beca613745
Revert Top P granularity
2023-10-26 15:11:38 +03:00
Cohee
dcca49e848
Revert TFS granularity
2023-10-26 15:09:34 +03:00
RossAscends
dd2d292a56
clean up NAI slider decimals
2023-10-26 20:46:09 +09:00
RossAscends
d50124e937
appwide slider overhaul
2023-10-26 13:20:47 +09:00
Cohee
a4ab898933
Move CFG scale to built-in functionality
2023-10-21 22:19:49 +03:00
Cohee
599904d589
Move NovelAI endpoints to separate file
2023-09-15 17:54:13 +03:00
Cohee
853736fa93
Remove legacy NovelAI models
2023-09-06 14:32:06 +03:00
Cohee
322511caa9
Remove legacy Pygmalion formatting, part 2
2023-09-06 14:19:29 +03:00
Cohee
ded1e3a859
Add NAI Diffusion upscaling. Add Anlas guard and view Anlas button
2023-09-04 18:00:15 +03:00
Cohee
2199096191
Add error handling of NAI streaming.
2023-08-28 00:28:11 +03:00
Cohee
8bf679cba2
#1033 Promt => prompt
2023-08-27 19:24:28 +03:00
Cohee
961b3e1a78
Fix leading space in Novel bias + add additional parsing methods
2023-08-27 18:57:07 +03:00
Cohee
9d166db4ee
Set rep pen range unlocked for bigger max context
2023-08-26 21:27:37 +03:00
Cohee
91d13efcef
#1018 Round Typical P to 3rd decimal for Novel
2023-08-25 15:38:07 +03:00
Cohee
f48cc0db31
Unify cfgValues parsing between ooba/Novel
2023-08-23 18:26:56 +03:00
Cohee
e77da62b85
Add padding to cache key. Fix Safari display issues. Fix 400 on empty translate. Reset bias cache on changing model.
2023-08-23 10:32:48 +03:00
Cohee
bc5fc67906
Put tokenizer functions to a separate file. Cache local models token counts
2023-08-23 02:38:43 +03:00
kingbri
25c7686462
CFG: Pass entire guidance object
...
If an API doesn't use the negative prompt from generate, allow
the negative prompt to be refetched in the specific API. This
requires the full guidance scale object instead of just the number.
Signed-off-by: kingbri <bdashore3@proton.me>
2023-08-22 10:17:20 -04:00
kingbri
60faaf1831
CFG: NAI fixes
...
NAI does CFG differently, so add special cases for them. Also gate
CFG access to only work on textgenwebui since that's where it's
implemented.
Signed-off-by: kingbri <bdashore3@proton.me>
2023-08-20 19:58:17 -04:00
Cohee
4ea9e481a8
Merge branch 'staging' into staging
2023-08-21 01:51:12 +03:00
Halsey1006
25b337f124
Update nai-settings.js
...
Does not add curly braces if Novel AI instruct format is already present in the supplied prompt.
2023-08-19 23:11:53 -07:00
kingbri
92e6c6a998
CFG: Use ST prompt builder for negatives
...
Make the generate function build a negative prompt in addition to the
normal one. This allows for nonconflicting insertion with other extension
prompts and World Info.
Signed-off-by: kingbri <bdashore3@proton.me>
2023-08-20 00:44:39 -04:00
kingbri
7191f7a8ad
CFG: Add insertion depth and custom separator
...
Insertion depth allows for CFG to variably inject itself into the
negative prompt. This is similar to how Author's note works.
However, this method of insertion depth conflicts with AN and
world info where negatives can be meshed between two lines
of those specific insertions.
A custom separator must be wrapped in quotes, otherwise the default
separator is a newline for negative cascading.
Signed-off-by: kingbri <bdashore3@proton.me>
2023-08-19 01:29:59 -04:00
Cohee
0f162c1803
Save Novel preamble to presets
2023-08-18 17:43:50 +03:00
Cohee
c4d8d70103
Improve phone usability of sortable drags
2023-08-18 13:41:46 +03:00
Cohee
1e0e5225ca
Fix quiet prompt generations for Novel with streaming enabled.
2023-08-18 12:56:20 +03:00