Commit Graph

76 Commits

Author SHA1 Message Date
51b3b8bfaa Add smooth streaming 2024-04-02 14:56:15 +03:00
c3129da879 [skip ci] Lint fix 2024-02-07 19:28:34 +02:00
60044c18a4 Implement Token Probabilities UI using logprobs 2024-01-25 18:34:46 -06:00
b0a4341571 Merge pull request #1574 from artisticMink/feature/before-combine-event
Allow extensions to alter the context order.
2023-12-20 15:46:34 +02:00
8d63ce5559 Log Novel Ai prompt to console
When prompt logging is enabled.
2023-12-19 19:27:24 +01:00
08ea2095f8 Refactor Novel logit bias 2023-12-18 17:32:10 +02:00
b0e7b73a32 Fix streaming processor error handler hooks 2023-12-08 02:01:08 +02:00
cdcd913805 Don't stream events if the API returned a 4xx code 2023-12-07 18:00:36 -05:00
5540c165cf Refactor server-sent events parsing
Create one server-sent events stream class which implements the entire
spec (different line endings, chunking, etc) and use it in all the
streaming generators.
2023-12-07 18:00:36 -05:00
939e938ba2 Disallow multiswipe for quiet gens 2023-12-03 20:56:25 +02:00
1786b0d340 #1403 Add Aphrodite multi-swipe 2023-12-03 20:40:09 +02:00
676cc7731e #1436 Add unlock to response length 2023-12-03 18:30:21 +02:00
64a3564892 lint: Comma dangle 2023-12-02 22:06:57 +02:00
c63cd87cc0 lint: Require semicolons 2023-12-02 21:11:06 +02:00
a37f874e38 Require single quotes 2023-12-02 13:04:51 -05:00
b023312117 Enable no-useless-escape lint 2023-12-02 10:32:26 -05:00
61908935f5 Stop string for user-continue. Trim spaces after name2 2023-11-22 16:16:48 +02:00
f4630f9808 Add lastMessage macro. Substitute params in CFG negative prompts 2023-11-16 16:58:49 +02:00
a5fd33d08a Kobold sampler restyle 2023-11-08 23:24:28 +09:00
b2629d9718 Refactor status checks and indicators. 2023-11-08 02:52:03 +02:00
2018a6d94a #1325 Increase precision for Novel typical sampler 2023-11-06 23:43:30 +02:00
78e1df28c1 #1325 Increase precision on freq/pres pen for Novel 2023-11-06 23:03:22 +02:00
41211137fe #1325 Revert precision changes on some KAI/NAI sliders 2023-11-06 22:58:04 +02:00
03e513a3e4 Fix slider formatting 2023-10-26 15:17:16 +03:00
beca613745 Revert Top P granularity 2023-10-26 15:11:38 +03:00
dcca49e848 Revert TFS granularity 2023-10-26 15:09:34 +03:00
dd2d292a56 clean up NAI slider decimals 2023-10-26 20:46:09 +09:00
d50124e937 appwide slider overhaul 2023-10-26 13:20:47 +09:00
a4ab898933 Move CFG scale to built-in functionality 2023-10-21 22:19:49 +03:00
599904d589 Move NovelAI endpoints to separate file 2023-09-15 17:54:13 +03:00
853736fa93 Remove legacy NovelAI models 2023-09-06 14:32:06 +03:00
322511caa9 Remove legacy Pygmalion formatting, part 2 2023-09-06 14:19:29 +03:00
ded1e3a859 Add NAI Diffusion upscaling. Add Anlas guard and view Anlas button 2023-09-04 18:00:15 +03:00
2199096191 Add error handling of NAI streaming. 2023-08-28 00:28:11 +03:00
8bf679cba2 #1033 Promt => prompt 2023-08-27 19:24:28 +03:00
961b3e1a78 Fix leading space in Novel bias + add additional parsing methods 2023-08-27 18:57:07 +03:00
9d166db4ee Set rep pen range unlocked for bigger max context 2023-08-26 21:27:37 +03:00
91d13efcef #1018 Round Typical P to 3rd decimal for Novel 2023-08-25 15:38:07 +03:00
f48cc0db31 Unify cfgValues parsing between ooba/Novel 2023-08-23 18:26:56 +03:00
e77da62b85 Add padding to cache key. Fix Safari display issues. Fix 400 on empty translate. Reset bias cache on changing model. 2023-08-23 10:32:48 +03:00
bc5fc67906 Put tokenizer functions to a separate file. Cache local models token counts 2023-08-23 02:38:43 +03:00
25c7686462 CFG: Pass entire guidance object
If an API doesn't use the negative prompt from generate, allow
the negative prompt to be refetched in the specific API. This
requires the full guidance scale object instead of just the number.

Signed-off-by: kingbri <bdashore3@proton.me>
2023-08-22 10:17:20 -04:00
60faaf1831 CFG: NAI fixes
NAI does CFG differently, so add special cases for them. Also gate
CFG access to only work on textgenwebui since that's where it's
implemented.

Signed-off-by: kingbri <bdashore3@proton.me>
2023-08-20 19:58:17 -04:00
4ea9e481a8 Merge branch 'staging' into staging 2023-08-21 01:51:12 +03:00
25b337f124 Update nai-settings.js
Does not add curly braces if Novel AI instruct format is already present in the supplied prompt.
2023-08-19 23:11:53 -07:00
92e6c6a998 CFG: Use ST prompt builder for negatives
Make the generate function build a negative prompt in addition to the
normal one. This allows for nonconflicting insertion with other extension
prompts and World Info.

Signed-off-by: kingbri <bdashore3@proton.me>
2023-08-20 00:44:39 -04:00
7191f7a8ad CFG: Add insertion depth and custom separator
Insertion depth allows for CFG to variably inject itself into the
negative prompt. This is similar to how Author's note works.

However, this method of insertion depth conflicts with AN and
world info where negatives can be meshed between two lines
of those specific insertions.

A custom separator must be wrapped in quotes, otherwise the default
separator is a newline for negative cascading.

Signed-off-by: kingbri <bdashore3@proton.me>
2023-08-19 01:29:59 -04:00
0f162c1803 Save Novel preamble to presets 2023-08-18 17:43:50 +03:00
c4d8d70103 Improve phone usability of sortable drags 2023-08-18 13:41:46 +03:00
1e0e5225ca Fix quiet prompt generations for Novel with streaming enabled. 2023-08-18 12:56:20 +03:00