Commit Graph

76 Commits

Author SHA1 Message Date
Cohee 51b3b8bfaa Add smooth streaming 2024-04-02 14:56:15 +03:00
Cohee c3129da879 [skip ci] Lint fix 2024-02-07 19:28:34 +02:00
khanon 60044c18a4 Implement Token Probabilities UI using logprobs 2024-01-25 18:34:46 -06:00
Cohee b0a4341571
Merge pull request #1574 from artisticMink/feature/before-combine-event
Allow extensions to alter the context order.
2023-12-20 15:46:34 +02:00
maver 8d63ce5559 Log Novel Ai prompt to console
When prompt logging is enabled.
2023-12-19 19:27:24 +01:00
Cohee 08ea2095f8 Refactor Novel logit bias 2023-12-18 17:32:10 +02:00
Cohee b0e7b73a32 Fix streaming processor error handler hooks 2023-12-08 02:01:08 +02:00
valadaptive cdcd913805 Don't stream events if the API returned a 4xx code 2023-12-07 18:00:36 -05:00
valadaptive 5540c165cf Refactor server-sent events parsing
Create one server-sent events stream class which implements the entire
spec (different line endings, chunking, etc) and use it in all the
streaming generators.
2023-12-07 18:00:36 -05:00
Cohee 939e938ba2 Disallow multiswipe for quiet gens 2023-12-03 20:56:25 +02:00
Cohee 1786b0d340 #1403 Add Aphrodite multi-swipe 2023-12-03 20:40:09 +02:00
Cohee 676cc7731e #1436 Add unlock to response length 2023-12-03 18:30:21 +02:00
Cohee 64a3564892 lint: Comma dangle 2023-12-02 22:06:57 +02:00
Cohee c63cd87cc0 lint: Require semicolons 2023-12-02 21:11:06 +02:00
valadaptive a37f874e38 Require single quotes 2023-12-02 13:04:51 -05:00
valadaptive b023312117 Enable no-useless-escape lint 2023-12-02 10:32:26 -05:00
Cohee 61908935f5 Stop string for user-continue. Trim spaces after name2 2023-11-22 16:16:48 +02:00
Cohee f4630f9808 Add lastMessage macro. Substitute params in CFG negative prompts 2023-11-16 16:58:49 +02:00
RossAscends a5fd33d08a Kobold sampler restyle 2023-11-08 23:24:28 +09:00
Cohee b2629d9718 Refactor status checks and indicators. 2023-11-08 02:52:03 +02:00
Cohee 2018a6d94a #1325 Increase precision for Novel typical sampler 2023-11-06 23:43:30 +02:00
Cohee 78e1df28c1 #1325 Increase precision on freq/pres pen for Novel 2023-11-06 23:03:22 +02:00
Cohee 41211137fe #1325 Revert precision changes on some KAI/NAI sliders 2023-11-06 22:58:04 +02:00
Cohee 03e513a3e4 Fix slider formatting 2023-10-26 15:17:16 +03:00
Cohee beca613745 Revert Top P granularity 2023-10-26 15:11:38 +03:00
Cohee dcca49e848 Revert TFS granularity 2023-10-26 15:09:34 +03:00
RossAscends dd2d292a56 clean up NAI slider decimals 2023-10-26 20:46:09 +09:00
RossAscends d50124e937 appwide slider overhaul 2023-10-26 13:20:47 +09:00
Cohee a4ab898933 Move CFG scale to built-in functionality 2023-10-21 22:19:49 +03:00
Cohee 599904d589 Move NovelAI endpoints to separate file 2023-09-15 17:54:13 +03:00
Cohee 853736fa93 Remove legacy NovelAI models 2023-09-06 14:32:06 +03:00
Cohee 322511caa9 Remove legacy Pygmalion formatting, part 2 2023-09-06 14:19:29 +03:00
Cohee ded1e3a859 Add NAI Diffusion upscaling. Add Anlas guard and view Anlas button 2023-09-04 18:00:15 +03:00
Cohee 2199096191 Add error handling of NAI streaming. 2023-08-28 00:28:11 +03:00
Cohee 8bf679cba2 #1033 Promt => prompt 2023-08-27 19:24:28 +03:00
Cohee 961b3e1a78 Fix leading space in Novel bias + add additional parsing methods 2023-08-27 18:57:07 +03:00
Cohee 9d166db4ee Set rep pen range unlocked for bigger max context 2023-08-26 21:27:37 +03:00
Cohee 91d13efcef #1018 Round Typical P to 3rd decimal for Novel 2023-08-25 15:38:07 +03:00
Cohee f48cc0db31 Unify cfgValues parsing between ooba/Novel 2023-08-23 18:26:56 +03:00
Cohee e77da62b85 Add padding to cache key. Fix Safari display issues. Fix 400 on empty translate. Reset bias cache on changing model. 2023-08-23 10:32:48 +03:00
Cohee bc5fc67906 Put tokenizer functions to a separate file. Cache local models token counts 2023-08-23 02:38:43 +03:00
kingbri 25c7686462 CFG: Pass entire guidance object
If an API doesn't use the negative prompt from generate, allow
the negative prompt to be refetched in the specific API. This
requires the full guidance scale object instead of just the number.

Signed-off-by: kingbri <bdashore3@proton.me>
2023-08-22 10:17:20 -04:00
kingbri 60faaf1831 CFG: NAI fixes
NAI does CFG differently, so add special cases for them. Also gate
CFG access to only work on textgenwebui since that's where it's
implemented.

Signed-off-by: kingbri <bdashore3@proton.me>
2023-08-20 19:58:17 -04:00
Cohee 4ea9e481a8
Merge branch 'staging' into staging 2023-08-21 01:51:12 +03:00
Halsey1006 25b337f124
Update nai-settings.js
Does not add curly braces if Novel AI instruct format is already present in the supplied prompt.
2023-08-19 23:11:53 -07:00
kingbri 92e6c6a998 CFG: Use ST prompt builder for negatives
Make the generate function build a negative prompt in addition to the
normal one. This allows for nonconflicting insertion with other extension
prompts and World Info.

Signed-off-by: kingbri <bdashore3@proton.me>
2023-08-20 00:44:39 -04:00
kingbri 7191f7a8ad CFG: Add insertion depth and custom separator
Insertion depth allows for CFG to variably inject itself into the
negative prompt. This is similar to how Author's note works.

However, this method of insertion depth conflicts with AN and
world info where negatives can be meshed between two lines
of those specific insertions.

A custom separator must be wrapped in quotes, otherwise the default
separator is a newline for negative cascading.

Signed-off-by: kingbri <bdashore3@proton.me>
2023-08-19 01:29:59 -04:00
Cohee 0f162c1803 Save Novel preamble to presets 2023-08-18 17:43:50 +03:00
Cohee c4d8d70103 Improve phone usability of sortable drags 2023-08-18 13:41:46 +03:00
Cohee 1e0e5225ca Fix quiet prompt generations for Novel with streaming enabled. 2023-08-18 12:56:20 +03:00