Commit Graph

91 Commits

Author SHA1 Message Date
Cohee 961b3e1a78 Fix leading space in Novel bias + add additional parsing methods 2023-08-27 18:57:07 +03:00
Cohee 9d166db4ee Set rep pen range unlocked for bigger max context 2023-08-26 21:27:37 +03:00
Cohee 91d13efcef #1018 Round Typical P to 3rd decimal for Novel 2023-08-25 15:38:07 +03:00
Cohee f48cc0db31 Unify cfgValues parsing between ooba/Novel 2023-08-23 18:26:56 +03:00
Cohee e77da62b85 Add padding to cache key. Fix Safari display issues. Fix 400 on empty translate. Reset bias cache on changing model. 2023-08-23 10:32:48 +03:00
Cohee bc5fc67906 Put tokenizer functions to a separate file. Cache local models token counts 2023-08-23 02:38:43 +03:00
kingbri 25c7686462 CFG: Pass entire guidance object
If an API doesn't use the negative prompt from generate, allow
the negative prompt to be refetched in the specific API. This
requires the full guidance scale object instead of just the number.

Signed-off-by: kingbri <bdashore3@proton.me>
2023-08-22 10:17:20 -04:00
kingbri 60faaf1831 CFG: NAI fixes
NAI does CFG differently, so add special cases for them. Also gate
CFG access to only work on textgenwebui since that's where it's
implemented.

Signed-off-by: kingbri <bdashore3@proton.me>
2023-08-20 19:58:17 -04:00
Cohee 4ea9e481a8
Merge branch 'staging' into staging 2023-08-21 01:51:12 +03:00
Halsey1006 25b337f124
Update nai-settings.js
Does not add curly braces if Novel AI instruct format is already present in the supplied prompt.
2023-08-19 23:11:53 -07:00
kingbri 92e6c6a998 CFG: Use ST prompt builder for negatives
Make the generate function build a negative prompt in addition to the
normal one. This allows for nonconflicting insertion with other extension
prompts and World Info.

Signed-off-by: kingbri <bdashore3@proton.me>
2023-08-20 00:44:39 -04:00
kingbri 7191f7a8ad CFG: Add insertion depth and custom separator
Insertion depth allows for CFG to variably inject itself into the
negative prompt. This is similar to how Author's note works.

However, this method of insertion depth conflicts with AN and
world info where negatives can be meshed between two lines
of those specific insertions.

A custom separator must be wrapped in quotes, otherwise the default
separator is a newline for negative cascading.

Signed-off-by: kingbri <bdashore3@proton.me>
2023-08-19 01:29:59 -04:00
Cohee 0f162c1803 Save Novel preamble to presets 2023-08-18 17:43:50 +03:00
Cohee c4d8d70103 Improve phone usability of sortable drags 2023-08-18 13:41:46 +03:00
Cohee 1e0e5225ca Fix quiet prompt generations for Novel with streaming enabled. 2023-08-18 12:56:20 +03:00
Cohee 80092b3170 #790 Simplify local prompt formatting. Use handlebars to render story string. 2023-08-17 22:47:34 +03:00
Cohee 86a486be8f Adjust Novel instruction prompts for quiet generation 2023-08-17 17:40:38 +03:00
Cohee 0b412033ba Streamline and simply Novel logit bias. Make it a part of preset 2023-08-17 13:05:22 +03:00
Mike Weldon 722801bb50 Add logit biases for NovelAI 2023-08-16 22:14:04 -07:00
Cohee 1f2394cada Apply preset manager for NovelAI 2023-08-16 21:43:38 +03:00
Cohee 81ed4d8431 Reorderable samplers for Novel 2023-08-16 20:34:47 +03:00
Mike Weldon feb523bd01 NovelAI Kayra 1.1 update
* Updated some presets and added Cosmic Cube
* Change defaults for NovelAI to select Clio on cold start
* Automatically change the preset to an appropriate default whenever you change the model
* Removed deprecated Top G sampler
2023-08-15 18:52:29 -07:00
Cohee 57b9a94c17 Add banned tokens for Novel 2023-08-15 15:51:14 +03:00
Mike Weldon 41ec7e5600 Many NovelAI fixes from dev guidance
* Remove AI Module "Autoselect" and make the auto-instruct work for all modules. This is how NAI is supposed to work.
* Log the response from the API.
* Move the AI Module setting up to the top of the settings window since it isn't part of the preset.
* Refactor phrase_rep_pen to use the actual API strings.
* Clamp the maximum token length to 150 before we call the API.
* Clamp the minimum token length in the UX from 1 to 150.
* Fix bug where the preamble was not initialized on cold start.
* Get rid of extra newline before dinkus.
* Make always_force_name2 default true.
2023-08-14 19:35:21 -07:00
Cohee edcce96a6e IndexedDB open sometime hangs forever 2023-08-14 19:40:31 +03:00
Cohee 8c759e87cf Better UI control for phrase rep pen 2023-08-14 19:00:36 +03:00
Cohee 9b8d069e3b Apply CFG extension for Novel 2023-08-13 15:38:07 +03:00
Cohee dd21091807 Selectable NovelAI module 2023-08-12 21:26:51 +03:00
Cohee1207 092846e0bc #924 Replace Novel Kayra subtier context 2023-08-12 14:21:05 +03:00
Mike Weldon a0573413b2 Add new NAI samplers and update presets 2023-08-11 17:58:40 -07:00
Cohee 104d983449 Adjust novel max context calculation 2023-08-10 19:15:52 +03:00
Mike Weldon 079b1623c5 NovelAI preamble code cleanup 2023-08-03 18:27:23 -07:00
Mike Weldon c8b5b7da22 Use prose augmenter by default for Kayra 2023-08-02 23:07:17 -07:00
Mike Weldon 1d0f67c144 Add NAI preamble to start of chat buffer 2023-08-02 18:22:06 -07:00
gd1551 ea800d1550 Add stop sequences support to NovelAI generations 2023-08-02 22:42:11 +03:00
Mike Weldon 9dba57dc85 Fix minor typo that broke phraseRepPen for NAI 2023-07-29 15:59:18 -07:00
Cohee 314b194891 Remove preset reloading when setting is NaN 2023-07-29 21:24:29 +03:00
Mike Weldon 732707ae2b Turn on instruct mode for NAI 2023-07-28 22:56:31 -07:00
Mike Weldon b107848ccb Add Kayra presets 2023-07-28 17:23:28 -07:00
Cohee 1b9ca4c9d9 Unhide advanced parameters for Novel 2023-07-23 02:09:03 +03:00
Cohee edd41989fd Initial commit 2023-07-20 20:32:15 +03:00