1199 Commits

Author SHA1 Message Date
vfbd
6ba7429eea Don't add sentence spacing if submission is empty
When you retry, it actually sends an empty submission, so if you have
add sentence spacing on, retrying could add an extra action with a
single space.

(cherry picked from commit 151407a001651c70f49a0c659957d80a36ec2a8a)
2022-06-26 14:06:18 -04:00
vfbd
9d09ae5fea Clean up whitespace in the editor as well
(cherry picked from commit 6e138db1c0be03768e1c1297668260614011b9e1)
2022-06-26 14:05:04 -04:00
vfbd
2a4d37ce60 Clean up whitespace at the end of actions when loading story
Specifically, we merge blank actions into the next action and we move
whitespace at the end of non-blank actions to the beginning of the next
action.

(cherry picked from commit 4b16600e49a24f9d43c16d9517eb0acfc9539313)
2022-06-26 14:04:36 -04:00
vfbd
e30abd209f Preserve whitespace in the editor
(cherry picked from commit 793d788706a7a35adb53fb0d22c6b629a9c1d215)
2022-06-26 14:04:16 -04:00
Henk
9e7eb80db4 Nerys V2 part 2 2022-06-25 14:03:19 +02:00
Henk
ecc6ee9474 Nerys V2 2022-06-25 13:47:49 +02:00
henk717
a2d2ea0735 Typo Fix 2022-06-25 13:14:27 +02:00
henk717
2495b9380d Nerys V2 2022-06-25 13:08:30 +02:00
Henk
8be0964427 AIDG Import Fix 2022-06-24 18:29:06 +02:00
henk717
27e16aecf2 Model Cleaner (suggested by Shrinkarom) 2022-06-24 14:03:58 +02:00
henk717
c3af92e9af Koboldai.org | New NeoX | Cloudflare 2022-06-24 10:43:06 +02:00
henk717
ec0bc1cc17
Merge pull request #130 from VE-FORBRYDERNE/neox-badwords
GPT-NeoX HF model badwords fix
2022-06-23 21:05:42 +02:00
vfbd
3da885d408 GPT-NeoX HF model badwords fix 2022-06-23 15:02:43 -04:00
henk717
d94f29a68a
Merge pull request #127 from VE-FORBRYDERNE/tracer
Fix JAX UnexpectedTracerError
2022-06-23 19:29:51 +02:00
henk717
1d41966d88
Merge pull request #129 from VE-FORBRYDERNE/budget
Account for lnheader in budget calculation
2022-06-23 12:39:20 +02:00
vfbd
0eb9f8a879 Account for lnheader in budget calculation 2022-06-22 19:16:24 -04:00
henk717
5f9a116052
Merge pull request #128 from VE-FORBRYDERNE/neox
TPU support for HF GPT-NeoX model
2022-06-22 01:39:53 +02:00
Gnome Ann
8c594c6869 Correct the padding token for GPT-NeoX 2022-06-21 19:37:43 -04:00
Gnome Ann
a7f667c34c Use NeoX badwords when loading from HF GPT-NeoX model 2022-06-21 19:33:25 -04:00
Gnome Ann
5e3c7c07ae Merge branch 'main' into neox 2022-06-21 19:30:51 -04:00
Henk
75bc472a9f Transformers bump to 4.20.1
Transformers issued an important change for the OPT models breaking their compatibility with all older versions. In order for people to be able to use all models on the menu they need 4.20.1 so this is now forced in the dependencies making the update easier.
2022-06-21 23:33:38 +02:00
henk717
2be1f5088f
Merge pull request #126 from VE-FORBRYDERNE/opt
Update OPT models and fix 20B model on TPU
2022-06-21 23:19:03 +02:00
Gnome Ann
33a2a318db Fix 20B TPU model 2022-06-21 17:16:01 -04:00
Gnome Ann
a7e3ef71aa Add final layer norm to OPT 2022-06-21 16:36:26 -04:00
henk717
a10446f258
Merge pull request #123 from VE-FORBRYDERNE/tokenizer
Fix OPT tokenization problems
2022-06-18 11:38:14 +02:00
Gnome Ann
5e71f7fe97 Use slow tokenizer if fast tokenizer is not available 2022-06-17 21:08:37 -04:00
Gnome Ann
f71bae254a Fix OPT tokenization problems 2022-06-17 13:29:42 -04:00
Henk
49a3cf132e Require accelerate
Transformers 4.20 now requires accelerate to be installed for some of the features we use in KoboldAI. This is now a required dependency for updated users.
2022-06-16 20:38:58 +02:00
Henk
3504581015 Transformers dependency bump
Makes transformers 4.20 mandatory in the dependency lists, not because the old versions are no longer supported but because it contains fixes that benefit our users and this makes it easier for them to update to it. If you stick to an older version the OPT and XGLM workarounds we have in place will remain functional, but you miss on the enhancements newer transformers versions bring.
2022-06-16 19:52:04 +02:00
henk717
3974e0a90c Remove broken chatbot models 2022-06-15 19:14:36 +02:00
Henk
661a2d2727 1.18.1 version bump
Since 1.18 Kobold had a few smaller features added, specifically the ability to re-order sampling options and a new sampler. Since it is a smaller addition a minor version bump was chosen since there are no breaking changes.
2022-06-15 00:55:12 +02:00
henk717
1ae410a7b0
Sampler Settings
This adds VE's changes to let users define the order of the samplers.
2022-06-15 00:49:09 +02:00
henk717
06c3a2a1fa
Merge pull request #146 from VE-FORBRYDERNE/sampler-order
Add support for changing the order of the samplers
2022-06-14 14:22:49 +02:00
Gnome Ann
6231106f95 Add Samplers menu 2022-06-13 20:18:09 -04:00
Gnome Ann
4c7d6f42d9 Add sampler_order to settings file 2022-06-13 19:14:38 -04:00
Gnome Ann
2d3db7b4ba Implement support for sampler order in the backend code 2022-06-13 19:12:23 -04:00
henk717
a273a5ebc4
Top A support
Smaller update adding Top-A support (also hides the chatbot models that have been removed by their author)
2022-06-12 15:28:19 +02:00
Henk
66c0dda485 Hide (Broken) Chatbot Models
Removing this option because they are currently unavailable. People who still have them can load them trough the load from file option. Once they have been retrained and reuploaded I will add the menu back.
2022-06-11 22:54:51 +02:00
Henk
5c81374a48 Top A for GooseAi 2022-06-11 22:04:37 +02:00
henk717
8a38b258f4
Merge pull request #145 from VE-FORBRYDERNE/top-a
Top-a sampling
2022-06-11 09:33:51 +02:00
Gnome Ann
42b7a327b2 Fix an unfortunate typo in top-a warper 2022-06-10 22:34:14 -04:00
Gnome Ann
fdb2a7fa4c Top-A sampling 2022-06-10 22:28:20 -04:00
henk717
98c2aad072
Merge pull request #116 from VE-FORBRYDERNE/patch
Update list of versions with broken OPT again
2022-06-10 00:05:45 +02:00
Gnome Ann
fe619d4677 Update list of versions with broken OPT again
They released another version of transformers that still doesn't have
the OPT patch so I decided it would be safer to just mark all 4.19
transformers versions as needing the OPT patch.
2022-06-09 17:42:46 -04:00
henk717
9bf4db2a7c
Mobile Friendly Userscript Selection
Mobile Friendly Userscript Selection
2022-06-06 19:01:12 +02:00
henk717
6708585271
Merge pull request #138 from VE-FORBRYDERNE/userscripts-menu
Allow clicking on userscripts to enable/disable them (mobile friendly)
2022-06-06 08:17:57 +02:00
Gnome Ann
ce4a785449 Allow clicking on userscripts to enable/disable them (mobile friendly) 2022-06-05 21:06:09 -04:00
henk717
10d9ae88f3 Official as Default (TPU) 2022-06-04 13:41:09 +02:00
henk717
1c12d84554 Official as Default (GPU) 2022-06-04 13:11:54 +02:00
henk717
e15e42a1ce
Release of 1.18
Release of 1.18
2022-06-04 13:10:03 +02:00