Commit Graph

1205 Commits

Author SHA1 Message Date
vfbd accbaea991 Fix a problem where a story with only the prompt cannot be edited 2022-06-30 11:08:22 -04:00
henk717 856e8d5c86
Merge pull request #133 from VE-FORBRYDERNE/whitespace
Fix the cleanupChunkWhitespace function
2022-06-28 18:22:24 +02:00
vfbd d55b4d9bbc Fix the cleanupChunkWhitespace function 2022-06-28 12:18:57 -04:00
henk717 ad9ec6eaba
Merge pull request #132 from VE-FORBRYDERNE/whitespace-cleanup
Story whitespace cleanup backport
2022-06-26 20:35:50 +02:00
vfbd 6576f5c01d Make sure editor changes are applied before submitting
(cherry picked from commit ae41ad298c)
2022-06-26 14:06:57 -04:00
vfbd ebba79fed6 Remove trailing whitespace from submissions
(cherry picked from commit b99d1449c9)
2022-06-26 14:06:34 -04:00
vfbd 6ba7429eea Don't add sentence spacing if submission is empty
When you retry, it actually sends an empty submission, so if you have
add sentence spacing on, retrying could add an extra action with a
single space.

(cherry picked from commit 151407a001)
2022-06-26 14:06:18 -04:00
vfbd 9d09ae5fea Clean up whitespace in the editor as well
(cherry picked from commit 6e138db1c0)
2022-06-26 14:05:04 -04:00
vfbd 2a4d37ce60 Clean up whitespace at the end of actions when loading story
Specifically, we merge blank actions into the next action and we move
whitespace at the end of non-blank actions to the beginning of the next
action.

(cherry picked from commit 4b16600e49)
2022-06-26 14:04:36 -04:00
vfbd e30abd209f Preserve whitespace in the editor
(cherry picked from commit 793d788706)
2022-06-26 14:04:16 -04:00
Henk 9e7eb80db4 Nerys V2 part 2 2022-06-25 14:03:19 +02:00
Henk ecc6ee9474 Nerys V2 2022-06-25 13:47:49 +02:00
henk717 a2d2ea0735 Typo Fix 2022-06-25 13:14:27 +02:00
henk717 2495b9380d Nerys V2 2022-06-25 13:08:30 +02:00
Henk 8be0964427 AIDG Import Fix 2022-06-24 18:29:06 +02:00
henk717 27e16aecf2 Model Cleaner (suggested by Shrinkarom) 2022-06-24 14:03:58 +02:00
henk717 c3af92e9af Koboldai.org | New NeoX | Cloudflare 2022-06-24 10:43:06 +02:00
henk717 ec0bc1cc17
Merge pull request #130 from VE-FORBRYDERNE/neox-badwords
GPT-NeoX HF model badwords fix
2022-06-23 21:05:42 +02:00
vfbd 3da885d408 GPT-NeoX HF model badwords fix 2022-06-23 15:02:43 -04:00
henk717 d94f29a68a
Merge pull request #127 from VE-FORBRYDERNE/tracer
Fix JAX UnexpectedTracerError
2022-06-23 19:29:51 +02:00
henk717 1d41966d88
Merge pull request #129 from VE-FORBRYDERNE/budget
Account for lnheader in budget calculation
2022-06-23 12:39:20 +02:00
vfbd 0eb9f8a879 Account for lnheader in budget calculation 2022-06-22 19:16:24 -04:00
henk717 5f9a116052
Merge pull request #128 from VE-FORBRYDERNE/neox
TPU support for HF GPT-NeoX model
2022-06-22 01:39:53 +02:00
Gnome Ann 8c594c6869 Correct the padding token for GPT-NeoX 2022-06-21 19:37:43 -04:00
Gnome Ann a7f667c34c Use NeoX badwords when loading from HF GPT-NeoX model 2022-06-21 19:33:25 -04:00
Gnome Ann 5e3c7c07ae Merge branch 'main' into neox 2022-06-21 19:30:51 -04:00
Henk 75bc472a9f Transformers bump to 4.20.1
Transformers issued an important change for the OPT models breaking their compatibility with all older versions. In order for people to be able to use all models on the menu they need 4.20.1 so this is now forced in the dependencies making the update easier.
2022-06-21 23:33:38 +02:00
henk717 2be1f5088f
Merge pull request #126 from VE-FORBRYDERNE/opt
Update OPT models and fix 20B model on TPU
2022-06-21 23:19:03 +02:00
Gnome Ann 33a2a318db Fix 20B TPU model 2022-06-21 17:16:01 -04:00
Gnome Ann a7e3ef71aa Add final layer norm to OPT 2022-06-21 16:36:26 -04:00
henk717 a10446f258
Merge pull request #123 from VE-FORBRYDERNE/tokenizer
Fix OPT tokenization problems
2022-06-18 11:38:14 +02:00
Gnome Ann 5e71f7fe97 Use slow tokenizer if fast tokenizer is not available 2022-06-17 21:08:37 -04:00
Gnome Ann f71bae254a Fix OPT tokenization problems 2022-06-17 13:29:42 -04:00
Henk 49a3cf132e Require accelerate
Transformers 4.20 now requires accelerate to be installed for some of the features we use in KoboldAI. This is now a required dependency for updated users.
2022-06-16 20:38:58 +02:00
Henk 3504581015 Transformers dependency bump
Makes transformers 4.20 mandatory in the dependency lists, not because the old versions are no longer supported but because it contains fixes that benefit our users and this makes it easier for them to update to it. If you stick to an older version the OPT and XGLM workarounds we have in place will remain functional, but you miss on the enhancements newer transformers versions bring.
2022-06-16 19:52:04 +02:00
henk717 3974e0a90c Remove broken chatbot models 2022-06-15 19:14:36 +02:00
Henk 661a2d2727 1.18.1 version bump
Since 1.18 Kobold had a few smaller features added, specifically the ability to re-order sampling options and a new sampler. Since it is a smaller addition a minor version bump was chosen since there are no breaking changes.
2022-06-15 00:55:12 +02:00
henk717 1ae410a7b0
Sampler Settings
This adds VE's changes to let users define the order of the samplers.
2022-06-15 00:49:09 +02:00
henk717 06c3a2a1fa
Merge pull request #146 from VE-FORBRYDERNE/sampler-order
Add support for changing the order of the samplers
2022-06-14 14:22:49 +02:00
Gnome Ann 6231106f95 Add Samplers menu 2022-06-13 20:18:09 -04:00
Gnome Ann 4c7d6f42d9 Add `sampler_order` to settings file 2022-06-13 19:14:38 -04:00
Gnome Ann 2d3db7b4ba Implement support for sampler order in the backend code 2022-06-13 19:12:23 -04:00
henk717 a273a5ebc4
Top A support
Smaller update adding Top-A support (also hides the chatbot models that have been removed by their author)
2022-06-12 15:28:19 +02:00
Henk 66c0dda485 Hide (Broken) Chatbot Models
Removing this option because they are currently unavailable. People who still have them can load them trough the load from file option. Once they have been retrained and reuploaded I will add the menu back.
2022-06-11 22:54:51 +02:00
Henk 5c81374a48 Top A for GooseAi 2022-06-11 22:04:37 +02:00
henk717 8a38b258f4
Merge pull request #145 from VE-FORBRYDERNE/top-a
Top-a sampling
2022-06-11 09:33:51 +02:00
Gnome Ann 42b7a327b2 Fix an unfortunate typo in top-a warper 2022-06-10 22:34:14 -04:00
Gnome Ann fdb2a7fa4c Top-A sampling 2022-06-10 22:28:20 -04:00
henk717 98c2aad072
Merge pull request #116 from VE-FORBRYDERNE/patch
Update list of versions with broken OPT again
2022-06-10 00:05:45 +02:00
Gnome Ann fe619d4677 Update list of versions with broken OPT again
They released another version of transformers that still doesn't have
the OPT patch so I decided it would be safer to just mark all 4.19
transformers versions as needing the OPT patch.
2022-06-09 17:42:46 -04:00