Commit Graph

1175 Commits

Author SHA1 Message Date
henk717 2be1f5088f
Merge pull request #126 from VE-FORBRYDERNE/opt
Update OPT models and fix 20B model on TPU
2022-06-21 23:19:03 +02:00
Gnome Ann 33a2a318db Fix 20B TPU model 2022-06-21 17:16:01 -04:00
Gnome Ann a7e3ef71aa Add final layer norm to OPT 2022-06-21 16:36:26 -04:00
henk717 a10446f258
Merge pull request #123 from VE-FORBRYDERNE/tokenizer
Fix OPT tokenization problems
2022-06-18 11:38:14 +02:00
Gnome Ann 5e71f7fe97 Use slow tokenizer if fast tokenizer is not available 2022-06-17 21:08:37 -04:00
Gnome Ann f71bae254a Fix OPT tokenization problems 2022-06-17 13:29:42 -04:00
Henk 49a3cf132e Require accelerate
Transformers 4.20 now requires accelerate to be installed for some of the features we use in KoboldAI. This is now a required dependency for updated users.
2022-06-16 20:38:58 +02:00
Henk 3504581015 Transformers dependency bump
Makes transformers 4.20 mandatory in the dependency lists, not because the old versions are no longer supported but because it contains fixes that benefit our users and this makes it easier for them to update to it. If you stick to an older version the OPT and XGLM workarounds we have in place will remain functional, but you miss on the enhancements newer transformers versions bring.
2022-06-16 19:52:04 +02:00
henk717 3974e0a90c Remove broken chatbot models 2022-06-15 19:14:36 +02:00
Henk 661a2d2727 1.18.1 version bump
Since 1.18 Kobold had a few smaller features added, specifically the ability to re-order sampling options and a new sampler. Since it is a smaller addition a minor version bump was chosen since there are no breaking changes.
2022-06-15 00:55:12 +02:00
henk717 1ae410a7b0
Sampler Settings
This adds VE's changes to let users define the order of the samplers.
2022-06-15 00:49:09 +02:00
henk717 06c3a2a1fa
Merge pull request #146 from VE-FORBRYDERNE/sampler-order
Add support for changing the order of the samplers
2022-06-14 14:22:49 +02:00
Gnome Ann 6231106f95 Add Samplers menu 2022-06-13 20:18:09 -04:00
Gnome Ann 4c7d6f42d9 Add `sampler_order` to settings file 2022-06-13 19:14:38 -04:00
Gnome Ann 2d3db7b4ba Implement support for sampler order in the backend code 2022-06-13 19:12:23 -04:00
henk717 a273a5ebc4
Top A support
Smaller update adding Top-A support (also hides the chatbot models that have been removed by their author)
2022-06-12 15:28:19 +02:00
Henk 66c0dda485 Hide (Broken) Chatbot Models
Removing this option because they are currently unavailable. People who still have them can load them trough the load from file option. Once they have been retrained and reuploaded I will add the menu back.
2022-06-11 22:54:51 +02:00
Henk 5c81374a48 Top A for GooseAi 2022-06-11 22:04:37 +02:00
henk717 8a38b258f4
Merge pull request #145 from VE-FORBRYDERNE/top-a
Top-a sampling
2022-06-11 09:33:51 +02:00
Gnome Ann 42b7a327b2 Fix an unfortunate typo in top-a warper 2022-06-10 22:34:14 -04:00
Gnome Ann fdb2a7fa4c Top-A sampling 2022-06-10 22:28:20 -04:00
henk717 98c2aad072
Merge pull request #116 from VE-FORBRYDERNE/patch
Update list of versions with broken OPT again
2022-06-10 00:05:45 +02:00
Gnome Ann fe619d4677 Update list of versions with broken OPT again
They released another version of transformers that still doesn't have
the OPT patch so I decided it would be safer to just mark all 4.19
transformers versions as needing the OPT patch.
2022-06-09 17:42:46 -04:00
henk717 9bf4db2a7c
Mobile Friendly Userscript Selection
Mobile Friendly Userscript Selection
2022-06-06 19:01:12 +02:00
henk717 6708585271
Merge pull request #138 from VE-FORBRYDERNE/userscripts-menu
Allow clicking on userscripts to enable/disable them (mobile friendly)
2022-06-06 08:17:57 +02:00
Gnome Ann ce4a785449 Allow clicking on userscripts to enable/disable them (mobile friendly) 2022-06-05 21:06:09 -04:00
henk717 10d9ae88f3 Official as Default (TPU) 2022-06-04 13:41:09 +02:00
henk717 1c12d84554 Official as Default (GPU) 2022-06-04 13:11:54 +02:00
henk717 e15e42a1ce
Release of 1.18
Release of 1.18
2022-06-04 13:10:03 +02:00
henk717 dd84a22fa9 Model Descriptions (GPU) 2022-06-01 19:53:31 +02:00
henk717 18cf8e620e Model Descriptions (TPU) 2022-06-01 19:51:59 +02:00
Henk e5dcf91a08 Defaults Support
This adds support for loading settings from the defaults folder, settings are loaded in the following order and overwritten if needed by the higher number.

1. The model config file.
2. The defaults folder.
3. The users defined settings file.

With this support we can begin to ship better defaults for models we do not manage. Our community tuners have been most helpful at adding good defaults to their configuration files, but for other models such as the base models this gives us the flexibility to define better settings for each model without messing with a users desired settings if they already exist.
2022-06-01 10:34:16 +02:00
Henk 714fc1729b Updated model list 2022-06-01 10:20:24 +02:00
henk717 243543df13
Merge pull request #136 from VE-FORBRYDERNE/kaggle
Kaggle TPU support
2022-05-31 18:28:29 +02:00
Gnome Ann 707316de31 Kaggle TPU support 2022-05-31 12:20:16 -04:00
Henk 1a1f2f6428 30B ram requirements 2022-05-31 13:17:06 +02:00
Henk 004caa5ba7 Extra Icons
Green will probably be used by the offline installer, but lets also ship blue in case people want to make their own shortcuts.
2022-05-29 14:55:25 +02:00
henk717 a46ee07f3e
Merge pull request #135 from VE-FORBRYDERNE/opt
Update list of transformers versions that have broken OPT
2022-05-29 12:59:26 +02:00
Gnome Ann 69da5b7bc2 Update list of transformers versions that have broken OPT 2022-05-28 23:44:19 -04:00
Henk 52b977a3d3 Better Icon
Thanks to Spock for all the effort in refining it
2022-05-29 02:20:06 +02:00
henk717 3764149aef
Merge pull request #134 from VE-FORBRYDERNE/settings
Don't cap setting values when manually entered by user
2022-05-29 01:21:01 +02:00
Gnome Ann 1c4ae8877f Resolve merge conflict 2022-05-28 19:18:13 -04:00
Gnome Ann b9c6c0b3bd Out-of-bounds setting values are now shown in red 2022-05-28 19:14:26 -04:00
Henk 2798cf11da Hide drive error
Fixes a small issue where the user gets an error if the drive is not mounted.
2022-05-29 00:53:22 +02:00
Gnome Ann 69a28210e9 Don't cap setting values when manually entered by user 2022-05-28 18:33:57 -04:00
Henk 6ae12f29e4 (Un)Installer improvements
Inno Setup has proven limited in its ability to uninstall because its hard to keep up to date which folders it should ask or keep and not everyone has used the Offline Installer yet wishes to use an uninstaller. This commit adds a new uninstall script which my future versions of the uninstaller will look for to delete the files. Eliminating the risk of the setup accidentally deleting your stories.

If the proper Inno Setup uninstaller is detected the script will terminate itself and launch that first, to ensure the entire uninstallation is handled. If not, it will warn you before removing anything.

It will also get rid of the virtual KoboldAI drives and we can update it trough normal git means.
2022-05-29 00:25:53 +02:00
henk717 8ae0c8311b GPU Colab improvements 2022-05-28 19:52:06 +02:00
Henk 0ac36fff37 Merge branch 'united' of https://github.com/henk717/koboldai into united 2022-05-28 19:46:09 +02:00
Henk 97401026dd Nerys Description in Readme 2022-05-28 19:46:05 +02:00
henk717 bab0cd6362 Nerys Description 2022-05-28 19:45:32 +02:00