Commit Graph

1323 Commits

Author SHA1 Message Date
Gnome Ann ce4a785449 Allow clicking on userscripts to enable/disable them (mobile friendly) 2022-06-05 21:06:09 -04:00
henk717 10d9ae88f3 Official as Default (TPU) 2022-06-04 13:41:09 +02:00
henk717 1c12d84554 Official as Default (GPU) 2022-06-04 13:11:54 +02:00
henk717 e15e42a1ce
Release of 1.18
Release of 1.18
2022-06-04 13:10:03 +02:00
henk717 dd84a22fa9 Model Descriptions (GPU) 2022-06-01 19:53:31 +02:00
henk717 18cf8e620e Model Descriptions (TPU) 2022-06-01 19:51:59 +02:00
Henk e5dcf91a08 Defaults Support
This adds support for loading settings from the defaults folder, settings are loaded in the following order and overwritten if needed by the higher number.

1. The model config file.
2. The defaults folder.
3. The users defined settings file.

With this support we can begin to ship better defaults for models we do not manage. Our community tuners have been most helpful at adding good defaults to their configuration files, but for other models such as the base models this gives us the flexibility to define better settings for each model without messing with a users desired settings if they already exist.
2022-06-01 10:34:16 +02:00
Henk 714fc1729b Updated model list 2022-06-01 10:20:24 +02:00
Gnome Ann f2558e39d9 Fix JAX UnexpectedTracerError 2022-05-31 13:25:41 -04:00
henk717 243543df13
Merge pull request #136 from VE-FORBRYDERNE/kaggle
Kaggle TPU support
2022-05-31 18:28:29 +02:00
Gnome Ann 707316de31 Kaggle TPU support 2022-05-31 12:20:16 -04:00
Henk 1a1f2f6428 30B ram requirements 2022-05-31 13:17:06 +02:00
Henk 004caa5ba7 Extra Icons
Green will probably be used by the offline installer, but lets also ship blue in case people want to make their own shortcuts.
2022-05-29 14:55:25 +02:00
henk717 a46ee07f3e
Merge pull request #135 from VE-FORBRYDERNE/opt
Update list of transformers versions that have broken OPT
2022-05-29 12:59:26 +02:00
Gnome Ann 69da5b7bc2 Update list of transformers versions that have broken OPT 2022-05-28 23:44:19 -04:00
Henk 52b977a3d3 Better Icon
Thanks to Spock for all the effort in refining it
2022-05-29 02:20:06 +02:00
henk717 3764149aef
Merge pull request #134 from VE-FORBRYDERNE/settings
Don't cap setting values when manually entered by user
2022-05-29 01:21:01 +02:00
Gnome Ann 1c4ae8877f Resolve merge conflict 2022-05-28 19:18:13 -04:00
Gnome Ann b9c6c0b3bd Out-of-bounds setting values are now shown in red 2022-05-28 19:14:26 -04:00
Henk 2798cf11da Hide drive error
Fixes a small issue where the user gets an error if the drive is not mounted.
2022-05-29 00:53:22 +02:00
Gnome Ann 69a28210e9 Don't cap setting values when manually entered by user 2022-05-28 18:33:57 -04:00
Henk 6ae12f29e4 (Un)Installer improvements
Inno Setup has proven limited in its ability to uninstall because its hard to keep up to date which folders it should ask or keep and not everyone has used the Offline Installer yet wishes to use an uninstaller. This commit adds a new uninstall script which my future versions of the uninstaller will look for to delete the files. Eliminating the risk of the setup accidentally deleting your stories.

If the proper Inno Setup uninstaller is detected the script will terminate itself and launch that first, to ensure the entire uninstallation is handled. If not, it will warn you before removing anything.

It will also get rid of the virtual KoboldAI drives and we can update it trough normal git means.
2022-05-29 00:25:53 +02:00
henk717 8ae0c8311b GPU Colab improvements 2022-05-28 19:52:06 +02:00
Henk 0ac36fff37 Merge branch 'united' of https://github.com/henk717/koboldai into united 2022-05-28 19:46:09 +02:00
Henk 97401026dd Nerys Description in Readme 2022-05-28 19:46:05 +02:00
henk717 bab0cd6362 Nerys Description 2022-05-28 19:45:32 +02:00
Henk 4b65ce9c76 1.18 version bump 2022-05-28 19:39:05 +02:00
henk717 6e0510e1f5 Replaced Jax models with HF models where possible 2022-05-27 01:35:15 +02:00
Henk b30370bf4b 2048 maxtoken default
Almost everyone prefers 2048 max tokens because of the superior coherency. It should only be lower due to ram limits, but the menu already shows the optimal ram for 2048. Negatively effected users can turn it down themselves, for everyone else especially on rented machines or colab 2048 is a better default.
2022-05-27 01:23:48 +02:00
henk717 f47db6d155 Nerys 13B 2022-05-27 00:12:35 +02:00
Gnome Ann 793d788706 Preserve whitespace in the editor 2022-05-26 14:34:40 -04:00
henk717 4482e6db9a
Merge pull request #132 from VE-FORBRYDERNE/gpt2
Fix an error that occurs when loading GPT-2 models
2022-05-20 22:24:24 +01:00
Gnome Ann c692987e40 Fix an error that occurs when loading GPT-2 models
I forgot that this new_rebuild_tensor function's first argument's type
is different when loading GPT-2 models.
2022-05-20 14:54:49 -04:00
henk717 266308b086
Merge pull request #131 from mrseeker/patch-8
Adding Nerys model 13B
2022-05-18 13:55:03 +02:00
Julius ter Pelkwijk 6ae7b48b69
Adding Nerys model 13B 2022-05-18 13:50:57 +02:00
henk717 348fd1c4e2
Merge pull request #130 from mrseeker/patch-8
Adding Nerys model 2.7B
2022-05-16 11:45:01 +02:00
Julius ter Pelkwijk f0df3de610
Adding Nerys model 2.7B 2022-05-16 09:50:45 +02:00
henk717 24a2eb8c0b
Merge pull request #129 from VE-FORBRYDERNE/tqdm
Better model saving and better progress bars
2022-05-14 18:02:41 +02:00
Gnome Ann d4e8f56789 Remove debugging code from tpu_mtj_backend.py 2022-05-14 12:00:44 -04:00
Gnome Ann d5ab3ef5b1 Fix `no attribute get_checkpoint_shard_files` 2022-05-14 11:49:04 -04:00
Gnome Ann 6e82f205b4 Aria2 bug fix for Windows users 2022-05-14 11:44:28 -04:00
henk717 9eaa76c72b Add OPT 13B to the models 2022-05-14 07:55:47 +02:00
Gnome Ann 1476e76cfc Copy fp16 model files instead of resaving them 2022-05-14 00:45:43 -04:00
Gnome Ann 0c5ca5261e Loading a sharded model will now display only one progress bar 2022-05-13 23:32:16 -04:00
Gnome Ann f9f1a5f3a9 Make sure tqdm progress bars display properly in Colab 2022-05-13 17:37:45 -04:00
Gnome Ann 91d3672446 Proper progress bar for aria2 downloads 2022-05-13 17:00:10 -04:00
henk717 7ea0c49c1a
Merge pull request #128 from VE-FORBRYDERNE/opt
OPT breakmodel and TPU support
2022-05-13 18:07:02 +02:00
Gnome Ann a051bf4397 OPT breakmodel bug fix 2022-05-13 10:45:57 -04:00
Gnome Ann 1200173386 Custom badwords for OPT
Generated using:
```
import transformers
tokenizer = transformers.AutoTokenizer.from_pretrained("facebook/opt-350m", fast=False)
badwordsids_opt = [[v] for k, v in tokenizer.vocab.items() if any(c in k for c in "<>[]")]
```
2022-05-13 10:45:28 -04:00
Henk d5fa782483 NS Mode (comment fix) 2022-05-13 10:53:19 +02:00