b30370bf4b
2048 maxtoken default
...
Almost everyone prefers 2048 max tokens because of the superior coherency. It should only be lower due to ram limits, but the menu already shows the optimal ram for 2048. Negatively effected users can turn it down themselves, for everyone else especially on rented machines or colab 2048 is a better default.
2022-05-27 01:23:48 +02:00
c692987e40
Fix an error that occurs when loading GPT-2 models
...
I forgot that this new_rebuild_tensor function's first argument's type
is different when loading GPT-2 models.
2022-05-20 14:54:49 -04:00
6ae7b48b69
Adding Nerys model 13B
2022-05-18 13:50:57 +02:00
f0df3de610
Adding Nerys model 2.7B
2022-05-16 09:50:45 +02:00
d5ab3ef5b1
Fix `no attribute get_checkpoint_shard_files`
2022-05-14 11:49:04 -04:00
1476e76cfc
Copy fp16 model files instead of resaving them
2022-05-14 00:45:43 -04:00
0c5ca5261e
Loading a sharded model will now display only one progress bar
2022-05-13 23:32:16 -04:00
f9f1a5f3a9
Make sure tqdm progress bars display properly in Colab
2022-05-13 17:37:45 -04:00
91d3672446
Proper progress bar for aria2 downloads
2022-05-13 17:00:10 -04:00
7ea0c49c1a
Merge pull request #128 from VE-FORBRYDERNE/opt
...
OPT breakmodel and TPU support
2022-05-13 18:07:02 +02:00
1200173386
Custom badwords for OPT
...
Generated using:
```
import transformers
tokenizer = transformers.AutoTokenizer.from_pretrained("facebook/opt-350m", fast=False)
badwordsids_opt = [[v] for k, v in tokenizer.vocab.items() if any(c in k for c in "<>[]")]
```
2022-05-13 10:45:28 -04:00
d5fa782483
NS Mode (comment fix)
2022-05-13 10:53:19 +02:00
8376f12e21
Add NS mode
...
OPT supports newlines, but it also needs some of the behavior we use in S mode. NS mode is a more limited version of S mode that still handles the </s> token, but instead of replacing it with a new line we replace it empty and newlines are not converted.
In future if your Fairseq style model has newline support use NS mode, while if it needs artifically inserted newlines use S mode. This also means that people finetuning fairseq models to include newlines might benefit from testing their models on ns mode.
2022-05-13 10:44:12 +02:00
55079f672a
Fix typo in soft prompt patching code
2022-05-13 01:51:55 -04:00
29bb3f569b
Fix a bug in OPTForCausalLM where self.lm_head is the wrong size
2022-05-13 01:37:17 -04:00
defbb53b68
OPT breakmodel
2022-05-13 01:03:38 -04:00
b1d8797a54
Allow TPU Colab to load sharded HF models
2022-05-12 23:51:40 -04:00
4fa5f1cd6a
Add TPU support for OPT-350M
...
The 350M model seems to have a different structure than the other ones ???
2022-05-12 22:21:15 -04:00
5c4a087970
Disable S mode for OPT
2022-05-13 01:47:59 +02:00
e98cc3cb16
OPT models
2022-05-12 23:55:21 +02:00
376e76f5da
S mode for OPT
2022-05-12 02:18:14 +02:00
46cfa1367f
Add `--no_aria2` command line flag
2022-05-11 00:44:56 -04:00
f09959f9be
Fix patching code of `PreTrainedModel.from_pretrained()`
2022-05-11 00:41:53 -04:00
4b49d1c464
Make sure `vars.revision` is defined
2022-05-10 22:51:36 -04:00
b97b2a02d6
Add `--revision` command line flag
2022-05-10 22:14:56 -04:00
937d9ee06a
Change default `model.save_pretrained` shard size to 500 MiB
2022-05-10 22:04:25 -04:00
a388c63023
Use aria2 to download split checkpoints
2022-05-10 21:28:13 -04:00
9c83ef7fa9
Replaced Adventure 125M and added C1-1.3B
2022-04-28 22:35:04 +00:00
ea82867e4d
Merge branch 'united' into settings
2022-04-26 13:58:01 -04:00
11280a6e66
LocalTunnel Linux Fix
2022-04-19 14:41:21 +02:00
b8e79afe5e
LocalTunnel support
2022-04-19 13:47:44 +02:00
c7b03398f6
Merge 'nolialsea/patch-1' into settings without Colab changes
2022-04-17 12:15:36 -04:00
372eb4c981
Merge pull request #119 from VE-FORBRYDERNE/scripting-sp
...
Allow userscripts to change the soft prompt
2022-04-14 21:33:20 +02:00
78d6ee491d
Merge pull request #117 from mrseeker/patch-7
...
Shinen FSD 13B (NSFW)
2022-04-14 21:33:08 +02:00
e180db88aa
Merge pull request #118 from VE-FORBRYDERNE/lazy-loader
...
Fix lazy loader in aiserver.py
2022-04-14 21:33:00 +02:00
bd6f7798b9
Fix lazy loader in aiserver.py
2022-04-14 14:33:10 -04:00
ad94f6c01c
Shinen FSD 13B (NSFW)
2022-04-14 08:23:50 +02:00
945c34e822
Shinen FSD 6.7B (NSFW)
2022-04-13 14:47:22 +02:00
eeff126df4
Memory Sizes
2022-04-13 12:41:21 +02:00
a3a52dc9c3
Add support for changing soft prompt from userscripts
2022-04-12 15:59:05 -04:00
26909e6cf3
Model Categories
2022-04-10 20:53:15 +02:00
6fcb0af488
Adding Janeway 13B
2022-04-10 15:03:39 +02:00
359a0a1c99
Copy Python 3.6 compatible lazy loader to aiserver.py
2022-04-08 19:40:12 -04:00
1974761f70
Releasing Janeway 6.7B
2022-04-08 08:13:36 +02:00
09fee52abd
Add `num_seqs` support to GooseAI/OpenAI client handler.
2022-04-07 14:50:23 -04:00
5feda462fb
OAI - Fixes last commit
2022-04-07 02:39:37 +02:00
34b6c907f0
OAI Max Token Slider
2022-04-07 02:26:15 +02:00
b568e31381
OAI Path Support
2022-04-06 05:15:25 +02:00
699b3fc10b
OAI Redo Fixes 2
2022-04-06 04:54:27 +02:00
b5a633e69b
OAI Redo Fix
2022-04-06 04:45:01 +02:00
Henk
Gnome Ann
Julius ter Pelkwijk
subtlewave
Wes Brown
Henky!!