765 Commits

Author SHA1 Message Date
Henk
8376f12e21 Add NS mode
OPT supports newlines, but it also needs some of the behavior we use in S mode. NS mode is a more limited version of S mode that still handles the </s> token, but instead of replacing it with a new line we replace it empty and newlines are not converted.

In future if your Fairseq style model has newline support use NS mode, while if it needs artifically inserted newlines use S mode. This also means that people finetuning fairseq models to include newlines might benefit from testing their models on ns mode.
2022-05-13 10:44:12 +02:00
Gnome Ann
55079f672a Fix typo in soft prompt patching code 2022-05-13 01:51:55 -04:00
Gnome Ann
29bb3f569b Fix a bug in OPTForCausalLM where self.lm_head is the wrong size 2022-05-13 01:37:17 -04:00
Gnome Ann
defbb53b68 OPT breakmodel 2022-05-13 01:03:38 -04:00
Gnome Ann
b1d8797a54 Allow TPU Colab to load sharded HF models 2022-05-12 23:51:40 -04:00
Gnome Ann
4fa5f1cd6a Add TPU support for OPT-350M
The 350M model seems to have a different structure than the other ones ???
2022-05-12 22:21:15 -04:00
Henk
5c4a087970 Disable S mode for OPT 2022-05-13 01:47:59 +02:00
Henk
e98cc3cb16 OPT models 2022-05-12 23:55:21 +02:00
Henk
376e76f5da S mode for OPT 2022-05-12 02:18:14 +02:00
Gnome Ann
46cfa1367f Add --no_aria2 command line flag 2022-05-11 00:44:56 -04:00
Gnome Ann
f09959f9be Fix patching code of PreTrainedModel.from_pretrained() 2022-05-11 00:41:53 -04:00
Gnome Ann
4b49d1c464 Make sure vars.revision is defined 2022-05-10 22:51:36 -04:00
Gnome Ann
b97b2a02d6 Add --revision command line flag 2022-05-10 22:14:56 -04:00
Gnome Ann
937d9ee06a Change default model.save_pretrained shard size to 500 MiB 2022-05-10 22:04:25 -04:00
Gnome Ann
a388c63023 Use aria2 to download split checkpoints 2022-05-10 21:28:13 -04:00
subtlewave
9c83ef7fa9
Replaced Adventure 125M and added C1-1.3B 2022-04-28 22:35:04 +00:00
Gnome Ann
ea82867e4d Merge branch 'united' into settings 2022-04-26 13:58:01 -04:00
Henk
11280a6e66 LocalTunnel Linux Fix 2022-04-19 14:41:21 +02:00
Henk
b8e79afe5e LocalTunnel support 2022-04-19 13:47:44 +02:00
Gnome Ann
c7b03398f6 Merge 'nolialsea/patch-1' into settings without Colab changes 2022-04-17 12:15:36 -04:00
henk717
372eb4c981
Merge pull request #119 from VE-FORBRYDERNE/scripting-sp
Allow userscripts to change the soft prompt
2022-04-14 21:33:20 +02:00
henk717
78d6ee491d
Merge pull request #117 from mrseeker/patch-7
Shinen FSD 13B (NSFW)
2022-04-14 21:33:08 +02:00
henk717
e180db88aa
Merge pull request #118 from VE-FORBRYDERNE/lazy-loader
Fix lazy loader in aiserver.py
2022-04-14 21:33:00 +02:00
Gnome Ann
bd6f7798b9 Fix lazy loader in aiserver.py 2022-04-14 14:33:10 -04:00
Julius ter Pelkwijk
ad94f6c01c
Shinen FSD 13B (NSFW) 2022-04-14 08:23:50 +02:00
Julius ter Pelkwijk
945c34e822
Shinen FSD 6.7B (NSFW) 2022-04-13 14:47:22 +02:00
Henk
eeff126df4 Memory Sizes 2022-04-13 12:41:21 +02:00
Gnome Ann
a3a52dc9c3 Add support for changing soft prompt from userscripts 2022-04-12 15:59:05 -04:00
Henk
26909e6cf3 Model Categories 2022-04-10 20:53:15 +02:00
Julius ter Pelkwijk
6fcb0af488
Adding Janeway 13B 2022-04-10 15:03:39 +02:00
Gnome Ann
359a0a1c99 Copy Python 3.6 compatible lazy loader to aiserver.py 2022-04-08 19:40:12 -04:00
Julius ter Pelkwijk
1974761f70
Releasing Janeway 6.7B 2022-04-08 08:13:36 +02:00
Wes Brown
09fee52abd Add num_seqs support to GooseAI/OpenAI client handler. 2022-04-07 14:50:23 -04:00
Henky!!
5feda462fb OAI - Fixes last commit 2022-04-07 02:39:37 +02:00
Henky!!
34b6c907f0 OAI Max Token Slider 2022-04-07 02:26:15 +02:00
Henky!!
b568e31381 OAI Path Support 2022-04-06 05:15:25 +02:00
Henky!!
699b3fc10b OAI Redo Fixes 2 2022-04-06 04:54:27 +02:00
Henky!!
b5a633e69b OAI Redo Fix 2022-04-06 04:45:01 +02:00
henk717
ee682702ee
Merge branch 'KoboldAI:main' into united 2022-04-05 01:35:22 +02:00
Henky!!
8153f21d5c Convo 6B 2022-04-05 01:33:51 +02:00
Henky!!
e644963564 OpenAI Fixes 2022-03-28 02:02:37 +02:00
Gnome Ann
20e48b11d7 Typical sampling 2022-03-27 16:25:50 -04:00
Noli
aa8de64aa4 fix default port 2022-03-25 23:26:27 +01:00
Noli
3e003d3b42 add port to the command options 2022-03-25 22:18:28 +01:00
Gnome Ann
0348970b19 Make sure AI is not busy when using retry to regenerate random story 2022-03-23 22:09:35 -04:00
Gnome Ann
4832dd6f37 Allow regenerating random story using Retry button
Commit b55e5a8e0b770d216339acf6346d18a3e7e8140c removed this feature, so
this commit adds it back.
2022-03-23 13:39:46 -04:00
henk717
cf99f02ca5 Merge branch 'main' into united 2022-03-20 19:22:53 +01:00
henk717
20eab085dd Fix AutoSave Toggle 2022-03-20 19:12:11 +01:00
henk717
5c795609e4 KML Fix 2022-03-20 13:10:56 +01:00
Gnome Ann
b1125a6705 Add EOS and padding token to default NeoX badwords 2022-03-19 01:30:02 -04:00