Henk
8376f12e21
Add NS mode
...
OPT supports newlines, but it also needs some of the behavior we use in S mode. NS mode is a more limited version of S mode that still handles the </s> token, but instead of replacing it with a new line we replace it empty and newlines are not converted.
In future if your Fairseq style model has newline support use NS mode, while if it needs artifically inserted newlines use S mode. This also means that people finetuning fairseq models to include newlines might benefit from testing their models on ns mode.
2022-05-13 10:44:12 +02:00
Gnome Ann
55079f672a
Fix typo in soft prompt patching code
2022-05-13 01:51:55 -04:00
Gnome Ann
29bb3f569b
Fix a bug in OPTForCausalLM where self.lm_head is the wrong size
2022-05-13 01:37:17 -04:00
Gnome Ann
defbb53b68
OPT breakmodel
2022-05-13 01:03:38 -04:00
Gnome Ann
b1d8797a54
Allow TPU Colab to load sharded HF models
2022-05-12 23:51:40 -04:00
Gnome Ann
4fa5f1cd6a
Add TPU support for OPT-350M
...
The 350M model seems to have a different structure than the other ones ???
2022-05-12 22:21:15 -04:00
Henk
5c4a087970
Disable S mode for OPT
2022-05-13 01:47:59 +02:00
Henk
e98cc3cb16
OPT models
2022-05-12 23:55:21 +02:00
Henk
376e76f5da
S mode for OPT
2022-05-12 02:18:14 +02:00
Gnome Ann
46cfa1367f
Add --no_aria2
command line flag
2022-05-11 00:44:56 -04:00
Gnome Ann
f09959f9be
Fix patching code of PreTrainedModel.from_pretrained()
2022-05-11 00:41:53 -04:00
Gnome Ann
4b49d1c464
Make sure vars.revision
is defined
2022-05-10 22:51:36 -04:00
Gnome Ann
b97b2a02d6
Add --revision
command line flag
2022-05-10 22:14:56 -04:00
Gnome Ann
937d9ee06a
Change default model.save_pretrained
shard size to 500 MiB
2022-05-10 22:04:25 -04:00
Gnome Ann
a388c63023
Use aria2 to download split checkpoints
2022-05-10 21:28:13 -04:00
subtlewave
9c83ef7fa9
Replaced Adventure 125M and added C1-1.3B
2022-04-28 22:35:04 +00:00
Gnome Ann
ea82867e4d
Merge branch 'united' into settings
2022-04-26 13:58:01 -04:00
Henk
11280a6e66
LocalTunnel Linux Fix
2022-04-19 14:41:21 +02:00
Henk
b8e79afe5e
LocalTunnel support
2022-04-19 13:47:44 +02:00
Gnome Ann
c7b03398f6
Merge 'nolialsea/patch-1' into settings without Colab changes
2022-04-17 12:15:36 -04:00
henk717
372eb4c981
Merge pull request #119 from VE-FORBRYDERNE/scripting-sp
...
Allow userscripts to change the soft prompt
2022-04-14 21:33:20 +02:00
henk717
78d6ee491d
Merge pull request #117 from mrseeker/patch-7
...
Shinen FSD 13B (NSFW)
2022-04-14 21:33:08 +02:00
henk717
e180db88aa
Merge pull request #118 from VE-FORBRYDERNE/lazy-loader
...
Fix lazy loader in aiserver.py
2022-04-14 21:33:00 +02:00
Gnome Ann
bd6f7798b9
Fix lazy loader in aiserver.py
2022-04-14 14:33:10 -04:00
Julius ter Pelkwijk
ad94f6c01c
Shinen FSD 13B (NSFW)
2022-04-14 08:23:50 +02:00
Julius ter Pelkwijk
945c34e822
Shinen FSD 6.7B (NSFW)
2022-04-13 14:47:22 +02:00
Henk
eeff126df4
Memory Sizes
2022-04-13 12:41:21 +02:00
Gnome Ann
a3a52dc9c3
Add support for changing soft prompt from userscripts
2022-04-12 15:59:05 -04:00
Henk
26909e6cf3
Model Categories
2022-04-10 20:53:15 +02:00
Julius ter Pelkwijk
6fcb0af488
Adding Janeway 13B
2022-04-10 15:03:39 +02:00
Gnome Ann
359a0a1c99
Copy Python 3.6 compatible lazy loader to aiserver.py
2022-04-08 19:40:12 -04:00
Julius ter Pelkwijk
1974761f70
Releasing Janeway 6.7B
2022-04-08 08:13:36 +02:00
Wes Brown
09fee52abd
Add num_seqs
support to GooseAI/OpenAI client handler.
2022-04-07 14:50:23 -04:00
Henky!!
5feda462fb
OAI - Fixes last commit
2022-04-07 02:39:37 +02:00
Henky!!
34b6c907f0
OAI Max Token Slider
2022-04-07 02:26:15 +02:00
Henky!!
b568e31381
OAI Path Support
2022-04-06 05:15:25 +02:00
Henky!!
699b3fc10b
OAI Redo Fixes 2
2022-04-06 04:54:27 +02:00
Henky!!
b5a633e69b
OAI Redo Fix
2022-04-06 04:45:01 +02:00
henk717
ee682702ee
Merge branch 'KoboldAI:main' into united
2022-04-05 01:35:22 +02:00
Henky!!
8153f21d5c
Convo 6B
2022-04-05 01:33:51 +02:00
Henky!!
e644963564
OpenAI Fixes
2022-03-28 02:02:37 +02:00
Gnome Ann
20e48b11d7
Typical sampling
2022-03-27 16:25:50 -04:00
Noli
aa8de64aa4
fix default port
2022-03-25 23:26:27 +01:00
Noli
3e003d3b42
add port to the command options
2022-03-25 22:18:28 +01:00
Gnome Ann
0348970b19
Make sure AI is not busy when using retry to regenerate random story
2022-03-23 22:09:35 -04:00
Gnome Ann
4832dd6f37
Allow regenerating random story using Retry button
...
Commit b55e5a8e0b770d216339acf6346d18a3e7e8140c removed this feature, so
this commit adds it back.
2022-03-23 13:39:46 -04:00
henk717
cf99f02ca5
Merge branch 'main' into united
2022-03-20 19:22:53 +01:00
henk717
20eab085dd
Fix AutoSave Toggle
2022-03-20 19:12:11 +01:00
henk717
5c795609e4
KML Fix
2022-03-20 13:10:56 +01:00
Gnome Ann
b1125a6705
Add EOS and padding token to default NeoX badwords
2022-03-19 01:30:02 -04:00