560 Commits

Author	SHA1	Message	Date
Julius ter Pelkwijk	6ae7b48b69	Adding Nerys model 13B	2022-05-18 13:50:57 +02:00
Julius ter Pelkwijk	f0df3de610	Adding Nerys model 2.7B	2022-05-16 09:50:45 +02:00
Gnome Ann	d5ab3ef5b1	Fix no attribute get_checkpoint_shard_files	2022-05-14 11:49:04 -04:00
Gnome Ann	1476e76cfc	Copy fp16 model files instead of resaving them	2022-05-14 00:45:43 -04:00
Gnome Ann	0c5ca5261e	Loading a sharded model will now display only one progress bar	2022-05-13 23:32:16 -04:00
Gnome Ann	f9f1a5f3a9	Make sure tqdm progress bars display properly in Colab	2022-05-13 17:37:45 -04:00
Gnome Ann	91d3672446	Proper progress bar for aria2 downloads	2022-05-13 17:00:10 -04:00
henk717	7ea0c49c1a	Merge pull request #128 from VE-FORBRYDERNE/opt ... OPT breakmodel and TPU support	2022-05-13 18:07:02 +02:00
Gnome Ann	1200173386	Custom badwords for OPT ... Generated using: ``` import transformers tokenizer = transformers.AutoTokenizer.from_pretrained("facebook/opt-350m", fast=False) badwordsids_opt = [[v] for k, v in tokenizer.vocab.items() if any(c in k for c in "<>[]")] ```	2022-05-13 10:45:28 -04:00
Henk	d5fa782483	NS Mode (comment fix)	2022-05-13 10:53:19 +02:00
Henk	8376f12e21	Add NS mode ... OPT supports newlines, but it also needs some of the behavior we use in S mode. NS mode is a more limited version of S mode that still handles the </s> token, but instead of replacing it with a new line we replace it empty and newlines are not converted. In future if your Fairseq style model has newline support use NS mode, while if it needs artifically inserted newlines use S mode. This also means that people finetuning fairseq models to include newlines might benefit from testing their models on ns mode.	2022-05-13 10:44:12 +02:00
Gnome Ann	55079f672a	Fix typo in soft prompt patching code	2022-05-13 01:51:55 -04:00
Gnome Ann	29bb3f569b	Fix a bug in OPTForCausalLM where self.lm_head is the wrong size	2022-05-13 01:37:17 -04:00
Gnome Ann	defbb53b68	OPT breakmodel	2022-05-13 01:03:38 -04:00
Gnome Ann	b1d8797a54	Allow TPU Colab to load sharded HF models	2022-05-12 23:51:40 -04:00
Gnome Ann	4fa5f1cd6a	Add TPU support for OPT-350M ... The 350M model seems to have a different structure than the other ones ???	2022-05-12 22:21:15 -04:00
Henk	5c4a087970	Disable S mode for OPT	2022-05-13 01:47:59 +02:00
Henk	e98cc3cb16	OPT models	2022-05-12 23:55:21 +02:00
Henk	376e76f5da	S mode for OPT	2022-05-12 02:18:14 +02:00
Gnome Ann	46cfa1367f	Add --no_aria2 command line flag	2022-05-11 00:44:56 -04:00
Gnome Ann	f09959f9be	Fix patching code of PreTrainedModel.from_pretrained()	2022-05-11 00:41:53 -04:00
Gnome Ann	4b49d1c464	Make sure vars.revision is defined	2022-05-10 22:51:36 -04:00
Gnome Ann	b97b2a02d6	Add --revision command line flag	2022-05-10 22:14:56 -04:00
Gnome Ann	937d9ee06a	Change default model.save_pretrained shard size to 500 MiB	2022-05-10 22:04:25 -04:00
Gnome Ann	a388c63023	Use aria2 to download split checkpoints	2022-05-10 21:28:13 -04:00
subtlewave	9c83ef7fa9	Replaced Adventure 125M and added C1-1.3B	2022-04-28 22:35:04 +00:00
Gnome Ann	ea82867e4d	Merge branch 'united' into settings	2022-04-26 13:58:01 -04:00
Henk	11280a6e66	LocalTunnel Linux Fix	2022-04-19 14:41:21 +02:00
Henk	b8e79afe5e	LocalTunnel support	2022-04-19 13:47:44 +02:00
Gnome Ann	c7b03398f6	Merge 'nolialsea/patch-1' into settings without Colab changes	2022-04-17 12:15:36 -04:00
henk717	372eb4c981	Merge pull request #119 from VE-FORBRYDERNE/scripting-sp ... Allow userscripts to change the soft prompt	2022-04-14 21:33:20 +02:00
henk717	78d6ee491d	Merge pull request #117 from mrseeker/patch-7 ... Shinen FSD 13B (NSFW)	2022-04-14 21:33:08 +02:00
henk717	e180db88aa	Merge pull request #118 from VE-FORBRYDERNE/lazy-loader ... Fix lazy loader in aiserver.py	2022-04-14 21:33:00 +02:00
Gnome Ann	bd6f7798b9	Fix lazy loader in aiserver.py	2022-04-14 14:33:10 -04:00
Julius ter Pelkwijk	ad94f6c01c	Shinen FSD 13B (NSFW)	2022-04-14 08:23:50 +02:00
Julius ter Pelkwijk	945c34e822	Shinen FSD 6.7B (NSFW)	2022-04-13 14:47:22 +02:00
Henk	eeff126df4	Memory Sizes	2022-04-13 12:41:21 +02:00
Gnome Ann	a3a52dc9c3	Add support for changing soft prompt from userscripts	2022-04-12 15:59:05 -04:00
Henk	26909e6cf3	Model Categories	2022-04-10 20:53:15 +02:00
Julius ter Pelkwijk	6fcb0af488	Adding Janeway 13B	2022-04-10 15:03:39 +02:00
Gnome Ann	359a0a1c99	Copy Python 3.6 compatible lazy loader to aiserver.py	2022-04-08 19:40:12 -04:00
Julius ter Pelkwijk	1974761f70	Releasing Janeway 6.7B	2022-04-08 08:13:36 +02:00
Wes Brown	09fee52abd	Add num_seqs support to GooseAI/OpenAI client handler.	2022-04-07 14:50:23 -04:00
Henky!!	5feda462fb	OAI - Fixes last commit	2022-04-07 02:39:37 +02:00
Henky!!	34b6c907f0	OAI Max Token Slider	2022-04-07 02:26:15 +02:00
Henky!!	b568e31381	OAI Path Support	2022-04-06 05:15:25 +02:00
Henky!!	699b3fc10b	OAI Redo Fixes 2	2022-04-06 04:54:27 +02:00
Henky!!	b5a633e69b	OAI Redo Fix	2022-04-06 04:45:01 +02:00
henk717	ee682702ee	Merge branch 'KoboldAI:main' into united	2022-04-05 01:35:22 +02:00
Henky!!	8153f21d5c	Convo 6B	2022-04-05 01:33:51 +02:00