Commit Graph

892 Commits

Author SHA1 Message Date
ebolam 64664dc61e Fix for the AI menu to respect the --cpu command line flag 2022-08-11 10:40:32 -04:00
vfbd 1527db894e Fix specification of GET /story/nums/{num} 2022-08-10 21:09:29 -04:00
vfbd 6853625570 Allow KoboldAI to use its own API to generate text 2022-08-10 21:00:17 -04:00
vfbd 4eff7bf3ba /api now redirects to /api/latest 2022-08-10 18:22:46 -04:00
vfbd d2c06182f2 Remove annotation from api_version 2022-08-10 18:05:04 -04:00
vfbd 2af57adff3 API v1.1.0 2022-08-10 14:48:01 -04:00
vfbd becda8b842 Error 405 now sets Allow header 2022-08-09 22:32:24 -04:00
vfbd 5352c14c59 Fix typo in /config/soft_prompt documentation 2022-08-08 19:20:48 -04:00
vfbd c04e3c5666 Fix /docs/ redirects 2022-08-08 18:21:46 -04:00
vfbd 55c4acad8f Disable probability viewer and output streaming when using API 2022-08-08 18:16:08 -04:00
vfbd 82ae749396 Merge branch 'united' into api 2022-08-08 18:14:50 -04:00
vfbd aa01d1419d Add /story/end/delete and /story endpoints 2022-08-08 18:08:55 -04:00
vfbd 1f629ee254 Add more endpoints 2022-08-08 17:51:40 -04:00
vfbd a93087aecd Fix `api_format_docstring` 2022-08-08 14:21:50 -04:00
vfbd ddda981436 Improve /generate description 2022-08-08 14:19:43 -04:00
vfbd dc0fa9bff1 Add redirects to /api/v1/docs/ 2022-08-08 14:16:38 -04:00
vfbd ce064168e3 Additional validation for soft_prompt in API 2022-08-08 13:52:07 -04:00
vfbd de1e8f266a ValidationErrorSchema now has minItems 1 for its arrays 2022-08-08 13:22:18 -04:00
vfbd 596f619999 Unknown values in API input are now ignored instead of causing error 2022-08-08 13:17:53 -04:00
vfbd 3b56859c12 vars.disable_input_formatting and vars.disable_output_formatting fix 2022-08-08 13:04:46 -04:00
vfbd 34c9535667 Upload basic API with /generate POST endpoint 2022-08-08 02:27:48 -04:00
Henk 77e2a7972c Fix incorrect max tokens 2022-08-06 17:28:55 +02:00
Henk fe00581b83 Merge branch 'main' into united 2022-08-06 17:10:09 +02:00
Henk c71fd0cc3f OPT Nerys V2 6B 2022-08-06 17:04:22 +02:00
Henk 610257b36e Output Streaming on by Default 2022-08-06 16:47:04 +02:00
henk717 8bcf4187ac
Merge pull request #178 from one-some/token-prob
Add token probability visualizer
2022-08-05 14:27:46 +02:00
somebody f6d046fe1b Add token probability visualizer 2022-08-04 13:49:37 -05:00
ebolam 71e119f0b7 Fix for secondary model loads leaking settings into secondary model's settings file. 2022-08-02 19:45:36 -04:00
henk717 050e195420
Merge pull request #173 from one-some/token-streaming
Add token streaming option
2022-07-30 18:32:51 +02:00
henk717 a63f7cfa5a
Merge pull request #174 from ebolam/united
Fix for blank model info box when downloading model
2022-07-29 22:15:58 +02:00
ebolam f97c10b794 Fix for blank model info box when downloading model 2022-07-28 19:40:27 -04:00
somebody a4d81292f8 Add token streaming option 2022-07-27 22:13:08 -05:00
henk717 fe64e480ee
Merge pull request #171 from ebolam/united
Add Download Model Status
2022-07-26 00:52:12 +02:00
henk717 7721b72184
Merge branch 'KoboldAI:main' into united 2022-07-26 00:42:35 +02:00
Henk 4d8a633351 Aetherroom instead of aidg.club 2022-07-26 00:41:51 +02:00
ebolam 12acb50ee0 Fix for getting "model download status" when downloading config to figure out layer counts 2022-07-25 18:29:14 -04:00
scott-ca 9dc9966433 Added functionality to add any/all args via json 2022-07-23 22:02:03 -06:00
ebolam 907cf74b13 Added status bar for downloading models 2022-07-22 13:58:20 -04:00
ebolam 2b53598307
Fixes for file editor (#170)
Various fixes for the file editor by Ebolam
2022-07-20 00:50:03 +02:00
ebolam f58064e72c Revert "Fix for aidg.club website being taken read-only"
This reverts commit 23a031d852.
2022-07-19 16:54:32 -04:00
ebolam 23a031d852 Fix for aidg.club website being taken read-only 2022-07-19 13:40:55 -04:00
ebolam 68d143b80c Merge branch 'united' of https://github.com/ebolam/KoboldAI into united 2022-07-15 12:30:18 -04:00
ebolam d91ed3141d Fix for non ascii files in edit mode 2022-07-15 12:30:02 -04:00
henk717 e8c39992a1
Merge pull request #166 from ebolam/united
Add file browser to soft prompts and user scripts
2022-07-04 19:52:05 +02:00
ebolam 328c0a38d7 Removed breadcrumbs on file browser before the jail directory 2022-07-03 16:02:55 -04:00
henk717 fd44f0ded3
Merge branch 'KoboldAI:main' into united 2022-07-03 15:12:12 +02:00
Henk d041ec0921 Safer defaults and more flexibility
There have been a lot of reports from newer users who experience AI breakdown because not all models properly handle 2048 max tokens. 1024 is the only value that all models support and was the original value KoboldAI used. This commit reverts the decision to increase this to 2048, any existing configurations are not effected. Users who wish to increase the max tokens can do so themselves. Most models handle up to 1900 well (The GPT2 models are excluded), for many you can go all the way. (It is currently not yet known why some finetunes cause a decrease in maxtoken support,

In addition this commit contains a request for more consistent slider behavior, allowing the sliders to be changed at 0.01 intervals instead of some sliders being capped to 0.05.
2022-07-03 15:07:54 +02:00
henk717 a99518d0a8
Merge branch 'KoboldAI:main' into united 2022-07-02 12:59:53 +02:00
Henk e2f7fed99f Don't turn gamestarted off 2022-07-02 12:59:14 +02:00
vfbd aeed9bd8f7 Fix base fairseq dense models when using accelerate with a GPU 2022-07-01 20:16:39 -04:00
ebolam 3f8a7ab4bb Allowing edit in userscripts 2022-06-30 19:41:11 -04:00
ebolam 813540fe9b Added folder browser for softprompts and userscripts 2022-06-30 19:13:05 -04:00
ebolam 97e0df45d7 File Dialog complete 2022-06-30 15:57:27 -04:00
ebolam 58418c4aa5 Basic file browser with edit and delete functionality
Can be shown by going to /popup_test in a second tab.
2022-06-30 09:44:04 -04:00
vfbd 048bd0ff3b Add support for setting the RNG seed and full determinism 2022-06-28 13:21:05 -04:00
ebolam edd6dd7cd7 Fix for saved breakmodel settings on custom models
Fix for unit tests with new disk breakmodel
2022-06-27 10:12:54 -04:00
Henk 46678931b2 Better sentence spacing 2022-06-26 20:27:21 +02:00
vfbd ebba79fed6 Remove trailing whitespace from submissions
(cherry picked from commit b99d1449c9)
2022-06-26 14:06:34 -04:00
vfbd 2a4d37ce60 Clean up whitespace at the end of actions when loading story
Specifically, we merge blank actions into the next action and we move
whitespace at the end of non-blank actions to the beginning of the next
action.

(cherry picked from commit 4b16600e49)
2022-06-26 14:04:36 -04:00
vfbd b99d1449c9 Remove trailing whitespace from submissions 2022-06-26 13:15:55 -04:00
Henk fa97d28cb3 Nerys V2 for United 2022-06-25 14:06:51 +02:00
Henk 9e7eb80db4 Nerys V2 part 2 2022-06-25 14:03:19 +02:00
Henk ecc6ee9474 Nerys V2 2022-06-25 13:47:49 +02:00
henk717 10e85db89d
Merge pull request #162 from VE-FORBRYDERNE/whitespace-cleanup
Story whitespace cleanup
2022-06-25 13:36:03 +02:00
Henk d3fce44095 Merge branch 'main' into united 2022-06-24 18:31:45 +02:00
Henk 8be0964427 AIDG Import Fix 2022-06-24 18:29:06 +02:00
vfbd 4b16600e49 Clean up whitespace at the end of actions when loading story
Specifically, we merge blank actions into the next action and we move
whitespace at the end of non-blank actions to the beginning of the next
action.
2022-06-24 12:03:35 -04:00
vfbd 3da885d408 GPT-NeoX HF model badwords fix 2022-06-23 15:02:43 -04:00
henk717 8098f4ec8f
Merge branch 'KoboldAI:main' into united 2022-06-23 17:20:48 +02:00
vfbd 0eb9f8a879 Account for lnheader in budget calculation 2022-06-22 19:16:24 -04:00
vfbd 53034ee533 Delete all torch tensors before loading model 2022-06-22 12:07:36 -04:00
vfbd 922394c68f Don't blacklist </s> token in "s" newline mode 2022-06-22 11:23:03 -04:00
Gnome Ann 8c594c6869 Correct the padding token for GPT-NeoX 2022-06-21 19:37:43 -04:00
Gnome Ann a7f667c34c Use NeoX badwords when loading from HF GPT-NeoX model 2022-06-21 19:33:25 -04:00
Gnome Ann 8593bf339b Another typo fix 2022-06-21 15:36:25 -04:00
Gnome Ann 7e0ded6b47 Typo fix 2022-06-21 15:12:55 -04:00
Gnome Ann 91643be10a Change soft prompt implementation to a more universal one 2022-06-21 15:03:43 -04:00
Gnome Ann 0ea4fa9c87 Automatically calculate badwords and pad_token_id 2022-06-21 14:35:52 -04:00
Gnome Ann 6b172306f6 move_model_to_devices no longer crashes if you don't have accelerate 2022-06-21 13:15:46 -04:00
Gnome Ann ff69e9fbfe Put layers_module_names, module_names and named_buffers in utils.py 2022-06-20 17:17:42 -04:00
Gnome Ann 1620ac4148 Lazy loader needs to cache named buffers of layers in the disk cache 2022-06-20 17:08:52 -04:00
Gnome Ann ab5ab79003 Set primary device to CPU if in CPU-only mode 2022-06-20 16:25:01 -04:00
Gnome Ann bd7d7b41a1 Don't enable accelerate if no layers are in disk cache or GPUs 2022-06-20 16:21:44 -04:00
Gnome Ann 90fd8b1845 Disk cache support in CPU-only mode 2022-06-20 16:06:09 -04:00
Gnome Ann af07d7a15f Disk cache support for computers with at least one GPU 2022-06-20 14:49:54 -04:00
Gnome Ann 47a58a36b8 Add disk cache slider 2022-06-19 22:53:30 -04:00
Gnome Ann 4dd59e0a9d Correct the type hint for lazy_load_callback 2022-06-19 17:17:41 -04:00
Gnome Ann 21de36c4b0 Lazy loader now moves all non-layer weights to primary device 2022-06-19 16:44:23 -04:00
Gnome Ann 26c319519e Lazy loader now attempts to pin layers if accelerate is enabled 2022-06-19 16:35:23 -04:00
Gnome Ann 042cf3e560 Automatically support soft prompts for all transformers models 2022-06-19 13:11:58 -04:00
Gnome Ann cc56718a7e Fix lazy loader putting too many layers on CPU 2022-06-19 00:29:35 -04:00
Gnome Ann 1380eb0bb0 Disable lazy loader when using GPT-2 2022-06-18 23:54:11 -04:00
Gnome Ann f9732eb143 Always enable breakmodel if accelerate is available 2022-06-18 23:46:09 -04:00
Gnome Ann 8b4efc5d0a Use `accelerate.dispatch_model()` instead of breakmodel if possible 2022-06-18 23:41:36 -04:00
Gnome Ann f7ffdd7b6b Add more model querying utilities 2022-06-18 18:16:56 -04:00
Gnome Ann e143963161 Merge branch 'united' into accelerate 2022-06-18 13:47:38 -04:00
henk717 b209cf9868
NS mode as default
Experimental change that makes NS the default, more and more models seem to be requiring this as megatron based models are getting traction, neither does this seem to break the original models (with the exception of a user not being able to use </s> in generated outputs, the extremely rare case someone would be effected by this they can manually switch the mode by editing their settings file).

If this breaks nothing ns will remain the default, however the n mode should remain a choice for those who need it. In case it does get reversed I have also added the bloom model type to the ns list since its models require this.
2022-06-18 19:46:16 +02:00
Gnome Ann 0eedc541c8 Merge branch 'main' into united-merge 2022-06-18 13:39:23 -04:00
Gnome Ann 5e71f7fe97 Use slow tokenizer if fast tokenizer is not available 2022-06-17 21:08:37 -04:00
Gnome Ann f71bae254a Fix OPT tokenization problems 2022-06-17 13:29:42 -04:00
ebolam 2964175d8b Fix for flaskwebgui 2022-06-17 08:17:22 -04:00
Henk f112fc3493 Initial flaskwebgui support 2022-06-17 13:49:03 +02:00
Gnome Ann 8bdf17f598 Lazy loader can now use accelerate's `init_empty_weights()` 2022-06-16 18:56:16 -04:00
Gnome Ann 5253cdcb36 Lazy loader no longer requires map file except when loading to TPU 2022-06-16 18:45:11 -04:00
Gnome Ann 96d3d397ab Don't use fallback loading if we run out of memory during loading 2022-06-15 14:35:32 -04:00
Henk fb2b6f1026 Model Path Hardening 2022-06-15 13:29:10 +02:00
Henk 24d34647e0 Block navigation on all remote modes 2022-06-15 12:32:19 +02:00
Henk f39e24d87f Localtunnel fix, small polish 2022-06-15 12:22:00 +02:00
henk717 de07b1749f
Merge pull request #150 from ebolam/Web-UI
Delete model fixes and model info ui cleanup
2022-06-15 01:50:39 +02:00
ebolam 095cd2a19d Prevent on server side deletion of folders other than in models in the executing directory
Removed delete icon for model folders outside the models directory
2022-06-14 19:39:11 -04:00
ebolam f444ad851f Potential catch for if somehow a user sends a delete model with a .. in it. 2022-06-14 19:30:01 -04:00
henk717 9add3b0761
Merge pull request #149 from ebolam/Web-UI
--remote jailed to model directory and delete of models from UI
2022-06-15 01:14:06 +02:00
ebolam 462206fa86 added --remote not allowing navigation outside of the model folder for custom models.
added a delete custom models option (will not delete models outside of the models directory, nor will it delete non-model directories)
2022-06-14 19:11:30 -04:00
Henk 01b3c9932a 1.18.1 version bump 2022-06-15 00:58:49 +02:00
Henk 661a2d2727 1.18.1 version bump
Since 1.18 Kobold had a few smaller features added, specifically the ability to re-order sampling options and a new sampler. Since it is a smaller addition a minor version bump was chosen since there are no breaking changes.
2022-06-15 00:55:12 +02:00
Gnome Ann 107966fef8 Merge branch 'united' into overhaul-merge 2022-06-14 18:47:38 -04:00
Gnome Ann a61e06f876 Merge commit '4c7d6f42d99d557130511f5d185249b34f9db5a1' into overhaul-merge 2022-06-14 18:43:25 -04:00
Gnome Ann 979640bd2f Merge commit '2d3db7b4ba388f566aaec88a0e76678fe4fade8d' into overhaul-merge 2022-06-14 18:42:14 -04:00
Gnome Ann 130d530e7c Merge commit 'a273a5ebc49935bfafdcf1aaf4b98c9bf4bc33b1' into overhaul-merge 2022-06-14 18:38:25 -04:00
Gnome Ann 18218a99bc Merge commit '8a38b258f497281af06fcb0c2559f382b419b938' into overhaul-merge 2022-06-14 18:36:37 -04:00
Gnome Ann 6231106f95 Add Samplers menu 2022-06-13 20:18:09 -04:00
Gnome Ann 4c7d6f42d9 Add `sampler_order` to settings file 2022-06-13 19:14:38 -04:00
Gnome Ann 2d3db7b4ba Implement support for sampler order in the backend code 2022-06-13 19:12:23 -04:00
ebolam 11ed55f34a Added custom text box for loading models from specific path, or loading other models from hugging face. 2022-06-13 13:48:45 -04:00
Henk 66c0dda485 Hide (Broken) Chatbot Models
Removing this option because they are currently unavailable. People who still have them can load them trough the load from file option. Once they have been retrained and reuploaded I will add the menu back.
2022-06-11 22:54:51 +02:00
Henk 5c81374a48 Top A for GooseAi 2022-06-11 22:04:37 +02:00
Gnome Ann fdb2a7fa4c Top-A sampling 2022-06-10 22:28:20 -04:00
ebolam cfd1147d5a Bug fix for loading model after loading a model duplicating the settings menu until the website is refreshed
Fixed escaping warnings
Added back/redo unit test
2022-06-10 14:47:52 -04:00
ebolam ed428f2e73 Merge branch 'Web-UI' of https://github.com/ebolam/KoboldAI into Web-UI 2022-06-10 09:12:18 -04:00
ebolam 4a920724d9 fix for folder paths on linux 2022-06-10 09:12:04 -04:00
ebolam 6200908582
Merge pull request #10 from henk717/overhaul
Overhaul
2022-06-10 08:40:15 -04:00
ebolam 13f17d3eca Changed unit tests so that they run with a simple pytest command 2022-06-10 08:39:15 -04:00
Gnome Ann ce582f188f Merge branch 'united' into overhaul-merge 2022-06-09 23:48:28 -04:00
Gnome Ann fe619d4677 Update list of versions with broken OPT again
They released another version of transformers that still doesn't have
the OPT patch so I decided it would be safer to just mark all 4.19
transformers versions as needing the OPT patch.
2022-06-09 17:42:46 -04:00
ebolam 663dee784d Unit Tests using pytest and Minor modifications to allow unit testing 2022-06-09 13:16:32 -04:00
ebolam 606c276f9d Potential fix for tokenizer using a fallback 2022-06-09 09:01:40 -04:00
ebolam db9a94ca2a Added GPU name to the UI when using break models.
Added total layers to the UI
Added favicon
2022-06-09 08:42:35 -04:00
ebolam c565978fff Fix for multi-gpu not showing appropriately
Slight visual improvement for custom model load breadcrumbs
2022-06-08 19:39:04 -04:00
ebolam 4548dcf1b0 Fix for --model with custom paths 2022-06-08 18:53:56 -04:00
ebolam 001439be45
Merge pull request #9 from henk717/overhaul
Overhaul
2022-06-08 18:44:21 -04:00
ebolam 622a3fc8db Fix for model loading by moving monkey patching functions into a run-once function
Added folder navigation to custom model loading (Needs prittying)
2022-06-08 18:42:44 -04:00
Henk 1a46d97ad5 Send correct settings after load 2022-06-08 13:26:30 +02:00
Henk 461cd04932 Fix Essential Code + selectfolder fix
As part of the restructuring essential code was removed that handled the --path parameter correctly. This has now been restored. Selectfolder was also updated to use its NeoCustom counterpart instead of specifying a model so that the underlying code that corrects model names is being hit again.
2022-06-08 11:30:00 +02:00
ebolam 190869f0d3 Fix for selectfolder model to force old style folder select on startup. 2022-06-07 20:24:31 -04:00
Henk 88f5ed7b3c --model selectfolder 2022-06-07 21:32:58 +02:00
Henk 66ba165b4c --noaimenu as seperate parameter 2022-06-07 20:44:14 +02:00
ebolam 6fd2496d94 Fix for green opening text showing OAI and/or OAI/GooseAI model name rather than the appropriate name. 2022-06-07 13:47:10 -04:00
ebolam 1df88e1696 TPU fix Attempt 2022-06-07 09:05:51 -04:00
ebolam bf4af94abb Hopefully a fix for InferKit 2022-06-07 08:22:10 -04:00
ebolam afb894f5a0 TPU Fix 2022-06-06 21:47:15 -04:00
ebolam 1b35b55d86 Fix TPU 2022-06-06 21:39:17 -04:00
ebolam ae1aed0916 TPU Fix 2022-06-06 21:37:35 -04:00
ebolam df76bc4b41 Fix for Colab 2022-06-06 21:29:14 -04:00
ebolam edbf36a632 Web UI functional for GooseAI (and presumably OpenAI).
Fix for Breakmodel layer info saving
2022-06-06 19:21:10 -04:00
ebolam d9480ec439 Fix for lazy loading 2022-06-06 14:27:47 -04:00
ebolam 60b70bdf8a Fix 2022-06-06 14:02:17 -04:00
ebolam dd07b10b73 Fix for model loading on web ui and removing AI menu when using remote/colab methods 2022-06-06 13:57:19 -04:00
ebolam c984f4412d Fix for web based model loading 2022-06-06 12:49:40 -04:00
ebolam 1e139594a9 Merge commit 'refs/pull/7/head' of https://github.com/ebolam/KoboldAI into HEAD 2022-06-06 09:49:46 -04:00
Henk e5dcf91a08 Defaults Support
This adds support for loading settings from the defaults folder, settings are loaded in the following order and overwritten if needed by the higher number.

1. The model config file.
2. The defaults folder.
3. The users defined settings file.

With this support we can begin to ship better defaults for models we do not manage. Our community tuners have been most helpful at adding good defaults to their configuration files, but for other models such as the base models this gives us the flexibility to define better settings for each model without messing with a users desired settings if they already exist.
2022-06-01 10:34:16 +02:00
Gnome Ann 707316de31 Kaggle TPU support 2022-05-31 12:20:16 -04:00
Henk 1a1f2f6428 30B ram requirements 2022-05-31 13:17:06 +02:00
Gnome Ann 69da5b7bc2 Update list of transformers versions that have broken OPT 2022-05-28 23:44:19 -04:00
Henk 4b65ce9c76 1.18 version bump 2022-05-28 19:39:05 +02:00
Henk b30370bf4b 2048 maxtoken default
Almost everyone prefers 2048 max tokens because of the superior coherency. It should only be lower due to ram limits, but the menu already shows the optimal ram for 2048. Negatively effected users can turn it down themselves, for everyone else especially on rented machines or colab 2048 is a better default.
2022-05-27 01:23:48 +02:00
Gnome Ann c692987e40 Fix an error that occurs when loading GPT-2 models
I forgot that this new_rebuild_tensor function's first argument's type
is different when loading GPT-2 models.
2022-05-20 14:54:49 -04:00
Julius ter Pelkwijk 6ae7b48b69
Adding Nerys model 13B 2022-05-18 13:50:57 +02:00
Julius ter Pelkwijk f0df3de610
Adding Nerys model 2.7B 2022-05-16 09:50:45 +02:00
Gnome Ann d5ab3ef5b1 Fix `no attribute get_checkpoint_shard_files` 2022-05-14 11:49:04 -04:00
Gnome Ann 1476e76cfc Copy fp16 model files instead of resaving them 2022-05-14 00:45:43 -04:00
Gnome Ann 0c5ca5261e Loading a sharded model will now display only one progress bar 2022-05-13 23:32:16 -04:00
Gnome Ann f9f1a5f3a9 Make sure tqdm progress bars display properly in Colab 2022-05-13 17:37:45 -04:00
Gnome Ann 91d3672446 Proper progress bar for aria2 downloads 2022-05-13 17:00:10 -04:00
henk717 7ea0c49c1a
Merge pull request #128 from VE-FORBRYDERNE/opt
OPT breakmodel and TPU support
2022-05-13 18:07:02 +02:00
Gnome Ann 1200173386 Custom badwords for OPT
Generated using:
```
import transformers
tokenizer = transformers.AutoTokenizer.from_pretrained("facebook/opt-350m", fast=False)
badwordsids_opt = [[v] for k, v in tokenizer.vocab.items() if any(c in k for c in "<>[]")]
```
2022-05-13 10:45:28 -04:00
Henk d5fa782483 NS Mode (comment fix) 2022-05-13 10:53:19 +02:00
Henk 8376f12e21 Add NS mode
OPT supports newlines, but it also needs some of the behavior we use in S mode. NS mode is a more limited version of S mode that still handles the </s> token, but instead of replacing it with a new line we replace it empty and newlines are not converted.

In future if your Fairseq style model has newline support use NS mode, while if it needs artifically inserted newlines use S mode. This also means that people finetuning fairseq models to include newlines might benefit from testing their models on ns mode.
2022-05-13 10:44:12 +02:00
Gnome Ann 55079f672a Fix typo in soft prompt patching code 2022-05-13 01:51:55 -04:00
Gnome Ann 29bb3f569b Fix a bug in OPTForCausalLM where self.lm_head is the wrong size 2022-05-13 01:37:17 -04:00
Gnome Ann defbb53b68 OPT breakmodel 2022-05-13 01:03:38 -04:00
Gnome Ann b1d8797a54 Allow TPU Colab to load sharded HF models 2022-05-12 23:51:40 -04:00
Gnome Ann 4fa5f1cd6a Add TPU support for OPT-350M
The 350M model seems to have a different structure than the other ones ???
2022-05-12 22:21:15 -04:00
Henk 5c4a087970 Disable S mode for OPT 2022-05-13 01:47:59 +02:00
Henk e98cc3cb16 OPT models 2022-05-12 23:55:21 +02:00
Henk 376e76f5da S mode for OPT 2022-05-12 02:18:14 +02:00
Gnome Ann 46cfa1367f Add `--no_aria2` command line flag 2022-05-11 00:44:56 -04:00
Gnome Ann f09959f9be Fix patching code of `PreTrainedModel.from_pretrained()` 2022-05-11 00:41:53 -04:00
Gnome Ann 4b49d1c464 Make sure `vars.revision` is defined 2022-05-10 22:51:36 -04:00
Gnome Ann b97b2a02d6 Add `--revision` command line flag 2022-05-10 22:14:56 -04:00
Gnome Ann 937d9ee06a Change default `model.save_pretrained` shard size to 500 MiB 2022-05-10 22:04:25 -04:00
Gnome Ann a388c63023 Use aria2 to download split checkpoints 2022-05-10 21:28:13 -04:00
subtlewave 9c83ef7fa9
Replaced Adventure 125M and added C1-1.3B 2022-04-28 22:35:04 +00:00
Gnome Ann ea82867e4d Merge branch 'united' into settings 2022-04-26 13:58:01 -04:00
Henk 11280a6e66 LocalTunnel Linux Fix 2022-04-19 14:41:21 +02:00
Henk b8e79afe5e LocalTunnel support 2022-04-19 13:47:44 +02:00
Gnome Ann c7b03398f6 Merge 'nolialsea/patch-1' into settings without Colab changes 2022-04-17 12:15:36 -04:00
henk717 372eb4c981
Merge pull request #119 from VE-FORBRYDERNE/scripting-sp
Allow userscripts to change the soft prompt
2022-04-14 21:33:20 +02:00
henk717 78d6ee491d
Merge pull request #117 from mrseeker/patch-7
Shinen FSD 13B (NSFW)
2022-04-14 21:33:08 +02:00
henk717 e180db88aa
Merge pull request #118 from VE-FORBRYDERNE/lazy-loader
Fix lazy loader in aiserver.py
2022-04-14 21:33:00 +02:00
Gnome Ann bd6f7798b9 Fix lazy loader in aiserver.py 2022-04-14 14:33:10 -04:00