Commit Graph

701 Commits

Author SHA1 Message Date
cc56718a7e Fix lazy loader putting too many layers on CPU 2022-06-19 00:29:35 -04:00
1380eb0bb0 Disable lazy loader when using GPT-2 2022-06-18 23:54:11 -04:00
f9732eb143 Always enable breakmodel if accelerate is available 2022-06-18 23:46:09 -04:00
8b4efc5d0a Use accelerate.dispatch_model() instead of breakmodel if possible 2022-06-18 23:41:36 -04:00
f7ffdd7b6b Add more model querying utilities 2022-06-18 18:16:56 -04:00
e143963161 Merge branch 'united' into accelerate 2022-06-18 13:47:38 -04:00
b209cf9868 NS mode as default
Experimental change that makes NS the default, more and more models seem to be requiring this as megatron based models are getting traction, neither does this seem to break the original models (with the exception of a user not being able to use </s> in generated outputs, the extremely rare case someone would be effected by this they can manually switch the mode by editing their settings file).

If this breaks nothing ns will remain the default, however the n mode should remain a choice for those who need it. In case it does get reversed I have also added the bloom model type to the ns list since its models require this.
2022-06-18 19:46:16 +02:00
0eedc541c8 Merge branch 'main' into united-merge 2022-06-18 13:39:23 -04:00
5e71f7fe97 Use slow tokenizer if fast tokenizer is not available 2022-06-17 21:08:37 -04:00
f71bae254a Fix OPT tokenization problems 2022-06-17 13:29:42 -04:00
2964175d8b Fix for flaskwebgui 2022-06-17 08:17:22 -04:00
f112fc3493 Initial flaskwebgui support 2022-06-17 13:49:03 +02:00
8bdf17f598 Lazy loader can now use accelerate's init_empty_weights() 2022-06-16 18:56:16 -04:00
5253cdcb36 Lazy loader no longer requires map file except when loading to TPU 2022-06-16 18:45:11 -04:00
96d3d397ab Don't use fallback loading if we run out of memory during loading 2022-06-15 14:35:32 -04:00
fb2b6f1026 Model Path Hardening 2022-06-15 13:29:10 +02:00
24d34647e0 Block navigation on all remote modes 2022-06-15 12:32:19 +02:00
f39e24d87f Localtunnel fix, small polish 2022-06-15 12:22:00 +02:00
de07b1749f Merge pull request #150 from ebolam/Web-UI
Delete model fixes and model info ui cleanup
2022-06-15 01:50:39 +02:00
095cd2a19d Prevent on server side deletion of folders other than in models in the executing directory
Removed delete icon for model folders outside the models directory
2022-06-14 19:39:11 -04:00
f444ad851f Potential catch for if somehow a user sends a delete model with a .. in it. 2022-06-14 19:30:01 -04:00
9add3b0761 Merge pull request #149 from ebolam/Web-UI
--remote jailed to model directory and delete of models from UI
2022-06-15 01:14:06 +02:00
462206fa86 added --remote not allowing navigation outside of the model folder for custom models.
added a delete custom models option (will not delete models outside of the models directory, nor will it delete non-model directories)
2022-06-14 19:11:30 -04:00
01b3c9932a 1.18.1 version bump 2022-06-15 00:58:49 +02:00
661a2d2727 1.18.1 version bump
Since 1.18 Kobold had a few smaller features added, specifically the ability to re-order sampling options and a new sampler. Since it is a smaller addition a minor version bump was chosen since there are no breaking changes.
2022-06-15 00:55:12 +02:00
107966fef8 Merge branch 'united' into overhaul-merge 2022-06-14 18:47:38 -04:00
a61e06f876 Merge commit '4c7d6f42d99d557130511f5d185249b34f9db5a1' into overhaul-merge 2022-06-14 18:43:25 -04:00
979640bd2f Merge commit '2d3db7b4ba388f566aaec88a0e76678fe4fade8d' into overhaul-merge 2022-06-14 18:42:14 -04:00
130d530e7c Merge commit 'a273a5ebc49935bfafdcf1aaf4b98c9bf4bc33b1' into overhaul-merge 2022-06-14 18:38:25 -04:00
18218a99bc Merge commit '8a38b258f497281af06fcb0c2559f382b419b938' into overhaul-merge 2022-06-14 18:36:37 -04:00
6231106f95 Add Samplers menu 2022-06-13 20:18:09 -04:00
4c7d6f42d9 Add sampler_order to settings file 2022-06-13 19:14:38 -04:00
2d3db7b4ba Implement support for sampler order in the backend code 2022-06-13 19:12:23 -04:00
11ed55f34a Added custom text box for loading models from specific path, or loading other models from hugging face. 2022-06-13 13:48:45 -04:00
66c0dda485 Hide (Broken) Chatbot Models
Removing this option because they are currently unavailable. People who still have them can load them trough the load from file option. Once they have been retrained and reuploaded I will add the menu back.
2022-06-11 22:54:51 +02:00
5c81374a48 Top A for GooseAi 2022-06-11 22:04:37 +02:00
fdb2a7fa4c Top-A sampling 2022-06-10 22:28:20 -04:00
cfd1147d5a Bug fix for loading model after loading a model duplicating the settings menu until the website is refreshed
Fixed escaping warnings
Added back/redo unit test
2022-06-10 14:47:52 -04:00
ed428f2e73 Merge branch 'Web-UI' of https://github.com/ebolam/KoboldAI into Web-UI 2022-06-10 09:12:18 -04:00
4a920724d9 fix for folder paths on linux 2022-06-10 09:12:04 -04:00
6200908582 Merge pull request #10 from henk717/overhaul
Overhaul
2022-06-10 08:40:15 -04:00
13f17d3eca Changed unit tests so that they run with a simple pytest command 2022-06-10 08:39:15 -04:00
ce582f188f Merge branch 'united' into overhaul-merge 2022-06-09 23:48:28 -04:00
fe619d4677 Update list of versions with broken OPT again
They released another version of transformers that still doesn't have
the OPT patch so I decided it would be safer to just mark all 4.19
transformers versions as needing the OPT patch.
2022-06-09 17:42:46 -04:00
663dee784d Unit Tests using pytest and Minor modifications to allow unit testing 2022-06-09 13:16:32 -04:00
606c276f9d Potential fix for tokenizer using a fallback 2022-06-09 09:01:40 -04:00
db9a94ca2a Added GPU name to the UI when using break models.
Added total layers to the UI
Added favicon
2022-06-09 08:42:35 -04:00
c565978fff Fix for multi-gpu not showing appropriately
Slight visual improvement for custom model load breadcrumbs
2022-06-08 19:39:04 -04:00
4548dcf1b0 Fix for --model with custom paths 2022-06-08 18:53:56 -04:00
001439be45 Merge pull request #9 from henk717/overhaul
Overhaul
2022-06-08 18:44:21 -04:00