Commit Graph

1135 Commits

Author SHA1 Message Date
Henk 6d27084e8a Better Aria2 Defaults
Trunc prevents slow allocation on windows, force_download=True has proven a more reliable default. Since models are converted to local formats it does not impact local users. And because -c is used the impact of checking if the model is correct is desirable and minimal.
2022-05-11 21:38:33 +02:00
Gnome Ann 7a3f865e3f Prevent aria2 from resuming cancelled downloads
Resumed downloads tend to be very slow.

The original transformers downloader didn't allow resuming downloads
either.
2022-05-11 15:14:37 -04:00
Gnome Ann c81f3bd084 Use `--file-allocation=trunc` instead of `--file-allocation=none` 2022-05-11 14:51:43 -04:00
Gnome Ann f96c878d83 Use aria2 even when all model files are already in cache
This allows aria2 to continue downloading a pytorch_model.bin after a
cancelled download.
2022-05-11 14:43:56 -04:00
Gnome Ann f60c7d8492 Fix the behaviour of `aria2_hook()` when using `force_download` 2022-05-11 14:41:34 -04:00
Gnome Ann 5732a8f15a Don't use `aria2_hook()` if `force_download=True` is used 2022-05-11 14:40:31 -04:00
henk717 903d593ce4
Merge pull request #125 from VE-FORBRYDERNE/aria2
Use aria2 to improve HF model download speeds in Colab
2022-05-11 07:55:53 +02:00
Gnome Ann 46cfa1367f Add `--no_aria2` command line flag 2022-05-11 00:44:56 -04:00
Gnome Ann f09959f9be Fix patching code of `PreTrainedModel.from_pretrained()` 2022-05-11 00:41:53 -04:00
Gnome Ann 22b4f3c9df Bug fixes for `aria2_hook()` when running Windows 2022-05-11 00:14:00 -04:00
Gnome Ann 82205722af Fix logic of `aria2_hook()` 2022-05-10 23:46:29 -04:00
Gnome Ann 4b49d1c464 Make sure `vars.revision` is defined 2022-05-10 22:51:36 -04:00
Gnome Ann 4b693b4858 Fix the logic of `force_download` in utils.py 2022-05-10 22:47:03 -04:00
Gnome Ann c1ef20bcff Also enable aria2 downloading for non-sharded checkpoints 2022-05-10 22:43:41 -04:00
Gnome Ann e115bb68e4 aria2 downloads in utils.py now use correct user agent 2022-05-10 22:22:46 -04:00
Gnome Ann b97b2a02d6 Add `--revision` command line flag 2022-05-10 22:14:56 -04:00
Gnome Ann 937d9ee06a Change default `model.save_pretrained` shard size to 500 MiB 2022-05-10 22:04:25 -04:00
Gnome Ann a388c63023 Use aria2 to download split checkpoints 2022-05-10 21:28:13 -04:00
Henk 01e15d03d6 Remove play.ipnyb
Interactive Python doesn't work well on Jupyter, until they support what Colab can do this file is pointless.
2022-05-11 01:49:07 +02:00
Henk 7a9297adc3 Jupyter Git integration 2022-05-11 01:31:12 +02:00
Henk f917d3438f Updated models 2022-05-10 21:39:16 +02:00
henk717 7fcc1a9acb Fix C1 2022-05-10 18:38:50 +02:00
Henk c5462ec480 Better Jupyter 2022-05-09 02:41:00 +02:00
Henk e09b939f04 Force Bash 2022-05-08 16:02:16 +02:00
Henk 0ca4917056 Linux Runtime Info 2022-05-08 00:24:14 +02:00
Henk 030df1a09f Small installer fix 2022-05-07 20:22:33 +02:00
Henk a3dc188c8f Linux Installer Improvements 2022-05-01 15:58:37 +02:00
henk717 9f7c9c4b9e
Merge pull request #124 from Crafteko/united
Replaced Adventure 125M and added C1-1.3B to the menu
2022-04-29 17:38:55 +02:00
subtlewave 9c83ef7fa9
Replaced Adventure 125M and added C1-1.3B 2022-04-28 22:35:04 +00:00
Henk 810f6614af Cap GIT version for now 2022-04-27 18:20:43 +02:00
henk717 716951f059
Merge pull request #123 from VE-FORBRYDERNE/settings
Prevent the settings throttle from lagging the sliders
2022-04-27 03:17:53 +02:00
Gnome Ann b1faca3686 Prevent the settings throttle from lagging the sliders 2022-04-26 21:14:44 -04:00
Henk 9cff8268b5 Lower slider latency for now 2022-04-27 00:53:55 +02:00
henk717 b2277f242b
Merge pull request #122 from VE-FORBRYDERNE/settings 2022-04-27 00:49:01 +02:00
Gnome Ann 02e4e6be1e Fix author's note slider 2022-04-26 17:29:18 -04:00
Gnome Ann ee8ced2f5f Allow users to type in the values for the settings 2022-04-26 15:27:28 -04:00
Gnome Ann ea82867e4d Merge branch 'united' into settings 2022-04-26 13:58:01 -04:00
henk717 4ce9a5fe28 New text 2022-04-26 19:45:37 +02:00
henk717 cd1a02e705 New TPU Colab 2022-04-26 19:14:40 +02:00
henk717 e94b97790c
Merge pull request #121 from VE-FORBRYDERNE/code
Fix the vscode notebook
2022-04-21 20:01:52 +02:00
henk717 c873d36374
Merge pull request #120 from VE-FORBRYDERNE/lazy-loader
Fix some lazy loader edge cases
2022-04-21 19:59:56 +02:00
Gnome Ann e4cf19e707 Fix the vscode notebook 2022-04-21 13:13:46 -04:00
Gnome Ann 2d38e90509 Remove lm_head.weight from maps/xglm.json 2022-04-20 12:56:57 -04:00
Gnome Ann 6803531384 Force grad to be off by default when loading with lazy loader 2022-04-19 12:26:02 -04:00
Henk a82a165146 ColabKobold Fixes 2022-04-19 15:15:57 +02:00
Henk 11280a6e66 LocalTunnel Linux Fix 2022-04-19 14:41:21 +02:00
Henk b8e79afe5e LocalTunnel support 2022-04-19 13:47:44 +02:00
Gnome Ann c7b03398f6 Merge 'nolialsea/patch-1' into settings without Colab changes 2022-04-17 12:15:36 -04:00
henk717 33733bf962
Merge branch 'KoboldAI:main' into united 2022-04-16 00:26:58 +02:00
henk717 06fc4c6ca8 Add TPU warning 2022-04-16 00:02:10 +02:00