Commit Graph

40 Commits

Author SHA1 Message Date
Gnome Ann c1ef20bcff Also enable aria2 downloading for non-sharded checkpoints 2022-05-10 22:43:41 -04:00
Gnome Ann a388c63023 Use aria2 to download split checkpoints 2022-05-10 21:28:13 -04:00
Henk a82a165146 ColabKobold Fixes 2022-04-19 15:15:57 +02:00
Henk b8e79afe5e LocalTunnel support 2022-04-19 13:47:44 +02:00
henk717 4892556059 Model saving for colab mode 2022-03-13 11:22:44 +01:00
henk717 3a5793c815 No longer uses --colab_tpu 2022-03-05 19:58:24 +01:00
henk717 935c7e5786 Improved TPU support 2022-03-05 19:47:51 +01:00
henk717 74012a24c9 Expose GDrive Models 2022-02-22 02:35:27 +01:00
henk717 040455b100 Enable Colab Mode in Colab
Now that we are ready to upstream we can safely enable the intended colab mode without breaking the old version.
2022-02-06 11:52:55 +01:00
henk717 13c54b1a89 Seperate Google Drive folders to its own section
This allows Colab developers to first get the correct folder structure on drive, before placing a configuration file for the model. That way we can quickly add the settings for a model without maintaining the init settings in two different lines. Its a substitute to the common --init only and --init skip approach from before.
2022-01-20 11:17:01 +01:00
henk717 f2bdf5a304
Git changing / Updating Support
KoboldAI now automatically updates when you restart your Colab, and you can change gits on the fly (Some dependency limitations apply).
2022-01-17 19:54:33 +01:00
henk717 01b4e0f945
No File Allocation
Why allocate the space for a file we are downloading if there is no chance we run out of space?
2022-01-17 06:12:53 +01:00
henk717 e69c76c397
Update colabkobold.sh 2022-01-17 05:22:29 +01:00
henk717 bc3141b2e6
Easier Dropdown support for Git
Colab does not allow to define labels for the modes, so to keep things simple for a version selector United is now capitalized and Stable has been added behaving the same as leaving it empty. This does potentially break all the dev colab's, so if you forked one make sure it uses United with a capital U for maximum compatibility.
2022-01-17 05:16:03 +01:00
henk717 f44e039002
Remove --colab for now
This broke compatibility with the old colab's, will be restored during upstreaming
2022-01-16 05:25:52 +01:00
henk717 f8f60bc6b8 Update colabkobold.sh 2022-01-16 01:03:18 +01:00
henk717 9802d041aa Colab Optimizations
Breakmodel is useless on Colab, so for the sake of efficiency if --colab is present we will always assume a model is incompatible. The same applies to the conversion, colab's are discarded so converting the model to a .bin file only wastes time since the HDD isn't fast. Finally we automatically set all the useful variables for Colab, so that in the future this can be removed from ckds and other scripts.

Lastly ckds has been adapted not to copy the examples folder and to add the new --colab parameter.

Local players are much better off running the old --remote command.
2022-01-16 00:56:03 +01:00
henk717 f513f47456
Update colabkobold.sh 2022-01-11 15:08:03 +01:00
henk717 1dec4e73ee
Optimizing Google Drive extracted model support 2022-01-11 15:04:31 +01:00
henk717 2327d79fe5
Update colabkobold.sh
7Z ignores -aos for some reason, in the example they had it at the end of the command so why not?
2022-01-11 14:54:51 +01:00
henk717 61cea435ef
Update colabkobold.sh 2022-01-11 14:32:53 +01:00
henk717 5df729b337
Update colabkobold.sh 2022-01-11 14:23:48 +01:00
henk717 be77732419
Adding debuggers
Allows me to find out why it is no longer adding the path (Sorry for testing so much on the dev branch, i need the colab's to pick it up for my tests)
2022-01-11 14:23:05 +01:00
henk717 930a7d0444
Update colabkobold.sh 2022-01-11 14:20:26 +01:00
henk717 140b0f4f32
Update colabkobold.sh 2022-01-11 14:18:12 +01:00
henk717 ef69a062d5
More path fixes 2022-01-11 14:16:57 +01:00
henk717 4cd09d0385
Update colabkobold.sh 2022-01-11 14:12:05 +01:00
henk717 b5c3a6c016
Path fixes
Don't accidentally overwrite the path of the OS, and hopefully it now properly updates the variable
2022-01-11 14:09:44 +01:00
henk717 e790a4f9be
Allow model on Drive
Initial commit for extracted model support experimenting
2022-01-11 13:37:30 +01:00
henk717 85477272c3 Colab example file handling
Expands the handling of the stories to userscripts and softprompts (Since I expect us to ship an example softprompt in the future). Now also copies the examples to your Google Drive if they are not already present.
2022-01-01 19:45:32 +01:00
henk717 c5dec67f13 Fix Netbase on Colab
Apparently Colab does not properly have netbase which we now use for the proper websocket support, now the installer forces it to be correctly installed so we don't crash on launch.
2021-12-14 04:02:33 +01:00
henk717 c5ade0333a Userscript support on GDrive
Make the Colab's create and map a userscripts folder.
2021-12-14 02:51:39 +01:00
henk717 64ca337c5d Update colabkobold.sh 2021-12-10 21:34:41 +01:00
henk717 47f2544630 Location Fix
Fix the extraction location for zstd
2021-12-10 21:24:23 +01:00
henk717 9054c71515
zstd path fix 2021-12-09 18:06:54 +01:00
henk717 c36bc376c0
Revert typo fix
Wasn't a typo (Testing on git again since its easier with the colabs)
2021-12-05 18:36:54 +01:00
henk717 337941e356
Typo fix
Accidentally had a negative which should have been a positive, this should fix repo downloads.
2021-12-05 18:34:20 +01:00
henk717 9e3318c696 Update colabkobold.sh
Bugfix
2021-11-29 18:42:40 +01:00
henk717 fd19e2bfd6 Allow Ngrok
Adds --ngrok to the Colab script
2021-11-29 18:12:45 +01:00
henk717 56c2e619f9 ColabKobold
A brand new launcher to power the colab's, you can use https://henk.tech/ckds as a short URL which points towards this github
2021-11-27 03:44:08 +01:00