Commit Graph

54 Commits

Author SHA1 Message Date
Henk
548db92df5 No longer pin United 2023-07-06 14:55:54 +02:00
Henk
c72c0d0052 Pin United branch properly 2023-07-05 03:17:00 +02:00
Henk
22cf752411 Revert United colab pin since it doesn't work 2023-07-05 02:38:04 +02:00
Henk
1769691eda Possible fix 2 2023-07-05 02:35:16 +02:00
Henk
a192c74058 Possible colab URL fix 2023-07-05 02:28:48 +02:00
Henk
def39f4118 Typo fix 2023-07-05 00:02:29 +02:00
Henk
041d4135c8 Route TPU to stable commit while we fix the loader 2023-07-05 00:01:44 +02:00
Henk
503e7e780e Cleanup bridge on Colab (To prevent future bans) 2023-02-09 23:49:13 +01:00
Henk
23cd2361da Revision Fixes 2023-01-24 13:53:33 +01:00
Henk
c562c6380a Revision Fixes 2023-01-24 13:21:34 +01:00
Henk
7ffdf37c62 CKDS Revision Support
To enable Pygmalion Dev in the notebooks
2023-01-24 13:12:43 +01:00
Henk
ca52b07f13 ColabKobold Fixes
Made a few mistakes in my initial commit
2022-12-22 01:56:44 +01:00
Henk
29c4762039 ColabKobold Update
Allows ColabKobold to handle the new directories
2022-12-22 01:53:11 +01:00
Henk
9b4f434d33 Submodule support for Linux
Adds submodule support for docker and colab, also enables updating again by default. We manually disable this for official releases.
2022-12-21 03:48:14 +01:00
c1ef20bcff Also enable aria2 downloading for non-sharded checkpoints 2022-05-10 22:43:41 -04:00
a388c63023 Use aria2 to download split checkpoints 2022-05-10 21:28:13 -04:00
Henk
a82a165146 ColabKobold Fixes 2022-04-19 15:15:57 +02:00
Henk
b8e79afe5e LocalTunnel support 2022-04-19 13:47:44 +02:00
henk717
4892556059 Model saving for colab mode 2022-03-13 11:22:44 +01:00
henk717
3a5793c815 No longer uses --colab_tpu 2022-03-05 19:58:24 +01:00
henk717
935c7e5786 Improved TPU support 2022-03-05 19:47:51 +01:00
henk717
74012a24c9 Expose GDrive Models 2022-02-22 02:35:27 +01:00
henk717
040455b100 Enable Colab Mode in Colab
Now that we are ready to upstream we can safely enable the intended colab mode without breaking the old version.
2022-02-06 11:52:55 +01:00
henk717
13c54b1a89 Seperate Google Drive folders to its own section
This allows Colab developers to first get the correct folder structure on drive, before placing a configuration file for the model. That way we can quickly add the settings for a model without maintaining the init settings in two different lines. Its a substitute to the common --init only and --init skip approach from before.
2022-01-20 11:17:01 +01:00
henk717
f2bdf5a304 Git changing / Updating Support
KoboldAI now automatically updates when you restart your Colab, and you can change gits on the fly (Some dependency limitations apply).
2022-01-17 19:54:33 +01:00
henk717
01b4e0f945 No File Allocation
Why allocate the space for a file we are downloading if there is no chance we run out of space?
2022-01-17 06:12:53 +01:00
henk717
e69c76c397 Update colabkobold.sh 2022-01-17 05:22:29 +01:00
henk717
bc3141b2e6 Easier Dropdown support for Git
Colab does not allow to define labels for the modes, so to keep things simple for a version selector United is now capitalized and Stable has been added behaving the same as leaving it empty. This does potentially break all the dev colab's, so if you forked one make sure it uses United with a capital U for maximum compatibility.
2022-01-17 05:16:03 +01:00
henk717
f44e039002 Remove --colab for now
This broke compatibility with the old colab's, will be restored during upstreaming
2022-01-16 05:25:52 +01:00
henk717
f8f60bc6b8 Update colabkobold.sh 2022-01-16 01:03:18 +01:00
henk717
9802d041aa Colab Optimizations
Breakmodel is useless on Colab, so for the sake of efficiency if --colab is present we will always assume a model is incompatible. The same applies to the conversion, colab's are discarded so converting the model to a .bin file only wastes time since the HDD isn't fast. Finally we automatically set all the useful variables for Colab, so that in the future this can be removed from ckds and other scripts.

Lastly ckds has been adapted not to copy the examples folder and to add the new --colab parameter.

Local players are much better off running the old --remote command.
2022-01-16 00:56:03 +01:00
henk717
f513f47456 Update colabkobold.sh 2022-01-11 15:08:03 +01:00
henk717
1dec4e73ee Optimizing Google Drive extracted model support 2022-01-11 15:04:31 +01:00
henk717
2327d79fe5 Update colabkobold.sh
7Z ignores -aos for some reason, in the example they had it at the end of the command so why not?
2022-01-11 14:54:51 +01:00
henk717
61cea435ef Update colabkobold.sh 2022-01-11 14:32:53 +01:00
henk717
5df729b337 Update colabkobold.sh 2022-01-11 14:23:48 +01:00
henk717
be77732419 Adding debuggers
Allows me to find out why it is no longer adding the path (Sorry for testing so much on the dev branch, i need the colab's to pick it up for my tests)
2022-01-11 14:23:05 +01:00
henk717
930a7d0444 Update colabkobold.sh 2022-01-11 14:20:26 +01:00
henk717
140b0f4f32 Update colabkobold.sh 2022-01-11 14:18:12 +01:00
henk717
ef69a062d5 More path fixes 2022-01-11 14:16:57 +01:00
henk717
4cd09d0385 Update colabkobold.sh 2022-01-11 14:12:05 +01:00
henk717
b5c3a6c016 Path fixes
Don't accidentally overwrite the path of the OS, and hopefully it now properly updates the variable
2022-01-11 14:09:44 +01:00
henk717
e790a4f9be Allow model on Drive
Initial commit for extracted model support experimenting
2022-01-11 13:37:30 +01:00
henk717
85477272c3 Colab example file handling
Expands the handling of the stories to userscripts and softprompts (Since I expect us to ship an example softprompt in the future). Now also copies the examples to your Google Drive if they are not already present.
2022-01-01 19:45:32 +01:00
henk717
c5dec67f13 Fix Netbase on Colab
Apparently Colab does not properly have netbase which we now use for the proper websocket support, now the installer forces it to be correctly installed so we don't crash on launch.
2021-12-14 04:02:33 +01:00
henk717
c5ade0333a Userscript support on GDrive
Make the Colab's create and map a userscripts folder.
2021-12-14 02:51:39 +01:00
henk717
64ca337c5d Update colabkobold.sh 2021-12-10 21:34:41 +01:00
henk717
47f2544630 Location Fix
Fix the extraction location for zstd
2021-12-10 21:24:23 +01:00
henk717
9054c71515 zstd path fix 2021-12-09 18:06:54 +01:00
henk717
c36bc376c0 Revert typo fix
Wasn't a typo (Testing on git again since its easier with the colabs)
2021-12-05 18:36:54 +01:00