Commit Graph

720 Commits

Author SHA1 Message Date
henk717 b54d66c522 Predefined Settings 2022-01-20 13:44:04 +01:00
henk717 9564ac1892 Adds GPT-Neo-2.7B-AID 2022-01-20 11:22:20 +01:00
henk717 13c54b1a89 Seperate Google Drive folders to its own section
This allows Colab developers to first get the correct folder structure on drive, before placing a configuration file for the model. That way we can quickly add the settings for a model without maintaining the init settings in two different lines. Its a substitute to the common --init only and --init skip approach from before.
2022-01-20 11:17:01 +01:00
henk717 9532b56cb8 Universal Model Settings
No longer depends on a local config file enabling the configuration to work in --colab mode.
2022-01-20 10:11:11 +01:00
henk717 c25e2a33f1
Merge pull request #66 from VE-FORBRYDERNE/patch
Set eventlet threadpool size back to 1
2022-01-20 08:31:53 +01:00
Gnome Ann c703729f0b Set eventlet threadpool size back to 1 2022-01-20 02:10:57 -05:00
Gnome Ann f0c39c004a Deleting world info entries should call `setgamesaved(False)` 2022-01-18 19:36:20 -05:00
henk717 4ca06ebcf3
Merge pull request #65 from VE-FORBRYDERNE/sp
Show author and SP length in soft prompt menu
2022-01-18 23:51:02 +01:00
henk717 1e0f9ada08
Add adventure 2.7B
Its on Huggingface now, so lets add it to the menu!
2022-01-18 23:50:21 +01:00
Gnome Ann 3018322963 Detect and show properly when story is unsaved 2022-01-18 17:20:45 -05:00
Gnome Ann 1951ccd2ce Show author and SP length in soft prompt menu 2022-01-18 16:30:09 -05:00
henk717 1e2dbd42a6 VSCode version of ColabKobold meant for development 2022-01-18 19:20:43 +01:00
henk717 509b9a8936
Merge pull request #64 from VE-FORBRYDERNE/patch
Prevent tokenizer from taking extra time the first time it's used
2022-01-18 05:42:17 +01:00
Gnome Ann 4da1a2d247 Prevent tokenizer from taking extra time the first time it's used 2022-01-17 22:55:25 -05:00
henk717 4fac202059 TPU Colab 2022-01-18 01:48:40 +01:00
henk717 5cc065d43c Location Fixes 2022-01-18 01:45:25 +01:00
henk717 5d01205496 Location Fixes 2022-01-18 01:19:23 +01:00
henk717 8739657abb
Syntax Fix 2 2022-01-18 01:05:04 +01:00
henk717 f20ef66b3a
Syntax Fixes 2022-01-18 01:02:35 +01:00
henk717 b81ccf1992
Update TPU.ipynb 2022-01-18 00:59:51 +01:00
henk717 cf87ea4199 Initial TPU Colab 2022-01-18 00:58:32 +01:00
henk717 f659904135
Merge pull request #63 from VE-FORBRYDERNE/patch
Bug fixes and polish
2022-01-17 22:01:39 +01:00
Gnome Ann 703c092577 Fix settings callback, and `genout.shape[-1]` in `tpumtjgenerate()` 2022-01-17 14:52:29 -05:00
Gnome Ann 293b75e89f Add an `API_VERSION` variable to Lua bridge 2022-01-17 14:28:08 -05:00
Gnome Ann 3ba0e3f9d9 Dynamic TPU backend should support dynamic warpers and abort button 2022-01-17 14:10:32 -05:00
henk717 f2bdf5a304
Git changing / Updating Support
KoboldAI now automatically updates when you restart your Colab, and you can change gits on the fly (Some dependency limitations apply).
2022-01-17 19:54:33 +01:00
Gnome Ann 31735c4239 Fix np.take (https://github.com/google/jax/issues/3774) 2022-01-17 13:54:02 -05:00
Gnome Ann 6502af086f Use `vars._actions` in `tpumtjgenerate` and its callbacks 2022-01-17 13:24:11 -05:00
Gnome Ann 45bfde8d5d `generated_cols` needs to be set properly by TPU static backend 2022-01-17 13:19:57 -05:00
Gnome Ann 9594b2db1c Fix soft prompt length calculation in `calcsubmitbudget()`
In TPU instances, `vars.sp.shape[0]` is not always the actual number of
tokens in the soft prompt. We have to use `vars.sp_length` to get an
accurate token count.
2022-01-17 13:17:20 -05:00
Gnome Ann 74f79081d1 Use `vars.model_type` to check for GPT-2 models 2022-01-17 13:13:54 -05:00
Gnome Ann 54a587d6a3 Show confirmation dialog when navigating away from UI window 2022-01-17 12:11:06 -05:00
Gnome Ann cdf052cd03 Update socket.io.min.js to version 4.4.1 2022-01-17 12:10:46 -05:00
henk717 2aab96a755 Make Official default 2022-01-17 18:10:13 +01:00
henk717 e795dbb567 GPU Colab Descriptions 2022-01-17 17:31:23 +01:00
Gnome Ann a4e8f0780c Fix a typo in bridge.lua 2022-01-17 10:48:53 -05:00
Gnome Ann 1627afa8c5 Merge branch 'united' into patch 2022-01-17 10:44:34 -05:00
henk717 1ea70e4bf6 GPU colab 2022-01-17 15:06:05 +01:00
henk717 01b4e0f945
No File Allocation
Why allocate the space for a file we are downloading if there is no chance we run out of space?
2022-01-17 06:12:53 +01:00
henk717 e69c76c397
Update colabkobold.sh 2022-01-17 05:22:29 +01:00
henk717 bc3141b2e6
Easier Dropdown support for Git
Colab does not allow to define labels for the modes, so to keep things simple for a version selector United is now capitalized and Stable has been added behaving the same as leaving it empty. This does potentially break all the dev colab's, so if you forked one make sure it uses United with a capital U for maximum compatibility.
2022-01-17 05:16:03 +01:00
henk717 260f4ffae0
Merge pull request #62 from VE-FORBRYDERNE/indicator
Show message when TPU backend is compiling
2022-01-17 04:02:58 +01:00
Gnome Ann 33f9f2dc82 Show message when TPU backend is compiling 2022-01-16 21:09:10 -05:00
Gnome Ann 03b16ed920 Merge branch 'united' into patch 2022-01-16 00:36:55 -05:00
henk717 9a50f8d294
Merge pull request #61 from VE-FORBRYDERNE/xmap
Use original TPU backend when possible
2022-01-16 05:33:32 +01:00
Gnome Ann 4f0c8b6552 Merge branch 'united' into xmap 2022-01-15 23:32:12 -05:00
Gnome Ann f4eb896a69 Use original TPU backend if possible 2022-01-15 23:31:07 -05:00
henk717 f44e039002
Remove --colab for now
This broke compatibility with the old colab's, will be restored during upstreaming
2022-01-16 05:25:52 +01:00
henk717 f8f60bc6b8 Update colabkobold.sh 2022-01-16 01:03:18 +01:00
henk717 9802d041aa Colab Optimizations
Breakmodel is useless on Colab, so for the sake of efficiency if --colab is present we will always assume a model is incompatible. The same applies to the conversion, colab's are discarded so converting the model to a .bin file only wastes time since the HDD isn't fast. Finally we automatically set all the useful variables for Colab, so that in the future this can be removed from ckds and other scripts.

Lastly ckds has been adapted not to copy the examples folder and to add the new --colab parameter.

Local players are much better off running the old --remote command.
2022-01-16 00:56:03 +01:00