Commit Graph

702 Commits

Author SHA1 Message Date
f20ef66b3a Syntax Fixes 2022-01-18 01:02:35 +01:00
b81ccf1992 Update TPU.ipynb 2022-01-18 00:59:51 +01:00
cf87ea4199 Initial TPU Colab 2022-01-18 00:58:32 +01:00
f659904135 Merge pull request #63 from VE-FORBRYDERNE/patch
Bug fixes and polish
2022-01-17 22:01:39 +01:00
703c092577 Fix settings callback, and genout.shape[-1] in tpumtjgenerate() 2022-01-17 14:52:29 -05:00
293b75e89f Add an API_VERSION variable to Lua bridge 2022-01-17 14:28:08 -05:00
3ba0e3f9d9 Dynamic TPU backend should support dynamic warpers and abort button 2022-01-17 14:10:32 -05:00
f2bdf5a304 Git changing / Updating Support
KoboldAI now automatically updates when you restart your Colab, and you can change gits on the fly (Some dependency limitations apply).
2022-01-17 19:54:33 +01:00
31735c4239 Fix np.take (https://github.com/google/jax/issues/3774) 2022-01-17 13:54:02 -05:00
6502af086f Use vars._actions in tpumtjgenerate and its callbacks 2022-01-17 13:24:11 -05:00
45bfde8d5d generated_cols needs to be set properly by TPU static backend 2022-01-17 13:19:57 -05:00
9594b2db1c Fix soft prompt length calculation in calcsubmitbudget()
In TPU instances, `vars.sp.shape[0]` is not always the actual number of
tokens in the soft prompt. We have to use `vars.sp_length` to get an
accurate token count.
2022-01-17 13:17:20 -05:00
74f79081d1 Use vars.model_type to check for GPT-2 models 2022-01-17 13:13:54 -05:00
54a587d6a3 Show confirmation dialog when navigating away from UI window 2022-01-17 12:11:06 -05:00
cdf052cd03 Update socket.io.min.js to version 4.4.1 2022-01-17 12:10:46 -05:00
2aab96a755 Make Official default 2022-01-17 18:10:13 +01:00
e795dbb567 GPU Colab Descriptions 2022-01-17 17:31:23 +01:00
a4e8f0780c Fix a typo in bridge.lua 2022-01-17 10:48:53 -05:00
1627afa8c5 Merge branch 'united' into patch 2022-01-17 10:44:34 -05:00
1ea70e4bf6 GPU colab 2022-01-17 15:06:05 +01:00
01b4e0f945 No File Allocation
Why allocate the space for a file we are downloading if there is no chance we run out of space?
2022-01-17 06:12:53 +01:00
e69c76c397 Update colabkobold.sh 2022-01-17 05:22:29 +01:00
bc3141b2e6 Easier Dropdown support for Git
Colab does not allow to define labels for the modes, so to keep things simple for a version selector United is now capitalized and Stable has been added behaving the same as leaving it empty. This does potentially break all the dev colab's, so if you forked one make sure it uses United with a capital U for maximum compatibility.
2022-01-17 05:16:03 +01:00
260f4ffae0 Merge pull request #62 from VE-FORBRYDERNE/indicator
Show message when TPU backend is compiling
2022-01-17 04:02:58 +01:00
33f9f2dc82 Show message when TPU backend is compiling 2022-01-16 21:09:10 -05:00
03b16ed920 Merge branch 'united' into patch 2022-01-16 00:36:55 -05:00
9a50f8d294 Merge pull request #61 from VE-FORBRYDERNE/xmap
Use original TPU backend when possible
2022-01-16 05:33:32 +01:00
4f0c8b6552 Merge branch 'united' into xmap 2022-01-15 23:32:12 -05:00
f4eb896a69 Use original TPU backend if possible 2022-01-15 23:31:07 -05:00
f44e039002 Remove --colab for now
This broke compatibility with the old colab's, will be restored during upstreaming
2022-01-16 05:25:52 +01:00
f8f60bc6b8 Update colabkobold.sh 2022-01-16 01:03:18 +01:00
9802d041aa Colab Optimizations
Breakmodel is useless on Colab, so for the sake of efficiency if --colab is present we will always assume a model is incompatible. The same applies to the conversion, colab's are discarded so converting the model to a .bin file only wastes time since the HDD isn't fast. Finally we automatically set all the useful variables for Colab, so that in the future this can be removed from ckds and other scripts.

Lastly ckds has been adapted not to copy the examples folder and to add the new --colab parameter.

Local players are much better off running the old --remote command.
2022-01-16 00:56:03 +01:00
9d086e9884 Merge pull request #60 from VE-FORBRYDERNE/united
Mark API documentation HTML as linguist-vendored
2022-01-15 20:03:51 +01:00
48395f964c Mark API documentation HTML as linguist-vendored 2022-01-15 13:00:58 -05:00
6a99a3a20b Merge pull request #59 from VE-FORBRYDERNE/united
Upload scripting API documentation
2022-01-15 18:59:22 +01:00
8c0f0f2a9b Upload HTML version of scripting API documentation 2022-01-15 12:57:50 -05:00
d5ca7e5807 Upload scripting API documentation 2022-01-15 12:52:22 -05:00
cbebfae236 Userscripts reorganizing
Moved examples to their own example directory, treating folders we didn't add as a unofficial folder, anything in examples gets submitted in commits. Because I want people to learn that kaipreset_ should only be used if a file should be part of KoboldAI's official scripts the examples do not have kaipreset_ in the name.
2022-01-15 18:16:07 +01:00
9bcc24c07e Merge pull request #58 from VE-FORBRYDERNE/xmap
Dynamic TPU backend xmaps
2022-01-15 16:20:58 +01:00
877fa39b8a Change TPU regeneration indicator message 2022-01-14 23:21:27 -05:00
bdfde33e8a Add an indicator for when dynamic WI scan is triggered in TPU Colabs 2022-01-14 23:13:55 -05:00
e0fdce2cc6 Fix TPU generation modifier 2022-01-14 23:00:06 -05:00
932c393d6a Add TPU support for dynamic WI scan and generation modifiers 2022-01-14 21:39:02 -05:00
0bef92419b Convert the jitted function into ordinary NumPy operations 2022-01-14 15:05:21 -05:00
57a6886007 Move sampling into a jax.jitted function 2022-01-14 02:23:19 -05:00
a329ed19f6 Merge branch 'scripts' into patch 2022-01-13 22:36:10 -05:00
cf9a4b7e6b Fix typos in error messages 2022-01-13 22:33:55 -05:00
53b91c6406 Small changes 2022-01-14 02:03:46 +01:00
25790ddc60 Merge pull request #57 from AngryBeeSec/main
Fixes OSError: Protocol  not found
2022-01-14 01:36:45 +01:00
3b42f31137 K: -> B: Drive
Pre-emptive change for people who may have existing K: drives. B: is never used unless its by programs like ours which is very rare. The installer now always installs as B:, but to maintain compatibility with older runtimes the scripts check if its K: or B:.
2022-01-13 23:52:21 +01:00