henk717
4fac202059
TPU Colab
2022-01-18 01:48:40 +01:00
henk717
5cc065d43c
Location Fixes
2022-01-18 01:45:25 +01:00
henk717
5d01205496
Location Fixes
2022-01-18 01:19:23 +01:00
henk717
8739657abb
Syntax Fix 2
2022-01-18 01:05:04 +01:00
henk717
f20ef66b3a
Syntax Fixes
2022-01-18 01:02:35 +01:00
henk717
b81ccf1992
Update TPU.ipynb
2022-01-18 00:59:51 +01:00
henk717
cf87ea4199
Initial TPU Colab
2022-01-18 00:58:32 +01:00
henk717
f659904135
Merge pull request #63 from VE-FORBRYDERNE/patch
...
Bug fixes and polish
2022-01-17 22:01:39 +01:00
Gnome Ann
703c092577
Fix settings callback, and genout.shape[-1] in tpumtjgenerate()
2022-01-17 14:52:29 -05:00
Gnome Ann
293b75e89f
Add an API_VERSION variable to Lua bridge
2022-01-17 14:28:08 -05:00
Gnome Ann
3ba0e3f9d9
Dynamic TPU backend should support dynamic warpers and abort button
2022-01-17 14:10:32 -05:00
henk717
f2bdf5a304
Git changing / Updating Support
...
KoboldAI now automatically updates when you restart your Colab, and you can change gits on the fly (Some dependency limitations apply).
2022-01-17 19:54:33 +01:00
Gnome Ann
31735c4239
Fix np.take ( https://github.com/google/jax/issues/3774 )
2022-01-17 13:54:02 -05:00
Gnome Ann
6502af086f
Use vars._actions in tpumtjgenerate and its callbacks
2022-01-17 13:24:11 -05:00
Gnome Ann
45bfde8d5d
generated_cols needs to be set properly by TPU static backend
2022-01-17 13:19:57 -05:00
Gnome Ann
9594b2db1c
Fix soft prompt length calculation in calcsubmitbudget()
...
In TPU instances, `vars.sp.shape[0]` is not always the actual number of
tokens in the soft prompt. We have to use `vars.sp_length` to get an
accurate token count.
2022-01-17 13:17:20 -05:00
Gnome Ann
74f79081d1
Use vars.model_type to check for GPT-2 models
2022-01-17 13:13:54 -05:00
Gnome Ann
54a587d6a3
Show confirmation dialog when navigating away from UI window
2022-01-17 12:11:06 -05:00
Gnome Ann
cdf052cd03
Update socket.io.min.js to version 4.4.1
2022-01-17 12:10:46 -05:00
henk717
2aab96a755
Make Official default
2022-01-17 18:10:13 +01:00
henk717
e795dbb567
GPU Colab Descriptions
2022-01-17 17:31:23 +01:00
Gnome Ann
a4e8f0780c
Fix a typo in bridge.lua
2022-01-17 10:48:53 -05:00
Gnome Ann
1627afa8c5
Merge branch 'united' into patch
2022-01-17 10:44:34 -05:00
henk717
1ea70e4bf6
GPU colab
2022-01-17 15:06:05 +01:00
henk717
01b4e0f945
No File Allocation
...
Why allocate the space for a file we are downloading if there is no chance we run out of space?
2022-01-17 06:12:53 +01:00
henk717
e69c76c397
Update colabkobold.sh
2022-01-17 05:22:29 +01:00
henk717
bc3141b2e6
Easier Dropdown support for Git
...
Colab does not allow to define labels for the modes, so to keep things simple for a version selector United is now capitalized and Stable has been added behaving the same as leaving it empty. This does potentially break all the dev colab's, so if you forked one make sure it uses United with a capital U for maximum compatibility.
2022-01-17 05:16:03 +01:00
henk717
260f4ffae0
Merge pull request #62 from VE-FORBRYDERNE/indicator
...
Show message when TPU backend is compiling
2022-01-17 04:02:58 +01:00
Gnome Ann
33f9f2dc82
Show message when TPU backend is compiling
2022-01-16 21:09:10 -05:00
Gnome Ann
03b16ed920
Merge branch 'united' into patch
2022-01-16 00:36:55 -05:00
henk717
9a50f8d294
Merge pull request #61 from VE-FORBRYDERNE/xmap
...
Use original TPU backend when possible
2022-01-16 05:33:32 +01:00
Gnome Ann
4f0c8b6552
Merge branch 'united' into xmap
2022-01-15 23:32:12 -05:00
Gnome Ann
f4eb896a69
Use original TPU backend if possible
2022-01-15 23:31:07 -05:00
henk717
f44e039002
Remove --colab for now
...
This broke compatibility with the old colab's, will be restored during upstreaming
2022-01-16 05:25:52 +01:00
henk717
f8f60bc6b8
Update colabkobold.sh
2022-01-16 01:03:18 +01:00
henk717
9802d041aa
Colab Optimizations
...
Breakmodel is useless on Colab, so for the sake of efficiency if --colab is present we will always assume a model is incompatible. The same applies to the conversion, colab's are discarded so converting the model to a .bin file only wastes time since the HDD isn't fast. Finally we automatically set all the useful variables for Colab, so that in the future this can be removed from ckds and other scripts.
Lastly ckds has been adapted not to copy the examples folder and to add the new --colab parameter.
Local players are much better off running the old --remote command.
2022-01-16 00:56:03 +01:00
henk717
9d086e9884
Merge pull request #60 from VE-FORBRYDERNE/united
...
Mark API documentation HTML as linguist-vendored
2022-01-15 20:03:51 +01:00
Gnome Ann
48395f964c
Mark API documentation HTML as linguist-vendored
2022-01-15 13:00:58 -05:00
henk717
6a99a3a20b
Merge pull request #59 from VE-FORBRYDERNE/united
...
Upload scripting API documentation
2022-01-15 18:59:22 +01:00
Gnome Ann
8c0f0f2a9b
Upload HTML version of scripting API documentation
2022-01-15 12:57:50 -05:00
Gnome Ann
d5ca7e5807
Upload scripting API documentation
2022-01-15 12:52:22 -05:00
henk717
cbebfae236
Userscripts reorganizing
...
Moved examples to their own example directory, treating folders we didn't add as a unofficial folder, anything in examples gets submitted in commits. Because I want people to learn that kaipreset_ should only be used if a file should be part of KoboldAI's official scripts the examples do not have kaipreset_ in the name.
2022-01-15 18:16:07 +01:00
henk717
9bcc24c07e
Merge pull request #58 from VE-FORBRYDERNE/xmap
...
Dynamic TPU backend xmaps
2022-01-15 16:20:58 +01:00
Gnome Ann
877fa39b8a
Change TPU regeneration indicator message
2022-01-14 23:21:27 -05:00
Gnome Ann
bdfde33e8a
Add an indicator for when dynamic WI scan is triggered in TPU Colabs
2022-01-14 23:13:55 -05:00
Gnome Ann
e0fdce2cc6
Fix TPU generation modifier
2022-01-14 23:00:06 -05:00
Gnome Ann
932c393d6a
Add TPU support for dynamic WI scan and generation modifiers
2022-01-14 21:39:02 -05:00
Gnome Ann
0bef92419b
Convert the jitted function into ordinary NumPy operations
2022-01-14 15:05:21 -05:00
Gnome Ann
57a6886007
Move sampling into a jax.jitted function
2022-01-14 02:23:19 -05:00
Gnome Ann
a329ed19f6
Merge branch 'scripts' into patch
2022-01-13 22:36:10 -05:00
