509b9a8936
Merge pull request #64 from VE-FORBRYDERNE/patch
...
Prevent tokenizer from taking extra time the first time it's used
2022-01-18 05:42:17 +01:00
4da1a2d247
Prevent tokenizer from taking extra time the first time it's used
2022-01-17 22:55:25 -05:00
4fac202059
TPU Colab
2022-01-18 01:48:40 +01:00
5cc065d43c
Location Fixes
2022-01-18 01:45:25 +01:00
5d01205496
Location Fixes
2022-01-18 01:19:23 +01:00
8739657abb
Syntax Fix 2
2022-01-18 01:05:04 +01:00
f20ef66b3a
Syntax Fixes
2022-01-18 01:02:35 +01:00
b81ccf1992
Update TPU.ipynb
2022-01-18 00:59:51 +01:00
cf87ea4199
Initial TPU Colab
2022-01-18 00:58:32 +01:00
f659904135
Merge pull request #63 from VE-FORBRYDERNE/patch
...
Bug fixes and polish
2022-01-17 22:01:39 +01:00
703c092577
Fix settings callback, and `genout.shape[-1]` in `tpumtjgenerate()`
2022-01-17 14:52:29 -05:00
293b75e89f
Add an `API_VERSION` variable to Lua bridge
2022-01-17 14:28:08 -05:00
3ba0e3f9d9
Dynamic TPU backend should support dynamic warpers and abort button
2022-01-17 14:10:32 -05:00
f2bdf5a304
Git changing / Updating Support
...
KoboldAI now automatically updates when you restart your Colab, and you can change gits on the fly (Some dependency limitations apply).
2022-01-17 19:54:33 +01:00
31735c4239
Fix np.take ( https://github.com/google/jax/issues/3774 )
2022-01-17 13:54:02 -05:00
6502af086f
Use `vars._actions` in `tpumtjgenerate` and its callbacks
2022-01-17 13:24:11 -05:00
45bfde8d5d
`generated_cols` needs to be set properly by TPU static backend
2022-01-17 13:19:57 -05:00
9594b2db1c
Fix soft prompt length calculation in `calcsubmitbudget()`
...
In TPU instances, `vars.sp.shape[0]` is not always the actual number of
tokens in the soft prompt. We have to use `vars.sp_length` to get an
accurate token count.
2022-01-17 13:17:20 -05:00
74f79081d1
Use `vars.model_type` to check for GPT-2 models
2022-01-17 13:13:54 -05:00
54a587d6a3
Show confirmation dialog when navigating away from UI window
2022-01-17 12:11:06 -05:00
cdf052cd03
Update socket.io.min.js to version 4.4.1
2022-01-17 12:10:46 -05:00
2aab96a755
Make Official default
2022-01-17 18:10:13 +01:00
e795dbb567
GPU Colab Descriptions
2022-01-17 17:31:23 +01:00
a4e8f0780c
Fix a typo in bridge.lua
2022-01-17 10:48:53 -05:00
1627afa8c5
Merge branch 'united' into patch
2022-01-17 10:44:34 -05:00
1ea70e4bf6
GPU colab
2022-01-17 15:06:05 +01:00
01b4e0f945
No File Allocation
...
Why allocate the space for a file we are downloading if there is no chance we run out of space?
2022-01-17 06:12:53 +01:00
e69c76c397
Update colabkobold.sh
2022-01-17 05:22:29 +01:00
bc3141b2e6
Easier Dropdown support for Git
...
Colab does not allow to define labels for the modes, so to keep things simple for a version selector United is now capitalized and Stable has been added behaving the same as leaving it empty. This does potentially break all the dev colab's, so if you forked one make sure it uses United with a capital U for maximum compatibility.
2022-01-17 05:16:03 +01:00
260f4ffae0
Merge pull request #62 from VE-FORBRYDERNE/indicator
...
Show message when TPU backend is compiling
2022-01-17 04:02:58 +01:00
33f9f2dc82
Show message when TPU backend is compiling
2022-01-16 21:09:10 -05:00
03b16ed920
Merge branch 'united' into patch
2022-01-16 00:36:55 -05:00
9a50f8d294
Merge pull request #61 from VE-FORBRYDERNE/xmap
...
Use original TPU backend when possible
2022-01-16 05:33:32 +01:00
4f0c8b6552
Merge branch 'united' into xmap
2022-01-15 23:32:12 -05:00
f4eb896a69
Use original TPU backend if possible
2022-01-15 23:31:07 -05:00
f44e039002
Remove --colab for now
...
This broke compatibility with the old colab's, will be restored during upstreaming
2022-01-16 05:25:52 +01:00
f8f60bc6b8
Update colabkobold.sh
2022-01-16 01:03:18 +01:00
9802d041aa
Colab Optimizations
...
Breakmodel is useless on Colab, so for the sake of efficiency if --colab is present we will always assume a model is incompatible. The same applies to the conversion, colab's are discarded so converting the model to a .bin file only wastes time since the HDD isn't fast. Finally we automatically set all the useful variables for Colab, so that in the future this can be removed from ckds and other scripts.
Lastly ckds has been adapted not to copy the examples folder and to add the new --colab parameter.
Local players are much better off running the old --remote command.
2022-01-16 00:56:03 +01:00
9d086e9884
Merge pull request #60 from VE-FORBRYDERNE/united
...
Mark API documentation HTML as linguist-vendored
2022-01-15 20:03:51 +01:00
48395f964c
Mark API documentation HTML as linguist-vendored
2022-01-15 13:00:58 -05:00
6a99a3a20b
Merge pull request #59 from VE-FORBRYDERNE/united
...
Upload scripting API documentation
2022-01-15 18:59:22 +01:00
8c0f0f2a9b
Upload HTML version of scripting API documentation
2022-01-15 12:57:50 -05:00
d5ca7e5807
Upload scripting API documentation
2022-01-15 12:52:22 -05:00
cbebfae236
Userscripts reorganizing
...
Moved examples to their own example directory, treating folders we didn't add as a unofficial folder, anything in examples gets submitted in commits. Because I want people to learn that kaipreset_ should only be used if a file should be part of KoboldAI's official scripts the examples do not have kaipreset_ in the name.
2022-01-15 18:16:07 +01:00
9bcc24c07e
Merge pull request #58 from VE-FORBRYDERNE/xmap
...
Dynamic TPU backend xmaps
2022-01-15 16:20:58 +01:00
877fa39b8a
Change TPU regeneration indicator message
2022-01-14 23:21:27 -05:00
bdfde33e8a
Add an indicator for when dynamic WI scan is triggered in TPU Colabs
2022-01-14 23:13:55 -05:00
e0fdce2cc6
Fix TPU generation modifier
2022-01-14 23:00:06 -05:00
932c393d6a
Add TPU support for dynamic WI scan and generation modifiers
2022-01-14 21:39:02 -05:00
0bef92419b
Convert the `jit`ted function into ordinary NumPy operations
2022-01-14 15:05:21 -05:00
henk717
Gnome Ann