666 Commits

Author SHA1 Message Date
Gnome Ann
4f0c8b6552 Merge branch 'united' into xmap 2022-01-15 23:32:12 -05:00
Gnome Ann
f4eb896a69 Use original TPU backend if possible 2022-01-15 23:31:07 -05:00
henk717
f8f60bc6b8 Update colabkobold.sh 2022-01-16 01:03:18 +01:00
henk717
9802d041aa Colab Optimizations
Breakmodel is useless on Colab, so for the sake of efficiency if --colab is present we will always assume a model is incompatible. The same applies to the conversion, colab's are discarded so converting the model to a .bin file only wastes time since the HDD isn't fast. Finally we automatically set all the useful variables for Colab, so that in the future this can be removed from ckds and other scripts.

Lastly ckds has been adapted not to copy the examples folder and to add the new --colab parameter.

Local players are much better off running the old --remote command.
2022-01-16 00:56:03 +01:00
henk717
9d086e9884
Merge pull request #60 from VE-FORBRYDERNE/united
Mark API documentation HTML as linguist-vendored
2022-01-15 20:03:51 +01:00
Gnome Ann
48395f964c Mark API documentation HTML as linguist-vendored 2022-01-15 13:00:58 -05:00
henk717
6a99a3a20b
Merge pull request #59 from VE-FORBRYDERNE/united
Upload scripting API documentation
2022-01-15 18:59:22 +01:00
Gnome Ann
8c0f0f2a9b Upload HTML version of scripting API documentation 2022-01-15 12:57:50 -05:00
Gnome Ann
d5ca7e5807 Upload scripting API documentation 2022-01-15 12:52:22 -05:00
henk717
cbebfae236 Userscripts reorganizing
Moved examples to their own example directory, treating folders we didn't add as a unofficial folder, anything in examples gets submitted in commits. Because I want people to learn that kaipreset_ should only be used if a file should be part of KoboldAI's official scripts the examples do not have kaipreset_ in the name.
2022-01-15 18:16:07 +01:00
henk717
9bcc24c07e
Merge pull request #58 from VE-FORBRYDERNE/xmap
Dynamic TPU backend xmaps
2022-01-15 16:20:58 +01:00
Gnome Ann
877fa39b8a Change TPU regeneration indicator message 2022-01-14 23:21:27 -05:00
Gnome Ann
bdfde33e8a Add an indicator for when dynamic WI scan is triggered in TPU Colabs 2022-01-14 23:13:55 -05:00
Gnome Ann
e0fdce2cc6 Fix TPU generation modifier 2022-01-14 23:00:06 -05:00
Gnome Ann
932c393d6a Add TPU support for dynamic WI scan and generation modifiers 2022-01-14 21:39:02 -05:00
Gnome Ann
0bef92419b Convert the jitted function into ordinary NumPy operations 2022-01-14 15:05:21 -05:00
Gnome Ann
57a6886007 Move sampling into a jax.jitted function 2022-01-14 02:23:19 -05:00
henk717
53b91c6406 Small changes 2022-01-14 02:03:46 +01:00
henk717
25790ddc60
Merge pull request #57 from AngryBeeSec/main
Fixes OSError: Protocol  not found
2022-01-14 01:36:45 +01:00
henk717
3b42f31137 K: -> B: Drive
Pre-emptive change for people who may have existing K: drives. B: is never used unless its by programs like ours which is very rare. The installer now always installs as B:, but to maintain compatibility with older runtimes the scripts check if its K: or B:.
2022-01-13 23:52:21 +01:00
henk717
e277068bf2 Allow input_box resizing
For when you need a larger input box you can now resize it.

The whole UI could use an overhaul to make it dynamic. But I lack the experience to do this properly as I am not a web developer. Someone else with CSS knowledge feel free to make it so the UI allows for better resizing and automatically scales the gamescreen based on what is on display so it no longer pushes elements out of view.
2022-01-13 23:10:53 +01:00
Gnome Ann
09c4fdcb2e Split generate_xmap into two xmaps 2022-01-13 00:56:00 -05:00
Gnome Ann
a3d6dc93e8 xmaps for moving things onto TPU 2022-01-12 21:45:30 -05:00
AngryBeeSec
92a8f7beee
Fixes OSError: Protocol not found
Fixes an issue with tcp not being found in the protocols list
2022-01-11 22:30:40 -05:00
henk717
49e2bcab1a Allow unique chatnames in multiplayer
No longer update the chatname outside of the config, this will not effect singleplayer tab at all, but it will allow people in multiplayer to chat with their own names.
2022-01-11 21:31:44 +01:00
henk717
f513f47456
Update colabkobold.sh 2022-01-11 15:08:03 +01:00
henk717
1dec4e73ee
Optimizing Google Drive extracted model support 2022-01-11 15:04:31 +01:00
henk717
2327d79fe5
Update colabkobold.sh
7Z ignores -aos for some reason, in the example they had it at the end of the command so why not?
2022-01-11 14:54:51 +01:00
henk717
61cea435ef
Update colabkobold.sh 2022-01-11 14:32:53 +01:00
henk717
5df729b337
Update colabkobold.sh 2022-01-11 14:23:48 +01:00
henk717
be77732419
Adding debuggers
Allows me to find out why it is no longer adding the path (Sorry for testing so much on the dev branch, i need the colab's to pick it up for my tests)
2022-01-11 14:23:05 +01:00
henk717
930a7d0444
Update colabkobold.sh 2022-01-11 14:20:26 +01:00
henk717
140b0f4f32
Update colabkobold.sh 2022-01-11 14:18:12 +01:00
henk717
ef69a062d5
More path fixes 2022-01-11 14:16:57 +01:00
henk717
4cd09d0385
Update colabkobold.sh 2022-01-11 14:12:05 +01:00
henk717
b5c3a6c016
Path fixes
Don't accidentally overwrite the path of the OS, and hopefully it now properly updates the variable
2022-01-11 14:09:44 +01:00
henk717
e790a4f9be
Allow model on Drive
Initial commit for extracted model support experimenting
2022-01-11 13:37:30 +01:00
henk717
3f88b4f840 Server clarification
To prevent confusion with users who have not used KoboldAI for a while, or who are following old tutorials I have added a disclaimer that informs people that most Colab links should not be used with this feature and instead opened in the browser.
2022-01-11 00:35:20 +01:00
henk717
d2947bd1cc Small model description update 2022-01-11 00:29:35 +01:00
henk717
5fc0509ae3
Merge pull request #56 from VE-FORBRYDERNE/concurrency
Compile TPU backend in background
2022-01-07 20:24:23 +01:00
Gnome Ann
fbc3a73c0f Compile TPU backend in background 2022-01-07 13:47:21 -05:00
henk717
38a3eddd57
Merge pull request #55 from VE-FORBRYDERNE/patch
Various fixes
2022-01-06 01:21:59 +01:00
Gnome Ann
01479c29ea Fix the type hint for bridged_kwarg decorator 2022-01-04 20:48:34 -05:00
Gnome Ann
fc6caa0df0 Easier method of adding kwargs to bridged in aiserver.py 2022-01-04 19:36:21 -05:00
Gnome Ann
fbf5062074 Add option to compute_context() to not scan story 2022-01-04 19:26:59 -05:00
Gnome Ann
6edc6387f4 Accept command line arguments in KOBOLDAI_ARGS environment var
So that you can use gunicorn or whatever with command-line arguments by
passing the arguments in an environment variable.
2022-01-04 17:11:14 -05:00
Gnome Ann
aa86c6001c --breakmodel_gpublocks should handle -1 properly now 2022-01-04 14:43:37 -05:00
Gnome Ann
2fc0bdfcba Correct a typo in restorePrompt() 2022-01-04 14:41:31 -05:00
Gnome Ann
e20452ddd8 Retrying random story generation now also remembers memory 2022-01-04 14:40:10 -05:00
Gnome Ann
f46ebd2359 Always pass 1.1 as repetition penalty to generator
The `dynamic_processor_wrap` makes it so that the repetition penalty is
read directly from `vars`, but this only works if the initial repetition
sent to `generator` is not equal to 1. So we are now forcing the initial
repetition penalty to be something other than 1.
2022-01-04 14:18:58 -05:00