In TPU instances, `vars.sp.shape[0]` is not always the actual number of
tokens in the soft prompt. We have to use `vars.sp_length` to get an
accurate token count.
Colab does not allow to define labels for the modes, so to keep things simple for a version selector United is now capitalized and Stable has been added behaving the same as leaving it empty. This does potentially break all the dev colab's, so if you forked one make sure it uses United with a capital U for maximum compatibility.
Breakmodel is useless on Colab, so for the sake of efficiency if --colab is present we will always assume a model is incompatible. The same applies to the conversion, colab's are discarded so converting the model to a .bin file only wastes time since the HDD isn't fast. Finally we automatically set all the useful variables for Colab, so that in the future this can be removed from ckds and other scripts.
Lastly ckds has been adapted not to copy the examples folder and to add the new --colab parameter.
Local players are much better off running the old --remote command.
Moved examples to their own example directory, treating folders we didn't add as a unofficial folder, anything in examples gets submitted in commits. Because I want people to learn that kaipreset_ should only be used if a file should be part of KoboldAI's official scripts the examples do not have kaipreset_ in the name.
Pre-emptive change for people who may have existing K: drives. B: is never used unless its by programs like ours which is very rare. The installer now always installs as B:, but to maintain compatibility with older runtimes the scripts check if its K: or B:.
For when you need a larger input box you can now resize it.
The whole UI could use an overhaul to make it dynamic. But I lack the experience to do this properly as I am not a web developer. Someone else with CSS knowledge feel free to make it so the UI allows for better resizing and automatically scales the gamescreen based on what is on display so it no longer pushes elements out of view.
henk717
Gnome Ann