Commit Graph

109 Commits

Author SHA1 Message Date
Gnome Ann 85151cec7b Prevent white border on chunks with Allow Edit off 2021-08-23 14:53:18 -04:00
Gnome Ann 81c83dfef7 Fix bug where chunks still editable with Allow Editing off
If, with Allow Editing on, you change a chunk and then click directly on
the "Allow Editing" switch again to turn it off without defocusing the
chunk in-between (by clicking outside the chunk, using enter/escape,
etc), all story chunks would still be editable.
That behaviour has now been fixed.
2021-08-23 14:25:40 -04:00
Gnome Ann 723e02d793 Improve story chunk blurring 2021-08-23 14:05:40 -04:00
Gnome Ann 2071daf335 Remove the Delete button 2021-08-23 13:22:50 -04:00
Gnome Ann f1f50e7b80 Remove display: flex; from #gamescreen CSS 2021-08-23 13:08:13 -04:00
Gnome Ann 42b4104d4f Use henk717's modified CSS for editable chunks 2021-08-23 13:06:27 -04:00
Gnome Ann 67521d53f9 You can now click on story chunks to edit them 2021-08-23 02:34:27 -04:00
henk717 2fd544cad7 Change max tokens to 4096
It works smoothly on the TPU colab, so lets allow it. People should not turn this all the way up unless they got the hardware, but we want to allow this for those that do.
2021-08-22 20:59:47 +02:00
henk717 a151e1a33a Small fix for Authors Notes in multiplayer
Multiplayer support was causing all players to automatically submit authors notes. This is now fixed only the person submitting the authors notes counts.
2021-08-22 15:54:35 +02:00
henk717 09ec15c91b
Merge pull request #3 from VE-FORBRYDERNE/breakmodel
Low VRAM patch
2021-08-21 21:03:46 +02:00
Gnome Ann 3c9ce2c541 Use torch.no_grad() and more garbage collection 2021-08-21 12:15:31 -04:00
Gnome Ann fae15b8a17 Fix typo in previous commit 2021-08-21 10:54:57 -04:00
Gnome Ann a8bbfab87a Actually use args.breakmodel_layers 2021-08-20 20:50:03 -04:00
Gnome Ann e00d9c4362 breakmodel fix for models without lm_head 2021-08-20 19:32:18 -04:00
Gnome Ann 8bfcf86a8b Fix for non-rotary models without "rotary" in config.json 2021-08-20 13:00:53 -04:00
henk717 68836728d4 Update World Info on Submit
Still VERY far from ideal for multiplayer, only one person can realistically edit it at a time. Whoever submits counts. Will need more major interface changes so things can be submitted one by one. But hey, it works and its good enough for a group of friends to play the game :D
2021-08-20 17:51:49 +02:00
Gnome Ann 56c9dc2c04 Fix "Expected all tensors to" on non-rotary models
Expected all tensors to be on the same device, but found at least two devices, cpu and cuda:0! (when checking arugment for argument index in method wrapper_index_select)
2021-08-20 11:34:31 -04:00
Gnome Ann 5f82e5ba0d Also clear CUDA cache twice if using breakmodel 2021-08-20 11:17:34 -04:00
Gnome Ann f986c65a4e Manually strip and decode tokens if not using a pipeline 2021-08-20 11:15:32 -04:00
Gnome Ann 7717168676 Only allow --breakmodel if it's supported 2021-08-20 10:52:57 -04:00
Gnome Ann eef0db8dee Specifically import torch.cuda.comm in breakmodel.py 2021-08-20 10:47:54 -04:00
Gnome Ann b1c13f832a Implement arrmansa's low VRAM patch 2021-08-20 10:25:03 -04:00
henk717 f12e3576a8 Multiple Browser Session Syncing
Multiplayer anyone? :D
2021-08-20 15:32:02 +02:00
henk717 dd77ac2f3a GPU detection bugfix 2021-08-20 12:30:52 +02:00
henk717 99c5ff240c Command Line Part 2
Automated Colab and GPU selection
2021-08-20 11:39:04 +02:00
henk717 ba20c3407c Command line support
Added command line options for model selection, this makes it usable inside Google Colab or other unattended servers people might want to use/provide.
2021-08-20 10:49:35 +02:00
henk717 136dd71171 Added --remote Mode
First step towards native Colab support, built in Cloudflare tunnels easily allows players to play KoboldAI on another device. This mode also removes buttons that would get you stuck if you have no local PC access.
2021-08-20 00:37:59 +02:00
henk717 9760c159fd Allow using Jupyter inside the KoboldAI environment
Not used by the game, but can be useful for running and troubleshooting notebook features.
2021-08-19 16:20:41 +02:00
henk717 a0ed12a74a Update readme.txt 2021-08-19 14:50:07 +02:00
henk717 72bfc417da top_k and tfs support by Frogging101
Adds top_k and tfs support, also fixes a SocketIO error.
2021-08-19 14:47:57 +02:00
henk717 caee12eae0 Updated credits
Forgot to give credit for Selective World Info, this is now fixed.
2021-08-19 13:55:59 +02:00
henk717 33215a87b3 Added VE_FORBRYDERNE's Selective World Info
This update allows you to selectively choose when World Info is loaded for more control and RAM savings.
2021-08-19 13:48:33 +02:00
henk717 00414d26e2 Integrated VE_FORBRYDERNE's Adventure Mode + Cleanup
Adventure Mode allows you to play this like AID, perfect for Choose your own Adventure models
2021-08-19 13:18:01 +02:00
henk717 efbe40f1f6 Random Story Generator
Add the Random Story Generator and more userfriendly defaults
2021-08-19 12:54:44 +02:00
henk717 17dce2e16c
Update readme.txt 2021-08-19 01:26:03 +02:00
henk717 2a191c2d7c
Update readme.txt 2021-08-19 01:24:01 +02:00
KoboldAI Dev 91efd9a946
Merge pull request #59 from henk717/mamba
The Mamba Installer Update
2021-07-14 12:10:11 -04:00
henk717 1327bd30a5 The Mamba Installer Update
Big overhaul of the installer, partially based on the #53  commit from LexSong.

The following is new :
- Conda has been replaced with MicroMamba, allows the dependencies to automatically download the best version of Python and prevents all the issues with people failing to download conda.
- The installer now has more options so you can choose not to delete the existing files, and it has new optional virtual K: drive support to bypass all the pathing issues people are having (Sorry Windows 7 users, its still not compatible even now).
- Docker support for Linux systems has been added including ROCm support.
- Environment files are now used to more easily keep everything on track, and to allow conda users to manually create environments across all operating systems (ROCm is an outlier in this because i have to use AMD's Pytorch docker for now it was to much hassle getting their Conda to use the environment file to add it to this commit).
- Play.bat has been changed to allow the virtual drive support, everything should still be compatible with old installations as I kept all the paths intact.
2021-06-28 22:35:15 +02:00
KoboldAI Dev 97aba93ef1
Added AGPLv3 license 2021-06-25 15:28:42 -04:00
KoboldAI Dev 9c908fd22f
Merge pull request #50 from henk717/patch-5
Migrated install_requirements.bat to conda-forge
2021-06-17 21:48:56 -04:00
henk717 d38384628c
Migrated install_requirements.bat to conda-forge
No more manually forcing CUDA to be 11, instead we use conda-forge.
This will pull down a lot more recent versions of pretty much everything, and fixes errors in the GPT-J models that cropped up on the older versions of the dependencies.
2021-06-18 01:33:56 +02:00
KoboldAI Dev 09f407c62e
Merge pull request #47 from henk717/patch-4
Installer: 6B update & stability fixes
2021-06-16 21:50:44 -04:00
henk717 80ebe1f368
6B update & stability fixes
I changed the menu order around because Finetuneanon's version is better for most users and needed for 6B.
The github branch it downloads for finetune is updated, and it can now fix the download path length errors if ran as admin.
2021-06-17 03:47:59 +02:00
KoboldAI Dev b4fef1de1b
Merge pull request #40 from henk717/patch-3
Bugfix: Force CUDA11 in new installer for 3000 series GPU's
2021-06-08 22:43:30 -04:00
henk717 2e290ed9b9
Force CUDA11
Important fix for 3000 series GPU's, this additional parameter forces CUDA11 fixing them not being able to use GPU mode.
2021-06-08 16:23:38 +02:00
KoboldAI Dev 732e836028
Merge pull request #38 from henk717/patch-2
Update to Play.bat to use miniconda environment if present. Otherwise falls back to system Python.
2021-06-08 03:51:18 -04:00
KoboldAI Dev 736bd03161
Update play.bat
Added cls line to remove error message if miniconda is not being used.
2021-06-08 03:50:31 -04:00
KoboldAI Dev b18a4174ef
Merge pull request #37 from henk717/patch-1
Install process updated to use miniconda environment to reduce issues with existing Python installs on user's machines.
2021-06-08 03:49:10 -04:00
KoboldAI Dev d1036b66df
Update install_requirements.bat
Changed description of transformers options.
2021-06-08 03:46:43 -04:00
henk717 2f10059cd2
Changed Play.Bat to use our own Miniconda3 2021-06-06 15:02:03 +02:00