Commit Graph

97 Commits

Author SHA1 Message Date
6668bada47 New documentation
Replaces the placeholder readme with a proper one, the menu is also updated and reorganized to encourage users to use custom models and to better reflect the real world VRAM requirements.
2021-09-02 14:04:25 +02:00
24d57a7ac3 Clip off ".json" from story name when downloading 2021-09-01 14:07:56 -04:00
7e1b1add11 Don't import breakmodel until it's actually needed
breakmodel imports torch which takes a long time to import.
We should delay the importing of torch as long as possible.
2021-09-01 14:04:37 -04:00
6bd6415749 Prevent remote-mode-forbidden actions server-side
Since some user interface buttons are disabled while in --remote mode,
they should also be disabled in aiserver.py so a malicious user can't
manually send those commands to the server.
2021-09-01 13:55:25 -04:00
8ae9304cda Clean up code for saving story as plaintext 2021-09-01 13:49:04 -04:00
543acf9ba4 Also allow downloading stories as plaintext 2021-09-01 13:46:37 -04:00
fab51b64a3 Don't leave memory mode when downloading 2021-09-01 13:36:05 -04:00
b5d9aaf785 Remember to actually import "Response" from flask 2021-09-01 13:31:05 -04:00
4e9b371564 Merge branch 'united' into story-manager 2021-09-01 13:25:28 -04:00
16184ceee8 Catch and display errors from "Save As" 2021-09-01 12:58:01 -04:00
4151fd1b6a Save story in plain text along the save
Not just saving in .json but also in plain text, should help story writers get their stories out more easily. Especially since they can technically add some markdown into their stories manually in the interface.
2021-09-01 17:41:18 +02:00
9b3e298089 Foundation for in browser downloading
This adds /download as a URL to immediately download the file, this will allow html changes that initiate a file download.
2021-09-01 15:58:56 +02:00
c276220a35 Allow deleting and renaming stories in the browser 2021-08-31 18:22:30 -04:00
63a4048053 Remove typing.Literal (a Python 3.8+ feature) 2021-08-26 15:38:58 -04:00
75c68c2b78 Fix world info depth being ignored 2021-08-26 12:50:17 -04:00
d7605a717b Merge branch 'united' into big-o
This resolves two merge conflicts that arose because this branch was
a few commits behind.
2021-08-26 01:37:40 -04:00
8fd8612cca Adventure mode colouring now controlled by a CSS class
So that we can just toggle the class instead of having aiserver.py send
back the entire story.
2021-08-26 01:06:57 -04:00
27c7baab92 Prevent some errors when the prompt is the only chunk 2021-08-25 23:58:12 -04:00
b0d64985bb Fix Retry and Back buttons popping the wrong chunk 2021-08-25 19:56:57 -04:00
bbd5bd0cd7 Merge pull request #8 from VE-FORBRYDERNE/misc
General usability fixes
2021-08-26 01:56:42 +02:00
796f5ffd05 Make vars.actions a dictionary instead of a list 2021-08-25 19:28:26 -04:00
6dcd7888c8 Change "recieved" to "received" 2021-08-25 14:55:26 -04:00
c3528e6221 Retry after Back no longer pops an extra story chunk 2021-08-25 14:54:51 -04:00
cf677c60fc Stability fixes for back/retry re genseqs/useprompt
* Back and Retry buttons no longer pop a story chunk while in the
  "Select sequence to keep" menu
* No longer freezes if you retry with no story chunks beyond the initial
  prompt chunk
* When "Always Add Prompt" is on, allow Retry even if the prompt is the
  only chunk in the story
* Added error messages for Back and Retry buttons
2021-08-25 14:42:37 -04:00
d848d03d60 Merge pull request #7 from VE-FORBRYDERNE/wi-constant
Constant world info keys
2021-08-25 20:14:19 +02:00
3da0c3d24a Remote improvements
Some colab's use KoboldAI as a subprocess, rather than making that to complicated for Colab developers its better to just dump the Cloudflare link to a log, in addition to showing the message on screen. That way if KoboldAI itself gets filtered you can easily cat the link or use the existing link grabbing methods.
2021-08-25 13:57:38 +02:00
b1c6aee8d3 Integrate inline chunk editor and Adventure mode with Javalar's branch 2021-08-24 19:02:52 -04:00
735fc9431b Still HTML-escape chunks if Adventure is off
(cherry picked from commit 3409d8c12e3fbb1e3232f2df82740b012e8f3604)
2021-08-24 18:46:34 -04:00
09030573e5 Broadcast updatechunk and removechunk 2021-08-24 18:40:12 -04:00
6d5845ff8d Merge https://github.com/KoboldAI/KoboldAI-Client/pull/45 into big-o 2021-08-24 17:27:50 -04:00
2a7c6244cb Constant world info keys 2021-08-24 13:45:20 -04:00
90e558cf3f Won't freeze anymore if you delete the prompt 2021-08-24 11:24:29 -04:00
f0962155b8 Merge pull request #5 from VE-FORBRYDERNE/editable-chunks
Scroll down on submit
2021-08-24 01:22:57 +02:00
13ce16b859 Scroll down on submit 2021-08-23 19:19:36 -04:00
c108e080bf Various Fixes
Various Fixes, mostly to make the UI play a little nicer in the new edit mode. Also reverted and optimized some of the setting stuff.
2021-08-24 01:18:09 +02:00
3bf467e63c Added dedicated inline editing commands to aiserver.py
It's a lot faster now.
2021-08-23 18:52:45 -04:00
a151e1a33a Small fix for Authors Notes in multiplayer
Multiplayer support was causing all players to automatically submit authors notes. This is now fixed only the person submitting the authors notes counts.
2021-08-22 15:54:35 +02:00
09ec15c91b Merge pull request #3 from VE-FORBRYDERNE/breakmodel
Low VRAM patch
2021-08-21 21:03:46 +02:00
3c9ce2c541 Use torch.no_grad() and more garbage collection 2021-08-21 12:15:31 -04:00
fae15b8a17 Fix typo in previous commit 2021-08-21 10:54:57 -04:00
a8bbfab87a Actually use args.breakmodel_layers 2021-08-20 20:50:03 -04:00
e00d9c4362 breakmodel fix for models without lm_head 2021-08-20 19:32:18 -04:00
8bfcf86a8b Fix for non-rotary models without "rotary" in config.json 2021-08-20 13:00:53 -04:00
68836728d4 Update World Info on Submit
Still VERY far from ideal for multiplayer, only one person can realistically edit it at a time. Whoever submits counts. Will need more major interface changes so things can be submitted one by one. But hey, it works and its good enough for a group of friends to play the game :D
2021-08-20 17:51:49 +02:00
56c9dc2c04 Fix "Expected all tensors to" on non-rotary models
Expected all tensors to be on the same device, but found at least two devices, cpu and cuda:0! (when checking arugment for argument index in method wrapper_index_select)
2021-08-20 11:34:31 -04:00
5f82e5ba0d Also clear CUDA cache twice if using breakmodel 2021-08-20 11:17:34 -04:00
f986c65a4e Manually strip and decode tokens if not using a pipeline 2021-08-20 11:15:32 -04:00
7717168676 Only allow --breakmodel if it's supported 2021-08-20 10:52:57 -04:00
b1c13f832a Implement arrmansa's low VRAM patch 2021-08-20 10:25:03 -04:00
f12e3576a8 Multiple Browser Session Syncing
Multiplayer anyone? :D
2021-08-20 15:32:02 +02:00