09030573e5
Broadcast updatechunk and removechunk
2021-08-24 18:40:12 -04:00
6d5845ff8d
Merge https://github.com/KoboldAI/KoboldAI-Client/pull/45 into big-o
2021-08-24 17:27:50 -04:00
2a7c6244cb
Constant world info keys
2021-08-24 13:45:20 -04:00
90e558cf3f
Won't freeze anymore if you delete the prompt
2021-08-24 11:24:29 -04:00
f0962155b8
Merge pull request #5 from VE-FORBRYDERNE/editable-chunks
...
Scroll down on submit
2021-08-24 01:22:57 +02:00
13ce16b859
Scroll down on submit
2021-08-23 19:19:36 -04:00
c108e080bf
Various Fixes
...
Various Fixes, mostly to make the UI play a little nicer in the new edit mode. Also reverted and optimized some of the setting stuff.
2021-08-24 01:18:09 +02:00
3bf467e63c
Added dedicated inline editing commands to aiserver.py
...
It's a lot faster now.
2021-08-23 18:52:45 -04:00
a151e1a33a
Small fix for Authors Notes in multiplayer
...
Multiplayer support was causing all players to automatically submit authors notes. This is now fixed only the person submitting the authors notes counts.
2021-08-22 15:54:35 +02:00
09ec15c91b
Merge pull request #3 from VE-FORBRYDERNE/breakmodel
...
Low VRAM patch
2021-08-21 21:03:46 +02:00
3c9ce2c541
Use torch.no_grad() and more garbage collection
2021-08-21 12:15:31 -04:00
fae15b8a17
Fix typo in previous commit
2021-08-21 10:54:57 -04:00
a8bbfab87a
Actually use args.breakmodel_layers
2021-08-20 20:50:03 -04:00
e00d9c4362
breakmodel fix for models without lm_head
2021-08-20 19:32:18 -04:00
8bfcf86a8b
Fix for non-rotary models without "rotary" in config.json
2021-08-20 13:00:53 -04:00
68836728d4
Update World Info on Submit
...
Still VERY far from ideal for multiplayer, only one person can realistically edit it at a time. Whoever submits counts. Will need more major interface changes so things can be submitted one by one. But hey, it works and its good enough for a group of friends to play the game :D
2021-08-20 17:51:49 +02:00
56c9dc2c04
Fix "Expected all tensors to" on non-rotary models
...
Expected all tensors to be on the same device, but found at least two devices, cpu and cuda:0! (when checking arugment for argument index in method wrapper_index_select)
2021-08-20 11:34:31 -04:00
5f82e5ba0d
Also clear CUDA cache twice if using breakmodel
2021-08-20 11:17:34 -04:00
f986c65a4e
Manually strip and decode tokens if not using a pipeline
2021-08-20 11:15:32 -04:00
7717168676
Only allow --breakmodel if it's supported
2021-08-20 10:52:57 -04:00
b1c13f832a
Implement arrmansa's low VRAM patch
2021-08-20 10:25:03 -04:00
f12e3576a8
Multiple Browser Session Syncing
...
Multiplayer anyone? :D
2021-08-20 15:32:02 +02:00
dd77ac2f3a
GPU detection bugfix
2021-08-20 12:30:52 +02:00
99c5ff240c
Command Line Part 2
...
Automated Colab and GPU selection
2021-08-20 11:39:04 +02:00
ba20c3407c
Command line support
...
Added command line options for model selection, this makes it usable inside Google Colab or other unattended servers people might want to use/provide.
2021-08-20 10:49:35 +02:00
136dd71171
Added --remote Mode
...
First step towards native Colab support, built in Cloudflare tunnels easily allows players to play KoboldAI on another device. This mode also removes buttons that would get you stuck if you have no local PC access.
2021-08-20 00:37:59 +02:00
72bfc417da
top_k and tfs support by Frogging101
...
Adds top_k and tfs support, also fixes a SocketIO error.
2021-08-19 14:47:57 +02:00
33215a87b3
Added VE_FORBRYDERNE's Selective World Info
...
This update allows you to selectively choose when World Info is loaded for more control and RAM savings.
2021-08-19 13:48:33 +02:00
00414d26e2
Integrated VE_FORBRYDERNE's Adventure Mode + Cleanup
...
Adventure Mode allows you to play this like AID, perfect for Choose your own Adventure models
2021-08-19 13:18:01 +02:00
efbe40f1f6
Random Story Generator
...
Add the Random Story Generator and more userfriendly defaults
2021-08-19 12:54:44 +02:00
81aba7cba8
Fix typo
2021-06-15 01:02:11 -04:00
9559347f82
Update or remove targeted chunks in Game Screen ( #2 )
2021-06-15 00:59:08 -04:00
e9b62cd3ae
escape the prompt too
2021-06-02 21:23:36 +02:00
1e95f7e1a5
Hotfix: HTML escaped story output. Shodan can no longer run JS popups in your browser.
2021-06-02 09:01:13 -04:00
4cb3df5e7e
Performance increase for `refresh_story` on large stories
2021-05-29 21:36:24 -04:00
65ad0e01e3
Bugfix for InferKit submit failing when starting new story.
2021-05-29 20:43:30 -04:00
bed1eba6eb
Added option to generate multiple responses per action.
...
Added ability to import World Info files from AI Dungeon.
Added slider for setting World Info scan depth.
Added toggle to control whether prompt is submitted each action.
Added 'Read Only' mode with no AI to startup.
Fixed GPU/CPU choice prompt appearing when GPU isn't an option.
Added error handling to generator calls for CUDA OOM message
Added generator parameter to only return new text
2021-05-29 05:46:03 -04:00
f9bbb174a6
Added OpenAI API support
...
Added in-browser Save/Load/New Story controls
(Force a full refresh in your browser!)
Fixed adding InferKit API key if client.settings already exists
Added cmd calls to bat files so they'll stay open on error
Wait animation now hidden on start state/restart
2021-05-22 05:28:40 -04:00
4996e0ff46
Bugfixes:
...
Improvements to pruning context from text returned from the AI
Colab errors should no longer throw JSON decode errors in client
Improved logic for World Info scanning
Fix for index error in addsentencespacing
2021-05-18 17:59:59 -04:00
3d070f057e
Bugfixes:
...
Expanded bad_word flagging for square brackets to combat Author's Note leakage
World Info should now work properly if you have an Author's Note defined
Set generator to use cache to improve performance of custom Neo models
Added error handling for Colab disconnections
Now using tokenized & detokenized version of last action to parse out new content
Updated readme
2021-05-17 20:28:18 -04:00
0e855ef1d8
Catch some edge cases when importing
2021-05-17 16:00:32 +02:00
95cb94e979
Compatability update for latest AIDCAT export format
2021-05-16 17:45:21 -04:00
ce2e4e1f9e
Switched aidg.club import from HTML scrape to API call
...
Added square bracket to bad_words_ids to help suppress AN tag from leaking into generator output
Added version number to CSS/JS ref to address browser loading outdated versions from cache
2021-05-16 14:53:19 -04:00
47f1f7a85b
Corrected requests import location for aidg.club support
2021-05-16 05:37:38 -04:00
b05a73a04f
Added ability to import aidg.club scenarios
...
Changed menu bar to bootstrap navbar to allow for dropdown menus
2021-05-16 05:29:39 -04:00
2cef3bceaf
Bugfix for save function not appending .json extension by default
...
Bugfix for New Story function not clearing World Info from previous story
Torch will not be initialized unless you select a local model, as there's no reason to invoke it for InferKit/Colab
Changed JSON file writes to use indentation for readability
2021-05-15 19:29:41 -04:00
429c9b13f5
Bug fixes for AIDCAT import issues.
...
Modified CSS to prevent Import dialog from expanding off the page.
Updated readme with Colab link.
2021-05-14 16:27:47 -04:00
5d53f1a676
It helps if you commit all the files in the bugfix
2021-05-14 02:39:36 -04:00
c9b6f89d1d
Hotfix for Google Colab generator call failing if when called from a fresh prompt.
2021-05-13 23:30:54 -04:00
3c0638bc73
Added support for running model remotely on Google Colab
2021-05-13 18:58:52 -04:00
0b113a75b4
Hotfix for tokenizer modifying spaced ellipses and breaking new text recognition.
2021-05-13 09:35:11 -04:00
c0736a8ec7
Added World Info
...
Added additional punctuation triggers for Add Sentence Spacing format
Added better screen reset logic when refresing screen or restarting server
2021-05-13 01:26:42 -04:00
fff77c5a88
Hotfix for top_p parameter in generator call
2021-05-11 14:16:34 -04:00
1cc069a779
Added ability to import AIDungeon games from AIDCAT
2021-05-11 00:27:34 -04:00
b55266a7c8
Added Formatting options
...
Added Bootstrap toggle library for UI
Added injection points for input/output modification
2021-05-10 19:17:10 -04:00
0e0947d93a
Bugfix: Add apikey check to loadsettings
2021-05-10 09:33:41 -04:00
739a8a5268
Bugfix: Check for keys in client.settings before attempting to access
2021-05-10 09:26:31 -04:00
ba1ba0fc8a
Reduced default max_length parameter to 512.
...
Added warning about VRAM usage to Max Tokens tooltip.
2021-05-07 19:04:51 -04:00
d632976fbf
Settings menu modularized.
...
Help text added to settings items.
Settings now saved to client file when changed.
Separated transformers settings and InferKit settings.
Reorganized model select list.
2021-05-07 14:32:10 -04:00
a27d5beb36
Replaced easygui with tkinter to address file prompts appearing beneath game window
...
Removed easygui from requirements.txt
Save directory is no longer stored in save file for privacy
2021-05-05 11:18:24 -04:00
229b10cb91
Added support for Author's Note
...
Increased input textarea height
Removed generator options from save/load system
Set output length slider to use steps of 2
2021-05-05 03:04:06 -04:00
0ce77f4875
Fixed InferKit API requests sending a default top_p value instead of the user-selected value
2021-05-04 11:48:24 -04:00
6e54f654d6
Added settings menu to adjust generator parameters from game UI
...
Fixed text scrolling when content exceeded game screen height
2021-05-04 09:56:48 -04:00
1c9c219251
Added support for selecting custom trained models
2021-05-04 01:47:23 -04:00
734b0b54d4
Added VRAM requirements info to model list
...
Added ability to opt for CPU gen if you have GPU support
Added better error checking to model selection
2021-05-03 15:19:03 -04:00
1214062292
Fixed Max Length limits not being enforced for transformers & InferKit
2021-05-03 13:57:27 -04:00
ace2b2db12
Fixing GPU support broke CPU support. Now testing for capabilities before creating pipeline
2021-05-03 00:24:16 -04:00
97ad42efe6
Added device selection to transformers pipeline request to utilize GPU for inference
2021-05-02 23:34:33 -04:00
7476163494
Initial Upload
2021-05-02 18:46:45 -04:00
Gnome Ann
henk717
Yves Dubois
Javalar
Ralf
KoboldAI Dev
ioncorimenia
KoboldAI