Commit Graph

1583 Commits

Author SHA1 Message Date
c854a62549 Clarified GPU Layers
breakmodel_layers and layers is confusing, changed the new method to breakmodel_gpulayers. The old one should no longer be used by people, but since it works in reverse we leave it in so scripts don't break.
2021-10-06 18:55:01 +02:00
bd063f7590 Merge pull request #19 from VE-FORBRYDERNE/multi-gpu
Multiple GPU support
2021-10-06 18:50:58 +02:00
3649ba9fa4 Breakmodel's CUDA stream should be on primary device 2021-10-06 12:04:56 -04:00
82c7eaffb5 Merge branch 'KoboldAI:main' into united 2021-10-06 00:26:08 +02:00
8893916fef Don't always submit prompt by default
Feedback from users is that its better to not always submit the prompt, this is consistent with the randomly generated stories. You can always toggle it on if you need this for coherency. This change does not override existing user settings.
2021-10-06 00:25:05 +02:00
aa59f8b4b2 Fix CPU layers not displaying correctly when using --layers 2021-10-05 11:29:47 -04:00
91352ea9f1 Change the command line flags for breakmodel 2021-10-05 11:22:09 -04:00
a1e4405aa6 Automatically use breakmodel instead of GPU-only where supported
There's really no reason to use GPU-only mode if breakmodel is supported
because breakmodel can run in GPU-only mode too.
2021-10-05 10:36:51 -04:00
fb90a7ed17 Change the help text for breakmodel to be more helpful 2021-10-05 10:31:28 -04:00
f9e6a6da17 Slightly increased performance in breakmodel mode
Commit a283d34b27 made breakmodel mode
slower. Performance has been restored to how it was before that commit.
2021-10-05 10:25:06 -04:00
231621e7c2 Use AutoModelForCausalLM for custom models with a model_type 2021-10-05 09:45:12 -04:00
18fa742b02 Merge branch 'united' into multi-gpu 2021-10-05 09:43:20 -04:00
a283d34b27 Multiple GPU support 2021-10-05 09:38:57 -04:00
6152d390c0 Merge branch 'KoboldAI:main' into united 2021-10-03 04:32:20 +02:00
0937bb33e7 Clarify licensing for breakmodel.py 2021-10-02 12:19:37 -04:00
6d30d30b39 Merge pull request #73 from VE-FORBRYDERNE/webkit-patch
Move using_webkit_patch to earlier in the code
2021-10-02 17:48:58 +02:00
a42b580027 Merge branch 'united' into multi-gpu 2021-10-02 11:44:26 -04:00
e69e15bec7 Move using_webkit_patch to earlier in the code
I don't know it this or help or not but I hope it does.
2021-09-30 22:58:54 -04:00
4451edc7a2 Merge branch 'KoboldAI:main' into united 2021-10-01 01:48:23 +02:00
a6d1546247 Merge pull request #72 from VE-FORBRYDERNE/webkit-patch
Safari support
2021-10-01 01:16:59 +02:00
d7893a0b52 Check for WebKit after connecting to the server
For some reason the original way only works in Safari after pressing the
refresh button. It did not work if you typed the URL into the address
bar in Safari without refreshing afterwards.
2021-09-30 19:00:15 -04:00
00c1f49ca1 Fix slow typing speed on mobile devices 2021-09-30 17:52:35 -04:00
a923b3bfa7 Safari compatibility
Only tested on macOS so far, not iOS.
2021-09-30 14:13:54 -04:00
e9ff779dc2 Merge branch 'KoboldAI:main' into united 2021-09-30 18:33:02 +02:00
1299e61225 Merge pull request #71 from VE-FORBRYDERNE/editor
Fix for submitting memory/AN when memory is empty
2021-09-30 17:02:01 +02:00
e325197748 Fix for submitting memory/AN when memory is empty 2021-09-30 10:57:29 -04:00
dab58d8393 Merge branch 'KoboldAI:main' into united 2021-09-29 17:05:06 +02:00
245ff6d2f3 Merge pull request #70 from VE-FORBRYDERNE/editor
More bug fixes
2021-09-29 16:37:25 +02:00
a179bb2820 Bump version number to 1.16.2 2021-09-28 21:50:33 -04:00
e6cd28243e Scroll to the bottom of the gamescreen after retrying 2021-09-28 21:34:36 -04:00
bb323152d7 Disable vars.recentedit again 2021-09-28 21:24:08 -04:00
2b89bcb16e Fix random story generator 2021-09-28 21:04:26 -04:00
af93c96c0f Submit Action mode action in Story mode if action is empty 2021-09-28 19:50:00 -04:00
9ab1d182ac Guard against empty prompts 2021-09-28 19:48:43 -04:00
4961273a26 Don't scroll to the bottom of screen when exiting world info
One of my earlier commits apparently removed the need for this.
2021-09-28 19:03:43 -04:00
8447ec44ab Fix world info screen and bump application.js version 2021-09-28 19:00:23 -04:00
da55ed3b49 Merge branch 'KoboldAI:main' into united 2021-09-28 10:41:01 +02:00
c44946f216 Merge pull request #69 from VE-FORBRYDERNE/editor
Editor enhancements part 2
2021-09-28 10:40:15 +02:00
03c1a3ebf9 Put vars.recentedit = True in deleterequest() for consistency 2021-09-28 01:10:20 -04:00
97e1760af5 Prevent retry from popping chunks after edit/delete 2021-09-28 01:07:11 -04:00
231290608d Do a better job of preventing editing of text when required 2021-09-28 00:48:37 -04:00
f632ad9880 Use a more robust scheme for restorePrompt
The original way didn't work properly in Firefox on Android when you
select all text and replace it with something else.
2021-09-27 23:38:41 -04:00
e8cefcc2c6 (Firefox) Fix certain chunks not updating when editing
I don't know why Firefox is so weird but we need to do this or else
some chunks don't update properly when you edit multiple chunks at the
same time.

One example of when this happened is when you have a story with at least
one chunk other than the prompt. Then, if you select the entire story
except for the first few characters of the prompt and then delete the
selected characters, and then defocus the story to save your changes,
the last chunk in the story will not register as having been deleted,
which you can verify if you refresh the page.

Another example. If your story has a chunk with no trailing newlines
followed by a chunk with exactly two leading newlines, if you delete
the first newline from the latter chunk and then defocus to save your
edits, the newline will be there again when you refresh the page.
2021-09-27 23:10:34 -04:00
3297c27fcd Fix using escape to save edits 2021-09-27 22:56:12 -04:00
b39f12b60b Remove unneeded console.log() 2021-09-27 22:47:27 -04:00
cc207109bc Merge branch 'main' into editor 2021-09-27 22:46:05 -04:00
431acce0bb Remove unneeded scrollbars
There was an unneeded scrollbar growing as you were expanding towards the top of the screen, now this scrollbar is hidden until you actually need it making the UI look a bit more polished.
2021-09-28 04:44:17 +02:00
13b81c7523 Prevent the user from deleting the prompt 2021-09-27 22:21:14 -04:00
01b30b315f Merge branch 'KoboldAI:main' into united 2021-09-28 02:31:20 +02:00
954a8a88f9 Merge pull request #68 from VE-FORBRYDERNE/editor
Editor enhancements
2021-09-28 02:30:35 +02:00