8ad3863854
Merge pull request #26 from VE-FORBRYDERNE/sp-patch
...
More softprompting bug fixes
2021-11-11 17:05:32 +01:00
1fadcbe1e3
Send allowsp command on connect instead of on startup
2021-11-11 00:18:46 -05:00
11b0291bc4
Use model.transformer.embed_dim if model.transformer.hidden_size doesn't exist
2021-11-10 17:47:14 -05:00
752e19a2bb
Fix vars.modeldim not always being set
2021-11-10 17:38:30 -05:00
e6599db78f
Merge pull request #25 from VE-FORBRYDERNE/united
...
Merge branch 'main' into united
2021-11-10 03:37:43 +01:00
2679df9664
Merge branch 'main' into united
2021-11-09 21:33:14 -05:00
c2371cf801
Merge pull request #23 from VE-FORBRYDERNE/scan-test
...
Dynamic world info scan
2021-11-10 03:31:42 +01:00
d5a26e8c20
Fixed root permissions
...
The Docker has been changed to no longer run these commands as root, added root permissions for the relevant commands to fix the docker.
2021-11-10 03:17:12 +01:00
4af0d9dabd
Merge pull request #78 from VE-FORBRYDERNE/patch
...
Allow remote mode to load from client-side story files
2021-11-06 16:58:05 +01:00
02a56945de
Version bump
2021-11-06 11:50:56 -04:00
bc0f9c8032
Allow remote mode to load from client-side story files
...
(cherry picked from commit a1345263df
2021-11-06 11:48:20 -04:00
7ea6f58b1a
Resolve merge conflict
2021-11-05 11:03:50 -04:00
a1345263df
Merge pull request #22 from VE-FORBRYDERNE/filereader
...
Allow remote mode to load from client-side story files
2021-11-05 02:30:20 +01:00
7a0b0b0d2d
Remove debug logging from application.js
2021-11-04 19:36:45 -04:00
7c099fe93c
Allow remote mode to load from client-side story files
2021-11-04 19:33:17 -04:00
2829c45ed6
Merge pull request #21 from VE-FORBRYDERNE/united
...
Softprompting bug fixes
2021-11-04 15:38:21 +01:00
81bd058caf
Make sure calcsubmitbudget uses the correct reference to vars.actions
2021-11-03 18:57:02 -04:00
a2d7735a51
Dynamic WI scanner should ignore triggers that are already in context
2021-11-03 18:55:53 -04:00
ecfbbdb4a9
Merge branch 'united' into scan-test
2021-11-03 18:23:22 -04:00
0fa47b1249
Fix budget calculation for stories with at least one non-prompt chunk
2021-11-03 18:22:31 -04:00
c11dab894e
Put placeholder variables into calcsubmitbudget
2021-11-03 18:02:19 -04:00
9b18068999
Shallow copy story chunks when generating
2021-11-03 17:53:38 -04:00
b8c3d8c12e
Fix generator output having the wrong length
2021-11-03 16:10:12 -04:00
5b3ce4510f
Make sure that soft_tokens is on the correct device
2021-11-03 16:07:50 -04:00
90fd5a538a
Merge branch 'united' into scan-test
2021-11-03 12:42:18 -04:00
fe2987d894
Fix missing break statement in device_config
2021-11-03 12:42:04 -04:00
bd76ab333c
Set numseqs to 1 if using dynamic world info scan
2021-11-03 12:28:17 -04:00
0a91ea27b3
Make the dynamic world info scan toggleable
2021-11-03 12:18:48 -04:00
de3664e73c
Add an assertion for the value of already_generated
2021-11-03 12:01:45 -04:00
ec8ec55256
Dynamic world info scan
2021-11-03 11:54:48 -04:00
aa998ba5e9
Merge pull request #20 from VE-FORBRYDERNE/sp
...
Soft prompt support for PyTorch models
2021-10-30 00:35:44 +02:00
206c01008e
Fix budget calculation when using soft prompt
2021-10-29 11:44:51 -04:00
c9c370aa17
Merge branch 'KoboldAI:main' into united
2021-10-28 23:29:29 +02:00
c59673efde
Merge pull request #77 from VE-FORBRYDERNE/patch
...
Create settings directory if it doesn't exist when using InferKit/OAI
2021-10-28 23:29:17 +02:00
bf4e7742ac
Patch GPTJForCausalLM, if it exists, to support soft prompting
2021-10-28 17:18:28 -04:00
40b4631f6c
Clamp input_ids in place
...
Apparently transformers maintains an internal reference to input_ids
(to use for repetition penalty) so we have to clamp the internal
version, too, because otherwise transformers will throw an out-of-bounds
error upon attempting to access token IDs that are not in the
vocabulary.
2021-10-28 16:52:39 -04:00
24d5d63c9f
Use the correct generation min and max when using soft prompt
2021-10-28 16:39:59 -04:00
511817132a
Don't change the shape of transformer.wte
2021-10-28 15:39:59 -04:00
a1ae11630a
Make sure to cast vars.sp to the correct dtype
2021-10-28 13:22:07 -04:00
1556bd32a5
Use torch.where to inject the soft prompt instead of torch.cat
2021-10-28 13:20:14 -04:00
248e0bd24b
Fix soft prompt loading code
2021-10-28 00:29:42 -04:00
4e3cc93020
Merge branch 'united' into sp
2021-10-23 11:45:03 -04:00
7b73d7cfdd
Single Line Mode
...
Adds Single Line mode, optimized for things like chatbot testing and other cases where you want to have control over what happens after a paragraph.
This can also be used as a foundation for a chatbot optimized interface mode.
2021-10-23 17:30:48 +02:00
9e82ce34a6
HTML-escape strings in the soft prompt selection menu
2021-10-22 14:25:25 -04:00
1f449a9dda
Soft prompt support (6B Colabs not supported yet)
2021-10-22 14:18:10 -04:00
3501f03153
Create settings directory if it doesn't exist when using InferKit/OAI
2021-10-21 23:33:32 -04:00
0f38dbc0ed
Using VE's fork for now
...
Switching the official huggingface to VE's fork for the time being until some of these changes land upstream.
2021-10-19 11:33:49 +02:00
fa0f8af1d6
Merge branch 'KoboldAI:main' into united
2021-10-15 08:23:06 +02:00
9513240dfb
Version bump
...
Since VE fixed important things in the editor i want users to be able to see this easier
2021-10-15 08:22:32 +02:00
fd7f9b7edf
Merge pull request #76 from VE-FORBRYDERNE/editor
...
Fix enter key behaviour in the editor when not using Firefox
2021-10-15 08:21:35 +02:00
henk717
Gnome Ann