Commit Graph

1555 Commits

Author SHA1 Message Date
henk717 856e8d5c86
Merge pull request #133 from VE-FORBRYDERNE/whitespace
Fix the cleanupChunkWhitespace function
2022-06-28 18:22:24 +02:00
vfbd d55b4d9bbc Fix the cleanupChunkWhitespace function 2022-06-28 12:18:57 -04:00
Henk 496f6dcf3f Add docker usage info 2022-06-28 16:28:00 +02:00
Henk 33b8cec452 Standalone Docker
KoboldAI United now has a working official docker available at henk717/koboldai:united . In the spirit of our project, this commit open sources the files used to build the docker. docker-helper.sh is in the main folder, so that it is not overwritten during updates. Instead this file is copied by the Dockerfile and should be updated trough container updates.
2022-06-28 16:23:21 +02:00
Henk cba38bf3e4 Automatically update requirements 2022-06-28 15:17:32 +02:00
henk717 5f1c98af8e
Merge pull request #164 from ebolam/united
Fix for saved breakmodel settings on custom models
2022-06-27 16:18:09 +02:00
ebolam edd6dd7cd7 Fix for saved breakmodel settings on custom models
Fix for unit tests with new disk breakmodel
2022-06-27 10:12:54 -04:00
henk717 2207ac4b0a
Merge branch 'KoboldAI:main' into united 2022-06-26 20:36:13 +02:00
henk717 ad9ec6eaba
Merge pull request #132 from VE-FORBRYDERNE/whitespace-cleanup
Story whitespace cleanup backport
2022-06-26 20:35:50 +02:00
Henk 46678931b2 Better sentence spacing 2022-06-26 20:27:21 +02:00
vfbd 6576f5c01d Make sure editor changes are applied before submitting
(cherry picked from commit ae41ad298c)
2022-06-26 14:06:57 -04:00
vfbd ebba79fed6 Remove trailing whitespace from submissions
(cherry picked from commit b99d1449c9)
2022-06-26 14:06:34 -04:00
vfbd 6ba7429eea Don't add sentence spacing if submission is empty
When you retry, it actually sends an empty submission, so if you have
add sentence spacing on, retrying could add an extra action with a
single space.

(cherry picked from commit 151407a001)
2022-06-26 14:06:18 -04:00
vfbd 9d09ae5fea Clean up whitespace in the editor as well
(cherry picked from commit 6e138db1c0)
2022-06-26 14:05:04 -04:00
vfbd 2a4d37ce60 Clean up whitespace at the end of actions when loading story
Specifically, we merge blank actions into the next action and we move
whitespace at the end of non-blank actions to the beginning of the next
action.

(cherry picked from commit 4b16600e49)
2022-06-26 14:04:36 -04:00
vfbd e30abd209f Preserve whitespace in the editor
(cherry picked from commit 793d788706)
2022-06-26 14:04:16 -04:00
henk717 8cea194809
Merge pull request #163 from VE-FORBRYDERNE/whitespace-cleanup
More story whitespace cleanup
2022-06-26 19:50:28 +02:00
vfbd ae41ad298c Make sure editor changes are applied before submitting 2022-06-26 13:40:58 -04:00
vfbd b99d1449c9 Remove trailing whitespace from submissions 2022-06-26 13:15:55 -04:00
vfbd 151407a001 Don't add sentence spacing if submission is empty
When you retry, it actually sends an empty submission, so if you have
add sentence spacing on, retrying could add an extra action with a
single space.
2022-06-26 13:02:22 -04:00
Henk fa97d28cb3 Nerys V2 for United 2022-06-25 14:06:51 +02:00
Henk 9e7eb80db4 Nerys V2 part 2 2022-06-25 14:03:19 +02:00
Henk ecc6ee9474 Nerys V2 2022-06-25 13:47:49 +02:00
henk717 10e85db89d
Merge pull request #162 from VE-FORBRYDERNE/whitespace-cleanup
Story whitespace cleanup
2022-06-25 13:36:03 +02:00
henk717 a2d2ea0735 Typo Fix 2022-06-25 13:14:27 +02:00
henk717 2495b9380d Nerys V2 2022-06-25 13:08:30 +02:00
vfbd 6acfa8c33c Merge branch 'whitespace' into whitespace-cleanup 2022-06-24 12:44:30 -04:00
vfbd 6e138db1c0 Clean up whitespace in the editor as well 2022-06-24 12:44:00 -04:00
Henk d3fce44095 Merge branch 'main' into united 2022-06-24 18:31:45 +02:00
Henk 8be0964427 AIDG Import Fix 2022-06-24 18:29:06 +02:00
vfbd 4b16600e49 Clean up whitespace at the end of actions when loading story
Specifically, we merge blank actions into the next action and we move
whitespace at the end of non-blank actions to the beginning of the next
action.
2022-06-24 12:03:35 -04:00
henk717 fca7c15fd3
Merge branch 'KoboldAI:main' into united 2022-06-24 18:00:37 +02:00
henk717 27e16aecf2 Model Cleaner (suggested by Shrinkarom) 2022-06-24 14:03:58 +02:00
henk717 c3af92e9af Koboldai.org | New NeoX | Cloudflare 2022-06-24 10:43:06 +02:00
Henk 6a89ad5b94 Merge branch 'main' into united 2022-06-23 21:07:56 +02:00
henk717 ec0bc1cc17
Merge pull request #130 from VE-FORBRYDERNE/neox-badwords
GPT-NeoX HF model badwords fix
2022-06-23 21:05:42 +02:00
vfbd 3da885d408 GPT-NeoX HF model badwords fix 2022-06-23 15:02:43 -04:00
henk717 d94f29a68a
Merge pull request #127 from VE-FORBRYDERNE/tracer
Fix JAX UnexpectedTracerError
2022-06-23 19:29:51 +02:00
henk717 8098f4ec8f
Merge branch 'KoboldAI:main' into united 2022-06-23 17:20:48 +02:00
henk717 1d41966d88
Merge pull request #129 from VE-FORBRYDERNE/budget
Account for lnheader in budget calculation
2022-06-23 12:39:20 +02:00
vfbd 0eb9f8a879 Account for lnheader in budget calculation 2022-06-22 19:16:24 -04:00
henk717 3de22f2b27
Merge pull request #160 from VE-FORBRYDERNE/gc
Delete all torch tensors before loading model
2022-06-22 18:38:21 +02:00
vfbd 53034ee533 Delete all torch tensors before loading model 2022-06-22 12:07:36 -04:00
henk717 f127918114
Merge pull request #159 from VE-FORBRYDERNE/fairseq
Don't blacklist </s> token in "s" newline mode
2022-06-22 17:41:20 +02:00
vfbd 922394c68f Don't blacklist </s> token in "s" newline mode 2022-06-22 11:23:03 -04:00
Henk d4e18360f0 HF NeoX Support 2022-06-22 01:46:40 +02:00
henk717 5f9a116052
Merge pull request #128 from VE-FORBRYDERNE/neox
TPU support for HF GPT-NeoX model
2022-06-22 01:39:53 +02:00
Gnome Ann 8c594c6869 Correct the padding token for GPT-NeoX 2022-06-21 19:37:43 -04:00
Gnome Ann a7f667c34c Use NeoX badwords when loading from HF GPT-NeoX model 2022-06-21 19:33:25 -04:00
Gnome Ann 5e3c7c07ae Merge branch 'main' into neox 2022-06-21 19:30:51 -04:00