048bd0ff3b
Add support for setting the RNG seed and full determinism
2022-06-28 13:21:05 -04:00
496f6dcf3f
Add docker usage info
2022-06-28 16:28:00 +02:00
33b8cec452
Standalone Docker
...
KoboldAI United now has a working official docker available at henk717/koboldai:united . In the spirit of our project, this commit open sources the files used to build the docker. docker-helper.sh is in the main folder, so that it is not overwritten during updates. Instead this file is copied by the Dockerfile and should be updated trough container updates.
2022-06-28 16:23:21 +02:00
cba38bf3e4
Automatically update requirements
2022-06-28 15:17:32 +02:00
5f1c98af8e
Merge pull request #164 from ebolam/united
...
Fix for saved breakmodel settings on custom models
2022-06-27 16:18:09 +02:00
edd6dd7cd7
Fix for saved breakmodel settings on custom models
...
Fix for unit tests with new disk breakmodel
2022-06-27 10:12:54 -04:00
2207ac4b0a
Merge branch 'KoboldAI:main' into united
2022-06-26 20:36:13 +02:00
ad9ec6eaba
Merge pull request #132 from VE-FORBRYDERNE/whitespace-cleanup
...
Story whitespace cleanup backport
2022-06-26 20:35:50 +02:00
46678931b2
Better sentence spacing
2022-06-26 20:27:21 +02:00
6576f5c01d
Make sure editor changes are applied before submitting
...
(cherry picked from commit ae41ad298c
2022-06-26 14:06:57 -04:00
ebba79fed6
Remove trailing whitespace from submissions
...
(cherry picked from commit b99d1449c9
2022-06-26 14:06:34 -04:00
6ba7429eea
Don't add sentence spacing if submission is empty
...
When you retry, it actually sends an empty submission, so if you have
add sentence spacing on, retrying could add an extra action with a
single space.
(cherry picked from commit 151407a001
2022-06-26 14:06:18 -04:00
9d09ae5fea
Clean up whitespace in the editor as well
...
(cherry picked from commit 6e138db1c0
2022-06-26 14:05:04 -04:00
2a4d37ce60
Clean up whitespace at the end of actions when loading story
...
Specifically, we merge blank actions into the next action and we move
whitespace at the end of non-blank actions to the beginning of the next
action.
(cherry picked from commit 4b16600e49
2022-06-26 14:04:36 -04:00
e30abd209f
Preserve whitespace in the editor
...
(cherry picked from commit 793d788706
2022-06-26 14:04:16 -04:00
8cea194809
Merge pull request #163 from VE-FORBRYDERNE/whitespace-cleanup
...
More story whitespace cleanup
2022-06-26 19:50:28 +02:00
ae41ad298c
Make sure editor changes are applied before submitting
2022-06-26 13:40:58 -04:00
b99d1449c9
Remove trailing whitespace from submissions
2022-06-26 13:15:55 -04:00
151407a001
Don't add sentence spacing if submission is empty
...
When you retry, it actually sends an empty submission, so if you have
add sentence spacing on, retrying could add an extra action with a
single space.
2022-06-26 13:02:22 -04:00
fa97d28cb3
Nerys V2 for United
2022-06-25 14:06:51 +02:00
9e7eb80db4
Nerys V2 part 2
2022-06-25 14:03:19 +02:00
ecc6ee9474
Nerys V2
2022-06-25 13:47:49 +02:00
10e85db89d
Merge pull request #162 from VE-FORBRYDERNE/whitespace-cleanup
...
Story whitespace cleanup
2022-06-25 13:36:03 +02:00
a2d2ea0735
Typo Fix
2022-06-25 13:14:27 +02:00
2495b9380d
Nerys V2
2022-06-25 13:08:30 +02:00
6acfa8c33c
Merge branch 'whitespace' into whitespace-cleanup
2022-06-24 12:44:30 -04:00
6e138db1c0
Clean up whitespace in the editor as well
2022-06-24 12:44:00 -04:00
d3fce44095
Merge branch 'main' into united
2022-06-24 18:31:45 +02:00
8be0964427
AIDG Import Fix
2022-06-24 18:29:06 +02:00
4b16600e49
Clean up whitespace at the end of actions when loading story
...
Specifically, we merge blank actions into the next action and we move
whitespace at the end of non-blank actions to the beginning of the next
action.
2022-06-24 12:03:35 -04:00
fca7c15fd3
Merge branch 'KoboldAI:main' into united
2022-06-24 18:00:37 +02:00
27e16aecf2
Model Cleaner (suggested by Shrinkarom)
2022-06-24 14:03:58 +02:00
c3af92e9af
Koboldai.org | New NeoX | Cloudflare
2022-06-24 10:43:06 +02:00
6a89ad5b94
Merge branch 'main' into united
2022-06-23 21:07:56 +02:00
ec0bc1cc17
Merge pull request #130 from VE-FORBRYDERNE/neox-badwords
...
GPT-NeoX HF model badwords fix
2022-06-23 21:05:42 +02:00
3da885d408
GPT-NeoX HF model badwords fix
2022-06-23 15:02:43 -04:00
d94f29a68a
Merge pull request #127 from VE-FORBRYDERNE/tracer
...
Fix JAX UnexpectedTracerError
2022-06-23 19:29:51 +02:00
8098f4ec8f
Merge branch 'KoboldAI:main' into united
2022-06-23 17:20:48 +02:00
1d41966d88
Merge pull request #129 from VE-FORBRYDERNE/budget
...
Account for lnheader in budget calculation
2022-06-23 12:39:20 +02:00
0eb9f8a879
Account for lnheader in budget calculation
2022-06-22 19:16:24 -04:00
3de22f2b27
Merge pull request #160 from VE-FORBRYDERNE/gc
...
Delete all torch tensors before loading model
2022-06-22 18:38:21 +02:00
53034ee533
Delete all torch tensors before loading model
2022-06-22 12:07:36 -04:00
f127918114
Merge pull request #159 from VE-FORBRYDERNE/fairseq
...
Don't blacklist </s> token in "s" newline mode
2022-06-22 17:41:20 +02:00
922394c68f
Don't blacklist </s> token in "s" newline mode
2022-06-22 11:23:03 -04:00
d4e18360f0
HF NeoX Support
2022-06-22 01:46:40 +02:00
5f9a116052
Merge pull request #128 from VE-FORBRYDERNE/neox
...
TPU support for HF GPT-NeoX model
2022-06-22 01:39:53 +02:00
8c594c6869
Correct the padding token for GPT-NeoX
2022-06-21 19:37:43 -04:00
a7f667c34c
Use NeoX badwords when loading from HF GPT-NeoX model
2022-06-21 19:33:25 -04:00
5e3c7c07ae
Merge branch 'main' into neox
2022-06-21 19:30:51 -04:00
f1d0a327f8
Merge branch 'KoboldAI:main' into united
2022-06-21 23:34:32 +02:00
