fa97d28cb3
Nerys V2 for United
2022-06-25 14:06:51 +02:00
9e7eb80db4
Nerys V2 part 2
2022-06-25 14:03:19 +02:00
ecc6ee9474
Nerys V2
2022-06-25 13:47:49 +02:00
10e85db89d
Merge pull request #162 from VE-FORBRYDERNE/whitespace-cleanup
...
Story whitespace cleanup
2022-06-25 13:36:03 +02:00
a2d2ea0735
Typo Fix
2022-06-25 13:14:27 +02:00
2495b9380d
Nerys V2
2022-06-25 13:08:30 +02:00
6acfa8c33c
Merge branch 'whitespace' into whitespace-cleanup
2022-06-24 12:44:30 -04:00
6e138db1c0
Clean up whitespace in the editor as well
2022-06-24 12:44:00 -04:00
d3fce44095
Merge branch 'main' into united
2022-06-24 18:31:45 +02:00
8be0964427
AIDG Import Fix
2022-06-24 18:29:06 +02:00
4b16600e49
Clean up whitespace at the end of actions when loading story
...
Specifically, we merge blank actions into the next action and we move
whitespace at the end of non-blank actions to the beginning of the next
action.
2022-06-24 12:03:35 -04:00
fca7c15fd3
Merge branch 'KoboldAI:main' into united
2022-06-24 18:00:37 +02:00
27e16aecf2
Model Cleaner (suggested by Shrinkarom)
2022-06-24 14:03:58 +02:00
c3af92e9af
Koboldai.org | New NeoX | Cloudflare
2022-06-24 10:43:06 +02:00
6a89ad5b94
Merge branch 'main' into united
2022-06-23 21:07:56 +02:00
ec0bc1cc17
Merge pull request #130 from VE-FORBRYDERNE/neox-badwords
...
GPT-NeoX HF model badwords fix
2022-06-23 21:05:42 +02:00
3da885d408
GPT-NeoX HF model badwords fix
2022-06-23 15:02:43 -04:00
d94f29a68a
Merge pull request #127 from VE-FORBRYDERNE/tracer
...
Fix JAX UnexpectedTracerError
2022-06-23 19:29:51 +02:00
8098f4ec8f
Merge branch 'KoboldAI:main' into united
2022-06-23 17:20:48 +02:00
1d41966d88
Merge pull request #129 from VE-FORBRYDERNE/budget
...
Account for lnheader in budget calculation
2022-06-23 12:39:20 +02:00
0eb9f8a879
Account for lnheader in budget calculation
2022-06-22 19:16:24 -04:00
3de22f2b27
Merge pull request #160 from VE-FORBRYDERNE/gc
...
Delete all torch tensors before loading model
2022-06-22 18:38:21 +02:00
53034ee533
Delete all torch tensors before loading model
2022-06-22 12:07:36 -04:00
f127918114
Merge pull request #159 from VE-FORBRYDERNE/fairseq
...
Don't blacklist </s> token in "s" newline mode
2022-06-22 17:41:20 +02:00
922394c68f
Don't blacklist </s> token in "s" newline mode
2022-06-22 11:23:03 -04:00
d4e18360f0
HF NeoX Support
2022-06-22 01:46:40 +02:00
5f9a116052
Merge pull request #128 from VE-FORBRYDERNE/neox
...
TPU support for HF GPT-NeoX model
2022-06-22 01:39:53 +02:00
8c594c6869
Correct the padding token for GPT-NeoX
2022-06-21 19:37:43 -04:00
a7f667c34c
Use NeoX badwords when loading from HF GPT-NeoX model
2022-06-21 19:33:25 -04:00
5e3c7c07ae
Merge branch 'main' into neox
2022-06-21 19:30:51 -04:00
f1d0a327f8
Merge branch 'KoboldAI:main' into united
2022-06-21 23:34:32 +02:00
75bc472a9f
Transformers bump to 4.20.1
...
Transformers issued an important change for the OPT models breaking their compatibility with all older versions. In order for people to be able to use all models on the menu they need 4.20.1 so this is now forced in the dependencies making the update easier.
2022-06-21 23:33:38 +02:00
b5b8e5a30b
Merge branch 'KoboldAI:main' into united
2022-06-21 23:19:57 +02:00
2be1f5088f
Merge pull request #126 from VE-FORBRYDERNE/opt
...
Update OPT models and fix 20B model on TPU
2022-06-21 23:19:03 +02:00
33a2a318db
Fix 20B TPU model
2022-06-21 17:16:01 -04:00
a7e3ef71aa
Add final layer norm to OPT
2022-06-21 16:36:26 -04:00
37eb47d0d3
Merge pull request #157 from VE-FORBRYDERNE/sp-fix
...
Bug fixes and new soft prompt implementation
2022-06-21 22:20:36 +02:00
8593bf339b
Another typo fix
2022-06-21 15:36:25 -04:00
7e0ded6b47
Typo fix
2022-06-21 15:12:55 -04:00
91643be10a
Change soft prompt implementation to a more universal one
2022-06-21 15:03:43 -04:00
0ea4fa9c87
Automatically calculate badwords and pad_token_id
2022-06-21 14:35:52 -04:00
ea7d278ff4
Fix 20B TPU model
2022-06-21 13:16:45 -04:00
6b172306f6
move_model_to_devices no longer crashes if you don't have accelerate
2022-06-21 13:15:46 -04:00
f2c5bb5cb7
Merge pull request #156 from VE-FORBRYDERNE/accelerate
...
Accelerate disk cache support
2022-06-21 00:31:50 +02:00
ff69e9fbfe
Put layers_module_names, module_names and named_buffers in utils.py
2022-06-20 17:17:42 -04:00
1620ac4148
Lazy loader needs to cache named buffers of layers in the disk cache
2022-06-20 17:08:52 -04:00
ab5ab79003
Set primary device to CPU if in CPU-only mode
2022-06-20 16:25:01 -04:00
bd7d7b41a1
Don't enable accelerate if no layers are in disk cache or GPUs
2022-06-20 16:21:44 -04:00
90fd8b1845
Disk cache support in CPU-only mode
2022-06-20 16:06:09 -04:00
af07d7a15f
Disk cache support for computers with at least one GPU
2022-06-20 14:49:54 -04:00
