somebody
a2ae87d1b7
Utils: Support safetensors aria2 download
2023-04-15 11:51:16 -05:00
somebody
2b950f08d3
Remove legacy no accelerate fallback code
...
Was causing issues with disk cache the old code had a
`and not utils.HAS_ACCELERATE` preceding it (a variable which no longer
exists), and since disk cache is accelerate only, there was no disk
handling code in here. Anyway its bad so blast it
2023-04-15 10:47:31 -05:00
somebody
b2e6fcfe3a
Remove line that sets disk_layers to None always
...
whoops
2023-04-15 10:41:10 -05:00
somebody
ea8df4c0d3
Merge branch 'united' of https://github.com/henk717/KoboldAI into model-structure-and-maybe-rwkv
2023-04-14 20:38:56 -05:00
somebody
38c53191d3
possible fix for cache dl thing
2023-04-14 20:25:03 -05:00
Henk
bde9c6980f
Transformers 4.28 support
2023-04-14 14:13:46 +02:00
henk717
03ab4b25af
Merge branch 'KoboldAI:main' into united
2023-04-14 13:59:55 +02:00
henk717
2385a34098
Merge pull request #325 from YellowRoseCx/patch-1
...
Add IP Whitelisting to --host
2023-04-10 14:08:09 +02:00
somebody
334c09606b
Fix for tokenizer stuff on pythia
2023-04-09 18:23:58 -05:00
somebody
3e8e3a18b0
Fix for custom gpt2
2023-04-09 18:23:52 -05:00
somebody
f73a8bb808
Merge branch 'united' of https://github.com/henk717/KoboldAI into model-structure-and-maybe-rwkv
2023-04-09 14:38:09 -05:00
somebody
fedbffd07b
Small fixes
...
Typos galore!
2023-04-09 13:35:28 -05:00
YellowRoseCx
ac98cd6dd1
add IP_whitelisting to koboldai_settings.py
2023-04-05 21:27:59 -05:00
YellowRoseCx
71e5d23a5b
Add IP whitelisting to --host
2023-04-05 21:23:24 -05:00
Henk
80e4b9e536
Merge branch 'main' into united
2023-04-05 00:22:30 +02:00
henk717
29c2d4b7a6
Removing Pygmalion from the TPU colab to get it unbanned
2023-04-04 19:51:18 +02:00
henk717
fd12214091
Clean the description of the GPU colab
2023-04-04 19:40:22 +02:00
henk717
bb51127bbf
We no longer support Pygmalion on Colab due to Google's Pygmalion ban
2023-04-04 19:37:15 +02:00
Henk
4b71da1714
Horde settings in the UI
2023-04-04 17:20:43 +02:00
Henk
8bf533da9a
Pin Accelerate Version
2023-04-04 01:47:59 +02:00
somebody
8412f83ce5
Breakmodel: Fix typo
2023-04-03 18:41:18 -05:00
somebody
4230fe4229
Merge branch 'united' of https://github.com/henk717/KoboldAI into model-structure-and-maybe-rwkv
2023-04-02 16:41:21 -05:00
somebody
77f0797b1a
Model fix
2023-04-02 15:47:52 -05:00
somebody
9d70646e4d
Lazyload: Safetensors
2023-04-02 15:40:34 -05:00
Henk
4a8b099888
Model loading fix
2023-04-02 00:29:56 +02:00
henk717
72b4669563
Fix the chex dependency
2023-03-30 23:41:35 +02:00
henk717
943d0fe68a
Merge branch 'KoboldAI:main' into united
2023-03-30 00:51:17 +02:00
henk717
ab779efe0e
Merge pull request #276 from YellowRoseCx/stable-branch
...
Update README and remove unavailable model from gpu.ipynb
2023-03-30 00:50:15 +02:00
YellowRoseCx
3c48a77a52
Update README.md
...
changed Colab GPU models listed to their higher quality counter parts
2023-03-29 17:44:44 -05:00
YellowRoseCx
f826930c02
Update GPU.ipynb
...
removed litv2-6B-rev3
2023-03-29 17:41:01 -05:00
henk717
66264d38c4
Add Mixes
2023-03-28 00:23:10 +02:00
henk717
37c3fd00b9
Merge pull request #315 from jojorne/jojorne-patch-enable-renaming-deleting-wi-root-folder
...
Enable renaming/deleting wi root folder by creating a new one
2023-03-26 16:30:41 +02:00
henk717
bbb554efd3
Merge branch 'KoboldAI:main' into united
2023-03-26 01:45:52 +01:00
somebody
91bb433b5f
GenericTokenizer: Fall back to defined tokenizer
...
Shouldn't be relied on for model-agnostic code, but for loading
processes where you know the tokenizer class used it should be okie
dokie
2023-03-19 19:03:20 -05:00
henk717
94eb8ff825
TPU Message
2023-03-19 14:52:14 +01:00
somebody
864f9ed8c3
Add small debug for TPU
2023-03-17 17:06:48 -05:00
somebody
ffe85ce8a1
Modeling: Fix logits processors (probs, biasing, lua)
2023-03-17 16:56:47 -05:00
somebody
692dbfeb37
Merge branch 'united' of https://github.com/henk717/KoboldAI into model-structure-and-maybe-rwkv
2023-03-17 16:20:13 -05:00
somebody
8d0bc404a5
Model: More Jax import fixes and formatting
2023-03-17 15:36:44 -05:00
Henk
90a7eb6153
LLama tokenizer settings
2023-03-17 12:40:08 +01:00
Henk
1235b71bb5
Merge branch 'main' into united
2023-03-17 01:48:10 +01:00
Henk
219b824b9b
SocketIO Requirements Pin
2023-03-17 01:28:59 +01:00
henk717
86c87b23c0
Merge branch 'KoboldAI:main' into united
2023-03-17 01:17:58 +01:00
jojorne
8378ff9e26
Fix typo
2023-03-14 04:20:32 -03:00
jojorne
8d5a581d5d
Enable renaming deleting wi root folder by creating a new one
2023-03-14 04:04:01 -03:00
somebody
03af06638c
Modeling: Maybe fix samplers
2023-03-13 20:42:35 -05:00
somebody
65b60085e3
Undo debug
2023-03-13 20:30:46 -05:00
somebody
b93c339145
Model: Lazyload backends
2023-03-13 20:29:29 -05:00
somebody
adc11fdbc9
TPUMTJ: Fix loading bar
...
I don't know why it works but I know it works
2023-03-13 20:13:05 -05:00
somebody
938c97b75a
RWKV: Fix yet another typo
2023-03-13 19:39:19 -05:00