Commit Graph

3830 Commits

Author SHA1 Message Date
somebody
a2ae87d1b7 Utils: Support safetensors aria2 download 2023-04-15 11:51:16 -05:00
somebody
2b950f08d3 Remove legacy no accelerate fallback code
Was causing issues with disk cache the old code had a
`and not utils.HAS_ACCELERATE` preceding it (a variable which no longer
exists), and since disk cache is accelerate only, there was no disk
handling code in here. Anyway its bad so blast it
2023-04-15 10:47:31 -05:00
somebody
b2e6fcfe3a Remove line that sets disk_layers to None always
whoops
2023-04-15 10:41:10 -05:00
somebody
ea8df4c0d3 Merge branch 'united' of https://github.com/henk717/KoboldAI into model-structure-and-maybe-rwkv 2023-04-14 20:38:56 -05:00
somebody
38c53191d3 possible fix for cache dl thing 2023-04-14 20:25:03 -05:00
Henk
bde9c6980f Transformers 4.28 support 2023-04-14 14:13:46 +02:00
henk717
03ab4b25af Merge branch 'KoboldAI:main' into united 2023-04-14 13:59:55 +02:00
henk717
2385a34098 Merge pull request #325 from YellowRoseCx/patch-1
Add IP Whitelisting to --host
2023-04-10 14:08:09 +02:00
somebody
334c09606b Fix for tokenizer stuff on pythia 2023-04-09 18:23:58 -05:00
somebody
3e8e3a18b0 Fix for custom gpt2 2023-04-09 18:23:52 -05:00
somebody
f73a8bb808 Merge branch 'united' of https://github.com/henk717/KoboldAI into model-structure-and-maybe-rwkv 2023-04-09 14:38:09 -05:00
somebody
fedbffd07b Small fixes
Typos galore!
2023-04-09 13:35:28 -05:00
YellowRoseCx
ac98cd6dd1 add IP_whitelisting to koboldai_settings.py 2023-04-05 21:27:59 -05:00
YellowRoseCx
71e5d23a5b Add IP whitelisting to --host 2023-04-05 21:23:24 -05:00
Henk
80e4b9e536 Merge branch 'main' into united 2023-04-05 00:22:30 +02:00
henk717
29c2d4b7a6 Removing Pygmalion from the TPU colab to get it unbanned 2023-04-04 19:51:18 +02:00
henk717
fd12214091 Clean the description of the GPU colab 2023-04-04 19:40:22 +02:00
henk717
bb51127bbf We no longer support Pygmalion on Colab due to Google's Pygmalion ban 2023-04-04 19:37:15 +02:00
Henk
4b71da1714 Horde settings in the UI 2023-04-04 17:20:43 +02:00
Henk
8bf533da9a Pin Accelerate Version 2023-04-04 01:47:59 +02:00
somebody
8412f83ce5 Breakmodel: Fix typo 2023-04-03 18:41:18 -05:00
somebody
4230fe4229 Merge branch 'united' of https://github.com/henk717/KoboldAI into model-structure-and-maybe-rwkv 2023-04-02 16:41:21 -05:00
somebody
77f0797b1a Model fix 2023-04-02 15:47:52 -05:00
somebody
9d70646e4d Lazyload: Safetensors 2023-04-02 15:40:34 -05:00
Henk
4a8b099888 Model loading fix 2023-04-02 00:29:56 +02:00
henk717
72b4669563 Fix the chex dependency 2023-03-30 23:41:35 +02:00
henk717
943d0fe68a Merge branch 'KoboldAI:main' into united 2023-03-30 00:51:17 +02:00
henk717
ab779efe0e Merge pull request #276 from YellowRoseCx/stable-branch
Update README and remove unavailable model from gpu.ipynb
2023-03-30 00:50:15 +02:00
YellowRoseCx
3c48a77a52 Update README.md
changed Colab GPU models listed to their higher quality counter parts
2023-03-29 17:44:44 -05:00
YellowRoseCx
f826930c02 Update GPU.ipynb
removed litv2-6B-rev3
2023-03-29 17:41:01 -05:00
henk717
66264d38c4 Add Mixes 2023-03-28 00:23:10 +02:00
henk717
37c3fd00b9 Merge pull request #315 from jojorne/jojorne-patch-enable-renaming-deleting-wi-root-folder
Enable renaming/deleting wi root folder by creating a new one
2023-03-26 16:30:41 +02:00
henk717
bbb554efd3 Merge branch 'KoboldAI:main' into united 2023-03-26 01:45:52 +01:00
somebody
91bb433b5f GenericTokenizer: Fall back to defined tokenizer
Shouldn't be relied on for model-agnostic code, but for loading
processes where you know the tokenizer class used it should be okie
dokie
2023-03-19 19:03:20 -05:00
henk717
94eb8ff825 TPU Message 2023-03-19 14:52:14 +01:00
somebody
864f9ed8c3 Add small debug for TPU 2023-03-17 17:06:48 -05:00
somebody
ffe85ce8a1 Modeling: Fix logits processors (probs, biasing, lua) 2023-03-17 16:56:47 -05:00
somebody
692dbfeb37 Merge branch 'united' of https://github.com/henk717/KoboldAI into model-structure-and-maybe-rwkv 2023-03-17 16:20:13 -05:00
somebody
8d0bc404a5 Model: More Jax import fixes and formatting 2023-03-17 15:36:44 -05:00
Henk
90a7eb6153 LLama tokenizer settings 2023-03-17 12:40:08 +01:00
Henk
1235b71bb5 Merge branch 'main' into united 2023-03-17 01:48:10 +01:00
Henk
219b824b9b SocketIO Requirements Pin 2023-03-17 01:28:59 +01:00
henk717
86c87b23c0 Merge branch 'KoboldAI:main' into united 2023-03-17 01:17:58 +01:00
jojorne
8378ff9e26 Fix typo 2023-03-14 04:20:32 -03:00
jojorne
8d5a581d5d Enable renaming deleting wi root folder by creating a new one 2023-03-14 04:04:01 -03:00
somebody
03af06638c Modeling: Maybe fix samplers 2023-03-13 20:42:35 -05:00
somebody
65b60085e3 Undo debug 2023-03-13 20:30:46 -05:00
somebody
b93c339145 Model: Lazyload backends 2023-03-13 20:29:29 -05:00
somebody
adc11fdbc9 TPUMTJ: Fix loading bar
I don't know why it works but I know it works
2023-03-13 20:13:05 -05:00
somebody
938c97b75a RWKV: Fix yet another typo 2023-03-13 19:39:19 -05:00