Commit Graph

4073 Commits

Author SHA1 Message Date
henk717
fd12214091 Clean the description of the GPU colab 2023-04-04 19:40:22 +02:00
henk717
bb51127bbf We no longer support Pygmalion on Colab due to Google's Pygmalion ban 2023-04-04 19:37:15 +02:00
Henk
4b71da1714 Horde settings in the UI 2023-04-04 17:20:43 +02:00
Henk
8bf533da9a Pin Accelerate Version 2023-04-04 01:47:59 +02:00
somebody
8412f83ce5 Breakmodel: Fix typo 2023-04-03 18:41:18 -05:00
somebody
4230fe4229 Merge branch 'united' of https://github.com/henk717/KoboldAI into model-structure-and-maybe-rwkv 2023-04-02 16:41:21 -05:00
somebody
77f0797b1a Model fix 2023-04-02 15:47:52 -05:00
somebody
9d70646e4d Lazyload: Safetensors 2023-04-02 15:40:34 -05:00
Henk
4a8b099888 Model loading fix 2023-04-02 00:29:56 +02:00
henk717
72b4669563 Fix the chex dependency 2023-03-30 23:41:35 +02:00
henk717
943d0fe68a Merge branch 'KoboldAI:main' into united 2023-03-30 00:51:17 +02:00
henk717
ab779efe0e Merge pull request #276 from YellowRoseCx/stable-branch
Update README and remove unavailable model from gpu.ipynb
2023-03-30 00:50:15 +02:00
YellowRoseCx
3c48a77a52 Update README.md
changed Colab GPU models listed to their higher quality counter parts
2023-03-29 17:44:44 -05:00
YellowRoseCx
f826930c02 Update GPU.ipynb
removed litv2-6B-rev3
2023-03-29 17:41:01 -05:00
henk717
66264d38c4 Add Mixes 2023-03-28 00:23:10 +02:00
Llama
157b1c75e7 Merge pull request #27 from henk717/united
Merge united
2023-03-26 23:25:36 -07:00
henk717
37c3fd00b9 Merge pull request #315 from jojorne/jojorne-patch-enable-renaming-deleting-wi-root-folder
Enable renaming/deleting wi root folder by creating a new one
2023-03-26 16:30:41 +02:00
henk717
bbb554efd3 Merge branch 'KoboldAI:main' into united 2023-03-26 01:45:52 +01:00
somebody
91bb433b5f GenericTokenizer: Fall back to defined tokenizer
Shouldn't be relied on for model-agnostic code, but for loading
processes where you know the tokenizer class used it should be okie
dokie
2023-03-19 19:03:20 -05:00
henk717
94eb8ff825 TPU Message 2023-03-19 14:52:14 +01:00
Llama
5b8db52abb Merge pull request #26 from henk717/united
Merge united
2023-03-17 23:32:27 -07:00
somebody
864f9ed8c3 Add small debug for TPU 2023-03-17 17:06:48 -05:00
somebody
ffe85ce8a1 Modeling: Fix logits processors (probs, biasing, lua) 2023-03-17 16:56:47 -05:00
somebody
692dbfeb37 Merge branch 'united' of https://github.com/henk717/KoboldAI into model-structure-and-maybe-rwkv 2023-03-17 16:20:13 -05:00
somebody
8d0bc404a5 Model: More Jax import fixes and formatting 2023-03-17 15:36:44 -05:00
Henk
90a7eb6153 LLama tokenizer settings 2023-03-17 12:40:08 +01:00
Henk
1235b71bb5 Merge branch 'main' into united 2023-03-17 01:48:10 +01:00
Henk
219b824b9b SocketIO Requirements Pin 2023-03-17 01:28:59 +01:00
henk717
86c87b23c0 Merge branch 'KoboldAI:main' into united 2023-03-17 01:17:58 +01:00
jojorne
8378ff9e26 Fix typo 2023-03-14 04:20:32 -03:00
jojorne
8d5a581d5d Enable renaming deleting wi root folder by creating a new one 2023-03-14 04:04:01 -03:00
somebody
03af06638c Modeling: Maybe fix samplers 2023-03-13 20:42:35 -05:00
somebody
65b60085e3 Undo debug 2023-03-13 20:30:46 -05:00
somebody
b93c339145 Model: Lazyload backends 2023-03-13 20:29:29 -05:00
somebody
adc11fdbc9 TPUMTJ: Fix loading bar
I don't know why it works but I know it works
2023-03-13 20:13:05 -05:00
somebody
938c97b75a RWKV: Fix yet another typo 2023-03-13 19:39:19 -05:00
somebody
3adc67c7a4 RWKV: Move import right before usage
So we don't needlessly compile the cuda kernel
2023-03-13 19:37:45 -05:00
somebody
14b2543c7c RWKV: Fix typo 2023-03-13 19:36:58 -05:00
somebody
b10b201701 Model: Add basic RWKV implementation 2023-03-13 19:34:38 -05:00
henk717
db7b53f52d Merge pull request #310 from nkpz/united
Fix out of range error after editing actions
2023-03-14 01:22:14 +01:00
somebody
bf8b60ac2d Model: Add GenericTokenizer
Because Hugging Face doesnt have a consistant API across their own
libraries
2023-03-13 17:36:58 -05:00
henk717
5249045c35 Merge pull request #304 from YellowRoseCx/united-yr
added local rng_states variable and fixed minor typo
2023-03-13 22:46:00 +01:00
somebody
60793eb121 Make modellist easier to work with 2023-03-13 15:40:24 -05:00
henk717
c96e96f95e Merge pull request #307 from jojorne/jojorne-patch-fix-save-loading-with-wi-features
Fix save loading between v1 and v2 to v3 with wi features
2023-03-13 21:40:11 +01:00
somebody
0320678b27 Model: WIP horde and API tests 2023-03-13 14:11:06 -05:00
Henk
8da04a98a4 Better Runtime Isolation 2023-03-13 18:41:25 +01:00
Nick Perez
0dce4c700f Just reverse the range 2023-03-13 07:00:51 -04:00
Nick Perez
b4b24f1389 Fix out of range after deletion in for loop 2023-03-13 06:21:25 -04:00
somebody
cd8ccf0a5e Modeling: Add seed parameter to raw_generate
Yahooo, decoupling from koboldai_vars. This makes the generation test
pass in `test_generation.py`, and makes full determinism outside of
core_generate work.
2023-03-12 21:49:10 -05:00
jojorne
4b8d4cde7d fix spacing 2023-03-12 20:41:34 -03:00