rixty/KoboldAI-Client
1
1
Fork 0
mirror of https://github.com/KoboldAI/KoboldAI-Client.git synced 2025-06-05 21:59:24 +02:00
Code Issues Projects Releases Wiki Activity
3,892 Commits 1 Branch 5 Tags
fa6bb4b956a76bbe17669737c220c09a1c2c6e6c
Commit Graph

3892 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
somebody
8d0bc404a5 Model: More Jax import fixes and formatting 2023-03-17 15:36:44 -05:00
Henk
90a7eb6153 LLama tokenizer settings 2023-03-17 12:40:08 +01:00
Henk
1235b71bb5 Merge branch 'main' into united 2023-03-17 01:48:10 +01:00
Henk
219b824b9b SocketIO Requirements Pin 2023-03-17 01:28:59 +01:00
henk717
86c87b23c0 Merge branch 'KoboldAI:main' into united 2023-03-17 01:17:58 +01:00
jojorne
8378ff9e26 Fix typo 2023-03-14 04:20:32 -03:00
jojorne
8d5a581d5d Enable renaming deleting wi root folder by creating a new one 2023-03-14 04:04:01 -03:00
somebody
03af06638c Modeling: Maybe fix samplers 2023-03-13 20:42:35 -05:00
somebody
65b60085e3 Undo debug 2023-03-13 20:30:46 -05:00
somebody
b93c339145 Model: Lazyload backends 2023-03-13 20:29:29 -05:00
somebody
adc11fdbc9 TPUMTJ: Fix loading bar 
I don't know why it works but I know it works
 2023-03-13 20:13:05 -05:00
somebody
938c97b75a RWKV: Fix yet another typo 2023-03-13 19:39:19 -05:00
somebody
3adc67c7a4 RWKV: Move import right before usage 
So we don't needlessly compile the cuda kernel
 2023-03-13 19:37:45 -05:00
somebody
14b2543c7c RWKV: Fix typo 2023-03-13 19:36:58 -05:00
somebody
b10b201701 Model: Add basic RWKV implementation 2023-03-13 19:34:38 -05:00
henk717
db7b53f52d Merge pull request #310 from nkpz/united 
Fix out of range error after editing actions
 2023-03-14 01:22:14 +01:00
somebody
bf8b60ac2d Model: Add GenericTokenizer 
Because Hugging Face doesnt have a consistant API across their own
libraries
 2023-03-13 17:36:58 -05:00
henk717
5249045c35 Merge pull request #304 from YellowRoseCx/united-yr 
added local rng_states variable and fixed minor typo
 2023-03-13 22:46:00 +01:00
somebody
60793eb121 Make modellist easier to work with 2023-03-13 15:40:24 -05:00
henk717
c96e96f95e Merge pull request #307 from jojorne/jojorne-patch-fix-save-loading-with-wi-features 
Fix save loading between v1 and v2 to v3 with wi features
 2023-03-13 21:40:11 +01:00
somebody
0320678b27 Model: WIP horde and API tests 2023-03-13 14:11:06 -05:00
Henk
8da04a98a4 Better Runtime Isolation 2023-03-13 18:41:25 +01:00
Nick Perez
0dce4c700f Just reverse the range 2023-03-13 07:00:51 -04:00
Nick Perez
b4b24f1389 Fix out of range after deletion in for loop 2023-03-13 06:21:25 -04:00
somebody
cd8ccf0a5e Modeling: Add seed parameter to raw_generate 
Yahooo, decoupling from koboldai_vars. This makes the generation test
pass in `test_generation.py`, and makes full determinism outside of
core_generate work.
 2023-03-12 21:49:10 -05:00
jojorne
4b8d4cde7d fix spacing 2023-03-12 20:41:34 -03:00
jojorne
4219e3e8d3 Removing the root folder is not supported 2023-03-12 20:38:58 -03:00
jojorne
e5c1b0506a Renaming the root folder is not supported 2023-03-12 20:05:40 -03:00
jojorne
53f06903c2 revert more unrelated code 2023-03-11 13:54:01 -03:00
jojorne
c87ef60db1 revert more unrelated code 2023-03-11 13:48:41 -03:00
jojorne
e4ad8547a7 revert unrelated code 2023-03-11 13:39:19 -03:00
jojorne
47242e9abe remove debug code 2023-03-11 13:21:22 -03:00
jojorne
423c022648 Fix save loading between v1 and v2 to v3 with wi features 2023-03-11 13:14:46 -03:00
somebody
38c4edac40 Model: Fix eos/bos padding issue 
Weird config None assignments
 2023-03-10 20:01:01 -06:00
SillyLossy
3ac3e41dd8 Fix setting softprompt via V1 API 2023-03-10 20:00:39 -06:00
henk717
6da57e8459 Nerybus 13B - TPU colab 2023-03-10 20:00:39 -06:00
somebody
d2696dad66 Remove ancient debug 2023-03-10 20:00:39 -06:00
somebody
8937e7f6df Model: Add basic tests 
We now do some basic tests for:
- hf torch loading (normal, lazy, lowmem)
- hf torch generation (shape batches, shape tokencount, faulty
  determinism)

Currently full determinism is failing; yahoo, the tests work!

All of the tests initally failed (note the test environment functions
different from the aiserver environment due to aiserver doing a lot of
initalizing stuff, working on phasing that out) but now only one fails.
Very useful for finding bugs!
 2023-03-10 20:00:39 -06:00
somebody
8c8bdfaf6a Model: Fix assorted bugs 
and ignore warnings in pytest
 2023-03-10 20:00:39 -06:00
somebody
3646aa9e83 Model: Respect model lazyload over kaivars 
kaivars dictates model config unless its from outside aiserver or
whatever.
 2023-03-10 20:00:39 -06:00
somebody
a472bdf6c3 Cleanup 2023-03-10 20:00:39 -06:00
somebody
52095054a3 Model: Reformat and clean up 2023-03-10 20:00:39 -06:00
somebody
fb0b2f0467 Model: Ditch awful current_model hack 
thanks to whjms for spotting that this could be zapped
 2023-03-10 20:00:38 -06:00
somebody
885c226651 Don't recurse over .git for pytest 2023-03-10 20:00:38 -06:00
YellowRoseCx
5bc862df56 Merge branch 'henk717:united' into united-yr 2023-03-10 12:39:36 -06:00
whjms
a3631ce503 remove black dep 2023-03-09 18:17:52 -05:00
whjms
b5000b35d9 fix 404 handler 2023-03-09 18:17:30 -05:00
whjms
afcdc724aa fix worldinfo prop name 2023-03-09 18:17:30 -05:00
whjms
ad2c2b6722 move aetherroom import to separate module 2023-03-09 18:17:30 -05:00
whjms
d7854e9d59 ignore .venv 2023-03-09 18:17:30 -05:00