rixty/KoboldAI-Client
1
1
Fork 0
mirror of https://github.com/KoboldAI/KoboldAI-Client.git synced 2025-06-05 21:59:24 +02:00
Code Issues Projects Releases Wiki Activity
4,067 Commits 1 Branch 5 Tags
0659b5062ba1d73d90455212e3042dccc3645dfc
Commit Graph

4067 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
jojorne
423c022648 Fix save loading between v1 and v2 to v3 with wi features 2023-03-11 13:14:46 -03:00
somebody
38c4edac40 Model: Fix eos/bos padding issue 
Weird config None assignments
 2023-03-10 20:01:01 -06:00
SillyLossy
3ac3e41dd8 Fix setting softprompt via V1 API 2023-03-10 20:00:39 -06:00
henk717
6da57e8459 Nerybus 13B - TPU colab 2023-03-10 20:00:39 -06:00
somebody
d2696dad66 Remove ancient debug 2023-03-10 20:00:39 -06:00
somebody
8937e7f6df Model: Add basic tests 
We now do some basic tests for:
- hf torch loading (normal, lazy, lowmem)
- hf torch generation (shape batches, shape tokencount, faulty
  determinism)

Currently full determinism is failing; yahoo, the tests work!

All of the tests initally failed (note the test environment functions
different from the aiserver environment due to aiserver doing a lot of
initalizing stuff, working on phasing that out) but now only one fails.
Very useful for finding bugs!
 2023-03-10 20:00:39 -06:00
somebody
8c8bdfaf6a Model: Fix assorted bugs 
and ignore warnings in pytest
 2023-03-10 20:00:39 -06:00
somebody
3646aa9e83 Model: Respect model lazyload over kaivars 
kaivars dictates model config unless its from outside aiserver or
whatever.
 2023-03-10 20:00:39 -06:00
somebody
a472bdf6c3 Cleanup 2023-03-10 20:00:39 -06:00
somebody
52095054a3 Model: Reformat and clean up 2023-03-10 20:00:39 -06:00
somebody
fb0b2f0467 Model: Ditch awful current_model hack 
thanks to whjms for spotting that this could be zapped
 2023-03-10 20:00:38 -06:00
somebody
885c226651 Don't recurse over .git for pytest 2023-03-10 20:00:38 -06:00
YellowRoseCx
5bc862df56 Merge branch 'henk717:united' into united-yr 2023-03-10 12:39:36 -06:00
whjms
a3631ce503 remove black dep 2023-03-09 18:17:52 -05:00
whjms
b5000b35d9 fix 404 handler 2023-03-09 18:17:30 -05:00
whjms
afcdc724aa fix worldinfo prop name 2023-03-09 18:17:30 -05:00
whjms
ad2c2b6722 move aetherroom import to separate module 2023-03-09 18:17:30 -05:00
whjms
d7854e9d59 ignore .venv 2023-03-09 18:17:30 -05:00
henk717
f761c4dafa Merge pull request #305 from SillyLossy/united 
Fix setting softprompt via V1 API
 2023-03-09 13:03:14 +01:00
SillyLossy
0d1771501f Fix setting softprompt via V1 API 2023-03-09 13:15:50 +02:00
Llama
835cf50ebc Merge pull request #25 from henk717/united 
Merge united
 2023-03-08 22:58:43 -08:00
YellowRoseCx
c5607110ee typo fix 
fixed typo of "specfic" to "specific"
 2023-03-08 15:36:30 -06:00
YellowRoseCx
4371de2c11 added rng_states variable 
added rng_states variable to fix an error caused by passing a seed through the API without having a seed already in use
 2023-03-08 15:35:55 -06:00
henk717
ffa5c0bc13 Empty Revision Fix 2023-03-08 20:52:03 +01:00
henk717
487739911a Restore Pygmalion 6B Dev 2023-03-08 18:44:03 +01:00
Henk
da70e8e220 Merge branch 'main' into united 2023-03-08 18:09:22 +01:00
Henk
2ed6cdb411 Huggingface Hub Pin 2023-03-08 18:03:36 +01:00
somebody
cb6010d666 Model: Respect sampler bounds in torch 
A rather embarassing way to spend an hour debugging after I told myself
"I'd better remember to add this important thing to the torch side".

Samplers were being applied when in their "off values" causing
boring mathmatical operations to take place (ie anything x 0 is always
0)
 2023-03-07 21:14:37 -06:00
somebody
6b45367cc7 Model: Rename "Colab" to "Basic API" 2023-03-07 17:07:01 -06:00
somebody
dc3dd38c4e Merge branch 'united' of https://github.com/henk717/KoboldAI into model-structure-and-maybe-rwkv 2023-03-07 17:02:28 -06:00
somebody
3b05359e4b Model: Refuse to serve certain models over the API 2023-03-07 16:54:08 -06:00
somebody
3a128e76b4 Attempts at dynamic wi fixes 2023-03-07 16:33:23 -06:00
Llama
7f0fd92a59 Merge pull request #24 from henk717/united 
Merge united
 2023-03-06 21:03:55 -08:00
henk717
b307cdff57 Merge pull request #301 from jojorne/jojorne-patch-use-str-for-wi-keys 
Access WI uid keys with str
 2023-03-06 21:15:44 +01:00
Henk
099c818c06 Experimental unbanning of <> 2023-03-06 20:56:15 +01:00
Henk
b7f30a41c5 LLama tokenizer workaround 2023-03-06 19:32:28 +01:00
jojorne
4f17bf0c87 Access WI uid keys with str. 2023-03-05 13:22:33 -03:00
somebody
5d9bd96ad8 Model: Fix API support 2023-03-04 21:15:12 -06:00
somebody
beef23f5a1 Model: Add debug code for detecting faulty samplers 2023-03-04 19:02:20 -06:00
somebody
c7822464c7 oops 2023-03-04 19:02:20 -06:00
somebody
b02513df07 Model: Add singleline_stopper and fix stopper code 
singleline_stopper adapted from MasterAibo in 0ba7ac9
 2023-03-04 19:02:20 -06:00
Henk
6857d2f7e1 Remove old worker API 2023-03-04 19:02:19 -06:00
Henk
9ee6adb35c Enable BMS API again under a new name 2023-03-04 19:02:19 -06:00
LightSaveUs
1b911eab8f RTE (6B) 2023-03-04 19:02:15 -06:00
LightSaveUs
9a85d6c4e7 RTE (13B) 2023-03-04 19:02:15 -06:00
LightSaveUs
a0d12bb29c RTE (Custom) 2023-03-04 19:02:15 -06:00
Henk
55349d84e1 Remote no longer unblocks the port by default 2023-03-04 19:02:15 -06:00
somebody
70cddc46e2 Model: Small cleanup 2023-03-04 19:02:10 -06:00
somebody
27b7635c95 Model: Fix TPU 2023-03-04 19:02:00 -06:00
Henk
1c891181e9 Remove old worker API 2023-03-04 18:27:02 +01:00