somebody
bf8b60ac2d
Model: Add GenericTokenizer
...
Because Hugging Face doesnt have a consistant API across their own
libraries
2023-03-13 17:36:58 -05:00
henk717
5249045c35
Merge pull request #304 from YellowRoseCx/united-yr
...
added local rng_states variable and fixed minor typo
2023-03-13 22:46:00 +01:00
somebody
60793eb121
Make modellist easier to work with
2023-03-13 15:40:24 -05:00
henk717
c96e96f95e
Merge pull request #307 from jojorne/jojorne-patch-fix-save-loading-with-wi-features
...
Fix save loading between v1 and v2 to v3 with wi features
2023-03-13 21:40:11 +01:00
somebody
0320678b27
Model: WIP horde and API tests
2023-03-13 14:11:06 -05:00
Henk
8da04a98a4
Better Runtime Isolation
2023-03-13 18:41:25 +01:00
Nick Perez
0dce4c700f
Just reverse the range
2023-03-13 07:00:51 -04:00
Nick Perez
b4b24f1389
Fix out of range after deletion in for loop
2023-03-13 06:21:25 -04:00
somebody
cd8ccf0a5e
Modeling: Add seed parameter to raw_generate
...
Yahooo, decoupling from koboldai_vars. This makes the generation test
pass in `test_generation.py`, and makes full determinism outside of
core_generate work.
2023-03-12 21:49:10 -05:00
jojorne
4b8d4cde7d
fix spacing
2023-03-12 20:41:34 -03:00
jojorne
4219e3e8d3
Removing the root folder is not supported
2023-03-12 20:38:58 -03:00
jojorne
e5c1b0506a
Renaming the root folder is not supported
2023-03-12 20:05:40 -03:00
jojorne
53f06903c2
revert more unrelated code
2023-03-11 13:54:01 -03:00
jojorne
c87ef60db1
revert more unrelated code
2023-03-11 13:48:41 -03:00
jojorne
e4ad8547a7
revert unrelated code
2023-03-11 13:39:19 -03:00
jojorne
47242e9abe
remove debug code
2023-03-11 13:21:22 -03:00
jojorne
423c022648
Fix save loading between v1 and v2 to v3 with wi features
2023-03-11 13:14:46 -03:00
somebody
38c4edac40
Model: Fix eos/bos padding issue
...
Weird config None assignments
2023-03-10 20:01:01 -06:00
SillyLossy
3ac3e41dd8
Fix setting softprompt via V1 API
2023-03-10 20:00:39 -06:00
henk717
6da57e8459
Nerybus 13B - TPU colab
2023-03-10 20:00:39 -06:00
somebody
d2696dad66
Remove ancient debug
2023-03-10 20:00:39 -06:00
somebody
8937e7f6df
Model: Add basic tests
...
We now do some basic tests for:
- hf torch loading (normal, lazy, lowmem)
- hf torch generation (shape batches, shape tokencount, faulty
determinism)
Currently full determinism is failing; yahoo, the tests work!
All of the tests initally failed (note the test environment functions
different from the aiserver environment due to aiserver doing a lot of
initalizing stuff, working on phasing that out) but now only one fails.
Very useful for finding bugs!
2023-03-10 20:00:39 -06:00
somebody
8c8bdfaf6a
Model: Fix assorted bugs
...
and ignore warnings in pytest
2023-03-10 20:00:39 -06:00
somebody
3646aa9e83
Model: Respect model lazyload over kaivars
...
kaivars dictates model config unless its from outside aiserver or
whatever.
2023-03-10 20:00:39 -06:00
somebody
a472bdf6c3
Cleanup
2023-03-10 20:00:39 -06:00
somebody
52095054a3
Model: Reformat and clean up
2023-03-10 20:00:39 -06:00
somebody
fb0b2f0467
Model: Ditch awful current_model hack
...
thanks to whjms for spotting that this could be zapped
2023-03-10 20:00:38 -06:00
somebody
885c226651
Don't recurse over .git for pytest
2023-03-10 20:00:38 -06:00
YellowRoseCx
5bc862df56
Merge branch 'henk717:united' into united-yr
2023-03-10 12:39:36 -06:00
whjms
a3631ce503
remove black dep
2023-03-09 18:17:52 -05:00
whjms
b5000b35d9
fix 404 handler
2023-03-09 18:17:30 -05:00
whjms
afcdc724aa
fix worldinfo prop name
2023-03-09 18:17:30 -05:00
whjms
ad2c2b6722
move aetherroom import to separate module
2023-03-09 18:17:30 -05:00
whjms
d7854e9d59
ignore .venv
2023-03-09 18:17:30 -05:00
henk717
f761c4dafa
Merge pull request #305 from SillyLossy/united
...
Fix setting softprompt via V1 API
2023-03-09 13:03:14 +01:00
SillyLossy
0d1771501f
Fix setting softprompt via V1 API
2023-03-09 13:15:50 +02:00
Llama
835cf50ebc
Merge pull request #25 from henk717/united
...
Merge united
2023-03-08 22:58:43 -08:00
YellowRoseCx
c5607110ee
typo fix
...
fixed typo of "specfic" to "specific"
2023-03-08 15:36:30 -06:00
YellowRoseCx
4371de2c11
added rng_states variable
...
added rng_states variable to fix an error caused by passing a seed through the API without having a seed already in use
2023-03-08 15:35:55 -06:00
henk717
ffa5c0bc13
Empty Revision Fix
2023-03-08 20:52:03 +01:00
henk717
487739911a
Restore Pygmalion 6B Dev
2023-03-08 18:44:03 +01:00
Henk
da70e8e220
Merge branch 'main' into united
2023-03-08 18:09:22 +01:00
Henk
2ed6cdb411
Huggingface Hub Pin
2023-03-08 18:03:36 +01:00
somebody
cb6010d666
Model: Respect sampler bounds in torch
...
A rather embarassing way to spend an hour debugging after I told myself
"I'd better remember to add this important thing to the torch side".
Samplers were being applied when in their "off values" causing
boring mathmatical operations to take place (ie anything x 0 is always
0)
2023-03-07 21:14:37 -06:00
somebody
6b45367cc7
Model: Rename "Colab" to "Basic API"
2023-03-07 17:07:01 -06:00
somebody
dc3dd38c4e
Merge branch 'united' of https://github.com/henk717/KoboldAI into model-structure-and-maybe-rwkv
2023-03-07 17:02:28 -06:00
somebody
3b05359e4b
Model: Refuse to serve certain models over the API
2023-03-07 16:54:08 -06:00
somebody
3a128e76b4
Attempts at dynamic wi fixes
2023-03-07 16:33:23 -06:00
Llama
7f0fd92a59
Merge pull request #24 from henk717/united
...
Merge united
2023-03-06 21:03:55 -08:00
henk717
b307cdff57
Merge pull request #301 from jojorne/jojorne-patch-use-str-for-wi-keys
...
Access WI uid keys with str
2023-03-06 21:15:44 +01:00
