Commit Graph

3892 Commits

Author SHA1 Message Date
henk717
f761c4dafa Merge pull request #305 from SillyLossy/united
Fix setting softprompt via V1 API
2023-03-09 13:03:14 +01:00
SillyLossy
0d1771501f Fix setting softprompt via V1 API 2023-03-09 13:15:50 +02:00
YellowRoseCx
c5607110ee typo fix
fixed typo of "specfic" to "specific"
2023-03-08 15:36:30 -06:00
YellowRoseCx
4371de2c11 added rng_states variable
added rng_states variable to fix an error caused by passing a seed through the API without having a seed already in use
2023-03-08 15:35:55 -06:00
henk717
ffa5c0bc13 Empty Revision Fix 2023-03-08 20:52:03 +01:00
henk717
487739911a Restore Pygmalion 6B Dev 2023-03-08 18:44:03 +01:00
Henk
da70e8e220 Merge branch 'main' into united 2023-03-08 18:09:22 +01:00
Henk
2ed6cdb411 Huggingface Hub Pin 2023-03-08 18:03:36 +01:00
somebody
cb6010d666 Model: Respect sampler bounds in torch
A rather embarassing way to spend an hour debugging after I told myself
"I'd better remember to add this important thing to the torch side".

Samplers were being applied when in their "off values" causing
boring mathmatical operations to take place (ie anything x 0 is always
0)
2023-03-07 21:14:37 -06:00
somebody
6b45367cc7 Model: Rename "Colab" to "Basic API" 2023-03-07 17:07:01 -06:00
somebody
dc3dd38c4e Merge branch 'united' of https://github.com/henk717/KoboldAI into model-structure-and-maybe-rwkv 2023-03-07 17:02:28 -06:00
somebody
3b05359e4b Model: Refuse to serve certain models over the API 2023-03-07 16:54:08 -06:00
somebody
3a128e76b4 Attempts at dynamic wi fixes 2023-03-07 16:33:23 -06:00
henk717
b307cdff57 Merge pull request #301 from jojorne/jojorne-patch-use-str-for-wi-keys
Access WI uid keys with str
2023-03-06 21:15:44 +01:00
Henk
099c818c06 Experimental unbanning of <> 2023-03-06 20:56:15 +01:00
Henk
b7f30a41c5 LLama tokenizer workaround 2023-03-06 19:32:28 +01:00
jojorne
4f17bf0c87 Access WI uid keys with str. 2023-03-05 13:22:33 -03:00
somebody
5d9bd96ad8 Model: Fix API support 2023-03-04 21:15:12 -06:00
somebody
beef23f5a1 Model: Add debug code for detecting faulty samplers 2023-03-04 19:02:20 -06:00
somebody
c7822464c7 oops 2023-03-04 19:02:20 -06:00
somebody
b02513df07 Model: Add singleline_stopper and fix stopper code
singleline_stopper adapted from MasterAibo in 0ba7ac9
2023-03-04 19:02:20 -06:00
Henk
6857d2f7e1 Remove old worker API 2023-03-04 19:02:19 -06:00
Henk
9ee6adb35c Enable BMS API again under a new name 2023-03-04 19:02:19 -06:00
LightSaveUs
1b911eab8f RTE (6B) 2023-03-04 19:02:15 -06:00
LightSaveUs
9a85d6c4e7 RTE (13B) 2023-03-04 19:02:15 -06:00
LightSaveUs
a0d12bb29c RTE (Custom) 2023-03-04 19:02:15 -06:00
Henk
55349d84e1 Remote no longer unblocks the port by default 2023-03-04 19:02:15 -06:00
somebody
70cddc46e2 Model: Small cleanup 2023-03-04 19:02:10 -06:00
somebody
27b7635c95 Model: Fix TPU 2023-03-04 19:02:00 -06:00
Henk
1c891181e9 Remove old worker API 2023-03-04 18:27:02 +01:00
Henk
59e1f74f7c Enable BMS API again under a new name 2023-03-04 14:17:47 +01:00
henk717
aa558da49c Merge pull request #297 from aibosan/united-singleline-stopper
Created SinglelineStopper...
2023-03-02 20:51:54 +01:00
henk717
99e40ce8e8 Merge pull request #276 from LightSaveUs/united
Restoring the Effect (of the presets)
2023-03-02 20:44:05 +01:00
Henk
f03b538cab Remote no longer unblocks the port by default 2023-03-02 17:43:23 +01:00
Ondřej Benda
aa124b65db Fix: incorrect newline evaluation 2023-03-02 08:22:31 +01:00
somebody
f2974d205e RWKV: Remove old gnarly (in a bad way) RWKV4 support
Better interface for it coming soon
2023-03-01 19:26:55 -06:00
somebody
54cecd4d5d Model: And another refactor 2023-03-01 19:16:35 -06:00
Ondřej Benda
0ba7ac96d3 Created SinglelineStopper, which interrupts token generation when a newline is reached if singleline mode is enabled 2023-03-02 00:04:17 +01:00
henk717
142cb354f9 Nerybus 13B - TPU colab 2023-03-01 22:33:11 +01:00
Henk
93bf023bd7 Use our own horde URL 2023-03-01 17:54:39 +01:00
henk717
750cc3d2dc Merge pull request #245 from db0/kaimergemain2
Makes prod version of KAI work with merged hordes in stablehorde.net
2023-03-01 17:52:58 +01:00
somebody
225dcf1a0a Model: Documentation part 1 2023-02-28 20:10:09 -06:00
somebody
ef1155291f Model: TPU Fixes 2023-02-28 18:05:34 -06:00
somebody
bd3bbdaad8 Model: More tpu fixes 2023-02-27 19:29:03 -06:00
somebody
45cd6b5de2 Model: Don't do breakmodel on colab 2023-02-27 19:24:41 -06:00
somebody
ed83362dee Model: TPU should be ready for testing 2023-02-27 19:08:44 -06:00
somebody
1839de1483 colab debug 2023-02-27 18:40:26 -06:00
somebody
2e3ca6f769 Model: Bugfixes/fix tokenizer hack 2023-02-27 18:30:13 -06:00
Henk
9265be58e9 Modeldir Fixes 2023-02-27 17:52:06 +01:00
Henk
0e06fc371f Modeldir Fix 2023-02-27 17:46:33 +01:00