Commit Graph

3728 Commits

Author SHA1 Message Date
somebody
6b45367cc7 Model: Rename "Colab" to "Basic API" 2023-03-07 17:07:01 -06:00
somebody
dc3dd38c4e Merge branch 'united' of https://github.com/henk717/KoboldAI into model-structure-and-maybe-rwkv 2023-03-07 17:02:28 -06:00
somebody
3b05359e4b Model: Refuse to serve certain models over the API 2023-03-07 16:54:08 -06:00
somebody
3a128e76b4 Attempts at dynamic wi fixes 2023-03-07 16:33:23 -06:00
henk717
b307cdff57 Merge pull request #301 from jojorne/jojorne-patch-use-str-for-wi-keys
Access WI uid keys with str
2023-03-06 21:15:44 +01:00
Henk
099c818c06 Experimental unbanning of <> 2023-03-06 20:56:15 +01:00
Henk
b7f30a41c5 LLama tokenizer workaround 2023-03-06 19:32:28 +01:00
jojorne
4f17bf0c87 Access WI uid keys with str. 2023-03-05 13:22:33 -03:00
somebody
5d9bd96ad8 Model: Fix API support 2023-03-04 21:15:12 -06:00
somebody
beef23f5a1 Model: Add debug code for detecting faulty samplers 2023-03-04 19:02:20 -06:00
somebody
c7822464c7 oops 2023-03-04 19:02:20 -06:00
somebody
b02513df07 Model: Add singleline_stopper and fix stopper code
singleline_stopper adapted from MasterAibo in 0ba7ac9
2023-03-04 19:02:20 -06:00
Henk
6857d2f7e1 Remove old worker API 2023-03-04 19:02:19 -06:00
Henk
9ee6adb35c Enable BMS API again under a new name 2023-03-04 19:02:19 -06:00
LightSaveUs
1b911eab8f RTE (6B) 2023-03-04 19:02:15 -06:00
LightSaveUs
9a85d6c4e7 RTE (13B) 2023-03-04 19:02:15 -06:00
LightSaveUs
a0d12bb29c RTE (Custom) 2023-03-04 19:02:15 -06:00
Henk
55349d84e1 Remote no longer unblocks the port by default 2023-03-04 19:02:15 -06:00
somebody
70cddc46e2 Model: Small cleanup 2023-03-04 19:02:10 -06:00
somebody
27b7635c95 Model: Fix TPU 2023-03-04 19:02:00 -06:00
Henk
1c891181e9 Remove old worker API 2023-03-04 18:27:02 +01:00
Henk
59e1f74f7c Enable BMS API again under a new name 2023-03-04 14:17:47 +01:00
henk717
aa558da49c Merge pull request #297 from aibosan/united-singleline-stopper
Created SinglelineStopper...
2023-03-02 20:51:54 +01:00
henk717
99e40ce8e8 Merge pull request #276 from LightSaveUs/united
Restoring the Effect (of the presets)
2023-03-02 20:44:05 +01:00
Henk
f03b538cab Remote no longer unblocks the port by default 2023-03-02 17:43:23 +01:00
Ondřej Benda
aa124b65db Fix: incorrect newline evaluation 2023-03-02 08:22:31 +01:00
somebody
f2974d205e RWKV: Remove old gnarly (in a bad way) RWKV4 support
Better interface for it coming soon
2023-03-01 19:26:55 -06:00
somebody
54cecd4d5d Model: And another refactor 2023-03-01 19:16:35 -06:00
Ondřej Benda
0ba7ac96d3 Created SinglelineStopper, which interrupts token generation when a newline is reached if singleline mode is enabled 2023-03-02 00:04:17 +01:00
somebody
225dcf1a0a Model: Documentation part 1 2023-02-28 20:10:09 -06:00
somebody
ef1155291f Model: TPU Fixes 2023-02-28 18:05:34 -06:00
somebody
bd3bbdaad8 Model: More tpu fixes 2023-02-27 19:29:03 -06:00
somebody
45cd6b5de2 Model: Don't do breakmodel on colab 2023-02-27 19:24:41 -06:00
somebody
ed83362dee Model: TPU should be ready for testing 2023-02-27 19:08:44 -06:00
somebody
1839de1483 colab debug 2023-02-27 18:40:26 -06:00
somebody
2e3ca6f769 Model: Bugfixes/fix tokenizer hack 2023-02-27 18:30:13 -06:00
Henk
9265be58e9 Modeldir Fixes 2023-02-27 17:52:06 +01:00
Henk
0e06fc371f Modeldir Fix 2023-02-27 17:46:33 +01:00
somebody
af73527be0 Samplers: Part 2 2023-02-26 17:22:54 -06:00
somebody
f882979c88 Model: Samplers pt. 1 2023-02-26 16:09:22 -06:00
somebody
f771ae38cf Model: Formatting fixes 2023-02-26 14:14:29 -06:00
somebody
10842e964b Get rid of yet another instance of this identical class 2023-02-26 14:02:15 -06:00
somebody
e8236bffbf Model: Fixup horde bug 2023-02-26 13:36:06 -06:00
somebody
15f957260f Model: Add rep pen for OAI API 2023-02-26 13:35:54 -06:00
somebody
35bbd78326 Model: Monkey release detection fix 2023-02-26 13:35:29 -06:00
somebody
b99c16f562 Merge branch 'united' of https://github.com/henk717/KoboldAI into model-structure-and-maybe-rwkv 2023-02-26 13:06:30 -06:00
somebody
56bcd32f6d Model: Fix ReadOnly
whoops
2023-02-26 12:40:20 -06:00
somebody
a73804ca1e Accelerate: Remove HAS_ACCELERATE
Accelerate has been a dependency for a while, and as such we probably
shouldn't be lugging around code that assumes it isn't present.
2023-02-26 12:18:06 -06:00
somebody
5e3b0062ee Model: Tokenizer fix 2023-02-26 12:17:49 -06:00
somebody
8d49b5cce1 Model: More TPU stuff 2023-02-26 12:09:26 -06:00