rixty/KoboldAI-Client
1
1
Fork 0
mirror of https://github.com/KoboldAI/KoboldAI-Client.git synced 2025-06-05 21:59:24 +02:00
Code Issues Projects Releases Wiki Activity
3,969 Commits 1 Branch 5 Tags
a87d5d6f2360d192e23d9d7f76b9bd03ee02bcfd
Commit Graph

3969 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
somebody
27b7635c95 Model: Fix TPU 2023-03-04 19:02:00 -06:00
Henk
1c891181e9 Remove old worker API 2023-03-04 18:27:02 +01:00
Henk
59e1f74f7c Enable BMS API again under a new name 2023-03-04 14:17:47 +01:00
henk717
aa558da49c Merge pull request #297 from aibosan/united-singleline-stopper 
Created SinglelineStopper...
 2023-03-02 20:51:54 +01:00
henk717
99e40ce8e8 Merge pull request #276 from LightSaveUs/united 
Restoring the Effect (of the presets)
 2023-03-02 20:44:05 +01:00
Henk
f03b538cab Remote no longer unblocks the port by default 2023-03-02 17:43:23 +01:00
Ondřej Benda
aa124b65db Fix: incorrect newline evaluation 2023-03-02 08:22:31 +01:00
somebody
f2974d205e RWKV: Remove old gnarly (in a bad way) RWKV4 support 
Better interface for it coming soon
 2023-03-01 19:26:55 -06:00
somebody
54cecd4d5d Model: And another refactor 2023-03-01 19:16:35 -06:00
Ondřej Benda
0ba7ac96d3 Created SinglelineStopper, which interrupts token generation when a newline is reached if singleline mode is enabled 2023-03-02 00:04:17 +01:00
henk717
142cb354f9 Nerybus 13B - TPU colab 2023-03-01 22:33:11 +01:00
Henk
93bf023bd7 Use our own horde URL 2023-03-01 17:54:39 +01:00
henk717
750cc3d2dc Merge pull request #245 from db0/kaimergemain2 
Makes prod version of KAI work with merged hordes in stablehorde.net
 2023-03-01 17:52:58 +01:00
somebody
225dcf1a0a Model: Documentation part 1 2023-02-28 20:10:09 -06:00
somebody
ef1155291f Model: TPU Fixes 2023-02-28 18:05:34 -06:00
somebody
bd3bbdaad8 Model: More tpu fixes 2023-02-27 19:29:03 -06:00
somebody
45cd6b5de2 Model: Don't do breakmodel on colab 2023-02-27 19:24:41 -06:00
somebody
ed83362dee Model: TPU should be ready for testing 2023-02-27 19:08:44 -06:00
somebody
1839de1483 colab debug 2023-02-27 18:40:26 -06:00
somebody
2e3ca6f769 Model: Bugfixes/fix tokenizer hack 2023-02-27 18:30:13 -06:00
Henk
9265be58e9 Modeldir Fixes 2023-02-27 17:52:06 +01:00
Henk
0e06fc371f Modeldir Fix 2023-02-27 17:46:33 +01:00
Llama
3b35f15339 Merge pull request #23 from henk717/united 
Merge united
 2023-02-26 23:01:07 -08:00
somebody
af73527be0 Samplers: Part 2 2023-02-26 17:22:54 -06:00
somebody
f882979c88 Model: Samplers pt. 1 2023-02-26 16:09:22 -06:00
somebody
f771ae38cf Model: Formatting fixes 2023-02-26 14:14:29 -06:00
somebody
10842e964b Get rid of yet another instance of this identical class 2023-02-26 14:02:15 -06:00
somebody
e8236bffbf Model: Fixup horde bug 2023-02-26 13:36:06 -06:00
somebody
15f957260f Model: Add rep pen for OAI API 2023-02-26 13:35:54 -06:00
somebody
35bbd78326 Model: Monkey release detection fix 2023-02-26 13:35:29 -06:00
somebody
b99c16f562 Merge branch 'united' of https://github.com/henk717/KoboldAI into model-structure-and-maybe-rwkv 2023-02-26 13:06:30 -06:00
somebody
56bcd32f6d Model: Fix ReadOnly 
whoops
 2023-02-26 12:40:20 -06:00
somebody
a73804ca1e Accelerate: Remove HAS_ACCELERATE 
Accelerate has been a dependency for a while, and as such we probably
shouldn't be lugging around code that assumes it isn't present.
 2023-02-26 12:18:06 -06:00
somebody
5e3b0062ee Model: Tokenizer fix 2023-02-26 12:17:49 -06:00
somebody
8d49b5cce1 Model: More TPU stuff 2023-02-26 12:09:26 -06:00
Henk
cdfc7326e6 Horde API Setting Consolidation 2023-02-26 17:59:36 +01:00
henk717
642d173579 Merge pull request #294 from db0/kaimerge 
Changes to work with the merged hordes
 2023-02-26 16:00:48 +01:00
Llama
5dff860147 Merge pull request #22 from henk717/united 
Merge united
 2023-02-25 21:19:46 -08:00
somebody
d53d2bcc45 Model: Fix crash on full GPU load 2023-02-25 18:19:46 -06:00
somebody
465e22fa5c Model Fix bugs and introduce hack for visualization 
Hopefully I remove that attrocity before the PR
 2023-02-25 18:12:49 -06:00
somebody
ffe4f25349 Model: Work on stoppers and stuff 2023-02-25 17:12:16 -06:00
somebody
6b4905de30 Model: Port rest of models over 
Generation's still broke but it's a start
 2023-02-25 16:05:56 -06:00
Henk
165c7219eb Frequency Penalty for OAI 2023-02-25 22:15:05 +01:00
Henk
526e8ab9b1 More Horde setting fixing 2023-02-25 16:20:49 +01:00
Henk
29ceac6d43 Horde parameter fixes 2023-02-25 16:01:11 +01:00
henk717
1e6e1aaa18 Merge branch 'KoboldAI:main' into united 2023-02-25 14:59:42 +01:00
Henk
b49070e3ed Updated bridge for the new horde 2023-02-25 14:58:18 +01:00
somebody
f8c4158ebc Model: Successful load implementation 
The goal of this series of commits is to have an implementation-agnostic
interface for models, thus being less reliant on HF Transformers for model
support. A model object will have a method for generation, a list of callbacks
to be run on every token generation, a list of samplers that will modify
probabilities, etc. Basically anything HF can do should be easily
implementable with the new interface :^)

Currently I've tested the loading of pre-downloaded models with
breakmodel between GPUs and that works, though essentially no testing
has been done in the larger scheme of things. Currently this is about
the only supported configuration, and generation isn't very functional.
 2023-02-24 21:41:44 -06:00
Llama
d36ab50758 Merge pull request #21 from henk717/united 
Merge united
 2023-02-24 15:50:04 -08:00
Divided by Zer0
6426e3ca24 changes 2023-02-23 18:34:46 +01:00