henk717
750cc3d2dc
Merge pull request #245 from db0/kaimergemain2
...
Makes prod version of KAI work with merged hordes in stablehorde.net
2023-03-01 17:52:58 +01:00
somebody
225dcf1a0a
Model: Documentation part 1
2023-02-28 20:10:09 -06:00
somebody
ef1155291f
Model: TPU Fixes
2023-02-28 18:05:34 -06:00
somebody
bd3bbdaad8
Model: More tpu fixes
2023-02-27 19:29:03 -06:00
somebody
45cd6b5de2
Model: Don't do breakmodel on colab
2023-02-27 19:24:41 -06:00
somebody
ed83362dee
Model: TPU should be ready for testing
2023-02-27 19:08:44 -06:00
somebody
1839de1483
colab debug
2023-02-27 18:40:26 -06:00
somebody
2e3ca6f769
Model: Bugfixes/fix tokenizer hack
2023-02-27 18:30:13 -06:00
Henk
9265be58e9
Modeldir Fixes
2023-02-27 17:52:06 +01:00
Henk
0e06fc371f
Modeldir Fix
2023-02-27 17:46:33 +01:00
Llama
3b35f15339
Merge pull request #23 from henk717/united
...
Merge united
2023-02-26 23:01:07 -08:00
somebody
af73527be0
Samplers: Part 2
2023-02-26 17:22:54 -06:00
somebody
f882979c88
Model: Samplers pt. 1
2023-02-26 16:09:22 -06:00
somebody
f771ae38cf
Model: Formatting fixes
2023-02-26 14:14:29 -06:00
somebody
10842e964b
Get rid of yet another instance of this identical class
2023-02-26 14:02:15 -06:00
somebody
e8236bffbf
Model: Fixup horde bug
2023-02-26 13:36:06 -06:00
somebody
15f957260f
Model: Add rep pen for OAI API
2023-02-26 13:35:54 -06:00
somebody
35bbd78326
Model: Monkey release detection fix
2023-02-26 13:35:29 -06:00
somebody
b99c16f562
Merge branch 'united' of https://github.com/henk717/KoboldAI into model-structure-and-maybe-rwkv
2023-02-26 13:06:30 -06:00
somebody
56bcd32f6d
Model: Fix ReadOnly
...
whoops
2023-02-26 12:40:20 -06:00
somebody
a73804ca1e
Accelerate: Remove HAS_ACCELERATE
...
Accelerate has been a dependency for a while, and as such we probably
shouldn't be lugging around code that assumes it isn't present.
2023-02-26 12:18:06 -06:00
somebody
5e3b0062ee
Model: Tokenizer fix
2023-02-26 12:17:49 -06:00
somebody
8d49b5cce1
Model: More TPU stuff
2023-02-26 12:09:26 -06:00
Henk
cdfc7326e6
Horde API Setting Consolidation
2023-02-26 17:59:36 +01:00
henk717
642d173579
Merge pull request #294 from db0/kaimerge
...
Changes to work with the merged hordes
2023-02-26 16:00:48 +01:00
Llama
5dff860147
Merge pull request #22 from henk717/united
...
Merge united
2023-02-25 21:19:46 -08:00
somebody
d53d2bcc45
Model: Fix crash on full GPU load
2023-02-25 18:19:46 -06:00
somebody
465e22fa5c
Model Fix bugs and introduce hack for visualization
...
Hopefully I remove that attrocity before the PR
2023-02-25 18:12:49 -06:00
somebody
ffe4f25349
Model: Work on stoppers and stuff
2023-02-25 17:12:16 -06:00
somebody
6b4905de30
Model: Port rest of models over
...
Generation's still broke but it's a start
2023-02-25 16:05:56 -06:00
Henk
165c7219eb
Frequency Penalty for OAI
2023-02-25 22:15:05 +01:00
Henk
526e8ab9b1
More Horde setting fixing
2023-02-25 16:20:49 +01:00
Henk
29ceac6d43
Horde parameter fixes
2023-02-25 16:01:11 +01:00
henk717
1e6e1aaa18
Merge branch 'KoboldAI:main' into united
2023-02-25 14:59:42 +01:00
Henk
b49070e3ed
Updated bridge for the new horde
2023-02-25 14:58:18 +01:00
somebody
f8c4158ebc
Model: Successful load implementation
...
The goal of this series of commits is to have an implementation-agnostic
interface for models, thus being less reliant on HF Transformers for model
support. A model object will have a method for generation, a list of callbacks
to be run on every token generation, a list of samplers that will modify
probabilities, etc. Basically anything HF can do should be easily
implementable with the new interface :^)
Currently I've tested the loading of pre-downloaded models with
breakmodel between GPUs and that works, though essentially no testing
has been done in the larger scheme of things. Currently this is about
the only supported configuration, and generation isn't very functional.
2023-02-24 21:41:44 -06:00
Llama
d36ab50758
Merge pull request #21 from henk717/united
...
Merge united
2023-02-24 15:50:04 -08:00
Divided by Zer0
6426e3ca24
changes
2023-02-23 18:34:46 +01:00
Divided by Zer0
2de9672b95
attempt1
2023-02-23 18:27:11 +01:00
Divided by Zer0
d459bdb1c0
adjust
2023-02-22 23:12:34 +01:00
henk717
0e7b2c1ba1
Merge pull request #293 from jojorne/jojorne-patch-save-load-story-with-UTF-8-encoding
...
Save/Load Story with UTF-8 encoding.
2023-02-22 19:59:33 +01:00
jojorne
d3bedfcbda
Include koboldai_vars.save_story().
2023-02-22 15:42:56 -03:00
jojorne
d6c9f5f1f5
Save/Load Story with UTF-8 encoding.
2023-02-22 14:40:42 -03:00
henk717
72135f7156
Merge pull request #292 from YellowRoseCx/united
...
updates PyTorch to allow AMD gpu splitting
2023-02-21 01:52:46 +01:00
YellowRoseCx
83bd1f0db6
updates PyTorch to allow AMD gpu splitting
...
Feature adding update for AMD GPUs:
Changes the installed PyTorch version from 1.12.1+rocm5.1.1 to the newer stable version 1.13.1+rocm5.2 to allow AMD GPUs to utilize VRAM splitting across multiple GPUs
2023-02-20 18:40:21 -06:00
henk717
c27faf56e6
Updated Silence Audio - GPU
2023-02-20 18:43:06 +01:00
henk717
5962a6cb4f
Updated Audio Link - TPU
2023-02-20 18:41:06 +01:00
Henk
1378fe8beb
Silence file for colab
2023-02-20 18:28:58 +01:00
Llama
0f50e9c885
Merge pull request #20 from henk717/united
...
Merge united
2023-02-20 00:25:11 -08:00
Henk
b3083034ea
UI2 Botname
2023-02-19 17:12:14 +01:00
