Commit Graph

4725 Commits

Author SHA1 Message Date
henk717
9a50bf3fd6 Merge branch 'KoboldAI:main' into united 2023-10-16 21:23:54 +02:00
henk717
58b4c48fdb Disable GPTQ for now to enable higher context 2023-10-16 21:23:27 +02:00
henk717
18537c7d23 Merge branch 'KoboldAI:main' into united 2023-10-16 11:31:22 +02:00
Henk
80f96d5bc0 Allow # due to request for this 2023-10-14 23:23:18 +02:00
Henk
829ea147fc Undo broken samplers 2023-10-14 20:38:35 +02:00
Henk
e3a43eef15 API and sampler setting fixes 2023-10-14 19:45:23 +02:00
henk717
009c48ab10 Merge pull request #475 from StefanGliga/united
Add epsilon and eta sampling
2023-10-14 18:07:37 +02:00
henk717
f1f6230ba0 Merge pull request #473 from ebolam/united
Abort code moved to model classes
2023-10-14 15:59:13 +02:00
henk717
c2246994f8 Merge pull request #479 from FunkEngine2023/united
Typo.
2023-10-14 14:53:57 +02:00
FunkEngine
2946231ccb Merge branch 'henk717:united' into united 2023-10-14 04:42:28 -04:00
FunkEngine
8f411f04be Merge pull request #1 from FunkEngine2023/FunkEngine
Typo.
2023-10-14 04:41:35 -04:00
FunkEngine
f7bd00afda Typo.
Minor.
2023-10-14 04:38:47 -04:00
henk717
bf61e5ef02 Emerhyst 2023-10-09 05:06:26 +02:00
ebolam
9501dd34ea Fix for aiserver asking horde for model list on start of koboldai. This meant that every run of KoboldAI resulted in horde being effectively notified 2023-10-06 09:24:59 -04:00
Henk
e9d3a4c269 Merge branch 'main' into united 2023-10-06 13:54:46 +02:00
Henk
386fd1f034 Werkzeug Fix 2023-10-06 13:51:52 +02:00
henk717
6e4f15f923 Merge pull request #478 from LostRuins/concedo_united_PR
Update Kobold Lite to v76
2023-10-06 13:28:32 +02:00
Concedo
20ba89a3d9 Merge branch 'concedo_united_PR' of https://github.com/LostRuins/KoboldAI into concedo_united_PR 2023-10-06 16:00:42 +08:00
Concedo
05f79860fe Update Kobold Lite to v76 2023-10-06 16:00:07 +08:00
henk717
1ba20518fc Merge pull request #477 from Disty0/united
IPEX Optimizations
2023-10-04 00:34:37 +02:00
Disty0
5a3986fb06 IPEX Optimizations 2023-10-04 01:32:36 +03:00
Henk
caa040b416 HF 4.34 part 2 2023-10-04 00:21:32 +02:00
Henk
02d3b00ff1 HF 4.34 2023-10-04 00:18:21 +02:00
Stefan Gligorijevic
05cc14f561 Add epsilon and eta sampling 2023-09-29 20:43:33 +02:00
Henk
b141ee0155 Universal downloader for more backends 2023-09-28 18:01:34 +02:00
Henk
fa8d9e65ff Fix flash-attn 2023-09-28 09:51:09 +02:00
Henk
e238a1c9f6 Ship exllamav2 2023-09-28 09:09:04 +02:00
Henk
04cc322d7c New dependencies 2023-09-28 03:24:01 +02:00
Henk
e99789a51b Flash Attention (Linux) 2023-09-28 03:19:03 +02:00
Henk
6fdf83aad5 Basic Exllama2 2023-09-28 01:48:38 +02:00
Henk
9e51a50bcd Llama fixes for Mistral 2023-09-28 01:08:53 +02:00
ebolam
380adeae43 Abort UI enhancement for Horde 2023-09-27 17:25:57 -04:00
ebolam
ac0f627616 Implemented abort function in model classes.
Horde stopper not working properly
2023-09-27 12:43:42 -04:00
henk717
2f3b24eba7 Merge pull request #472 from LostRuins/concedo_united_PR
updated lite to v70
2023-09-24 17:15:22 +02:00
Concedo
90959c3dcf updated lite to v70 2023-09-24 23:01:35 +08:00
henk717
80f34cb2e8 Merge pull request #471 from nkpz/patch-2
[gptq_hf_torch] Fix typo in model type check
2023-09-23 11:26:06 +02:00
Nick Perez
d8877b642d [gptq_hf_torch] Fix typo in model type check
`model_tseype` -> `model_type`
2023-09-23 00:53:48 -04:00
henk717
db5ff9e748 Merge pull request #470 from LostRuins/concedo_united_PR
updated kobold lite to v66
2023-09-20 15:01:47 +02:00
Concedo
55251c6b8e updated kobold lite to v66 2023-09-20 20:30:30 +08:00
henk717
34919eaf88 Merge pull request #468 from Disty0/united
GPTQ support for IPEX
2023-09-19 16:14:00 +02:00
Disty0
806fc4b8ad GPTQ support for IPEX 2023-09-19 17:09:51 +03:00
henk717
9e49d7bc3c Merge pull request #466 from LostRuins/concedo_united_PR
Updated Kobold Lite to v63
2023-09-17 04:11:32 +02:00
Henk
613b02e6f8 Worker main branch 2023-09-16 15:56:44 +02:00
Henk
d36049f56f Newer Horde Worker 2023-09-16 06:30:35 +02:00
Henk
fd87ebdb66 Horde length passtrough 2023-09-16 06:25:12 +02:00
Concedo
83c74e12f8 Updated Kobold Lite to v63. You may want to wait a day or two to confirm its stable before merging 2023-09-15 17:00:40 +08:00
henk717
498824f4dc Merge pull request #465 from Disty0/united
IPEX fix diffusers 0.21 lazy load
2023-09-14 15:05:11 +02:00
Disty0
79d6e1d6a0 IPEX fix diffusers 0.21 lazy load 2023-09-14 15:57:31 +03:00
Henk
83ac6ce3fc Fix backend option 2023-09-11 14:21:44 +02:00
Henk
96bc0848d6 Add multiple backend support 2023-09-11 14:15:18 +02:00