rixty/KoboldAI-Client
1
1
Fork 0
mirror of https://github.com/KoboldAI/KoboldAI-Client.git synced 2025-06-05 21:59:24 +02:00
Code Issues Projects Releases Wiki Activity
3,739 Commits 1 Branch 5 Tags
2e7a8a1a66a3813ff2f68b5e37f659479f44afc2
Commit Graph

3739 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
0cc4m
2e7a8a1a66 Adapt KoboldAI to latest gptq changes 2023-03-27 04:48:21 +00:00
0cc4m
9dcba38978 Pin transformers to a working Llama-compatible version 2023-03-24 19:07:28 +00:00
0cc4m
026eb3205e Fix 4-bit loading error when not loading in 4-bit 2023-03-22 22:12:06 +00:00
0cc4m
8941428c66 Fix Kobold loading to CPU in 4-bit, causing CUDA ASSERT error 2023-03-22 06:22:34 +00:00
0cc4m
c7edc764b9 Fix llama loading 2023-03-21 21:58:31 +00:00
0cc4m
ecd065a881 Overhaul 4-bit support to load with a toggle 2023-03-21 21:40:59 +00:00
0cc4m
4cfc1219d4 Add gptq as submodule 2023-03-20 19:13:46 +00:00
0cc4m
3b7505dc28 Merge remote-tracking branch 'united/united' into 4bit 2023-03-20 19:06:40 +00:00
0cc4m
858657f669 Fix zipfile folder identification fix for Windows 2023-03-20 09:16:30 +01:00
0cc4m
60acf59316 Improve 4-bit llama support, add 4-bit gptj and gptneox support 2023-03-19 21:20:13 +00:00
Henk
90a7eb6153 LLama tokenizer settings 2023-03-17 12:40:08 +01:00
Henk
1235b71bb5 Merge branch 'main' into united 2023-03-17 01:48:10 +01:00
Henk
219b824b9b SocketIO Requirements Pin 2023-03-17 01:28:59 +01:00
henk717
86c87b23c0 Merge branch 'KoboldAI:main' into united 2023-03-17 01:17:58 +01:00
0cc4m
5d17692c79 Remove except Exception so that errors actually show up 2023-03-16 05:24:58 +00:00
YellowRoseCx
b3b454bbe4 Update huggingface.yml 2023-03-15 00:03:43 -05:00
YellowRoseCx
bf677a32f6 Merge remote-tracking branch 'catboxanon/test/4bit' into yr4bit 2023-03-14 17:09:06 -05:00
YellowRoseCx
2909910bcc Merge branch 'henk717:united' into dev-yr 2023-03-14 17:04:33 -05:00
henk717
db7b53f52d Merge pull request #310 from nkpz/united 
Fix out of range error after editing actions
 2023-03-14 01:22:14 +01:00
catboxanon
5f3770bb58 Merge branch 'henk717:united' into test/4bit 2023-03-13 19:34:17 -04:00
henk717
5249045c35 Merge pull request #304 from YellowRoseCx/united-yr 
added local rng_states variable and fixed minor typo
 2023-03-13 22:46:00 +01:00
henk717
c96e96f95e Merge pull request #307 from jojorne/jojorne-patch-fix-save-loading-with-wi-features 
Fix save loading between v1 and v2 to v3 with wi features
 2023-03-13 21:40:11 +01:00
Henk
8da04a98a4 Better Runtime Isolation 2023-03-13 18:41:25 +01:00
Nick Perez
0dce4c700f Just reverse the range 2023-03-13 07:00:51 -04:00
Nick Perez
b4b24f1389 Fix out of range after deletion in for loop 2023-03-13 06:21:25 -04:00
jojorne
4b8d4cde7d fix spacing 2023-03-12 20:41:34 -03:00
jojorne
4219e3e8d3 Removing the root folder is not supported 2023-03-12 20:38:58 -03:00
jojorne
e5c1b0506a Renaming the root folder is not supported 2023-03-12 20:05:40 -03:00
catboxanon
bde31217f1 improve model None check 2023-03-11 12:15:58 -05:00
catboxanon
1808b0d2ec Another safety check for if model is not loaded 2023-03-11 12:13:22 -05:00
jojorne
53f06903c2 revert more unrelated code 2023-03-11 13:54:01 -03:00
jojorne
c87ef60db1 revert more unrelated code 2023-03-11 13:48:41 -03:00
jojorne
e4ad8547a7 revert unrelated code 2023-03-11 13:39:19 -03:00
jojorne
47242e9abe remove debug code 2023-03-11 13:21:22 -03:00
jojorne
423c022648 Fix save loading between v1 and v2 to v3 with wi features 2023-03-11 13:14:46 -03:00
YellowRoseCx
cde74ff94d Merge branch 'henk717:united' into dev-yr 2023-03-10 12:39:49 -06:00
YellowRoseCx
5bc862df56 Merge branch 'henk717:united' into united-yr 2023-03-10 12:39:36 -06:00
catboxanon
3f132ce45b Notify if LLAMA_4BIT env var not set 2023-03-10 03:26:09 -05:00
catboxanon
dcf9d37a00 It just works. 2023-03-10 00:01:40 -05:00
catboxanon
8c9ed55406 Update aiserver.py 2023-03-09 22:36:45 -05:00
henk717
f761c4dafa Merge pull request #305 from SillyLossy/united 
Fix setting softprompt via V1 API
 2023-03-09 13:03:14 +01:00
SillyLossy
0d1771501f Fix setting softprompt via V1 API 2023-03-09 13:15:50 +02:00
YellowRoseCx
c5607110ee typo fix 
fixed typo of "specfic" to "specific"
 2023-03-08 15:36:30 -06:00
YellowRoseCx
4371de2c11 added rng_states variable 
added rng_states variable to fix an error caused by passing a seed through the API without having a seed already in use
 2023-03-08 15:35:55 -06:00
henk717
ffa5c0bc13 Empty Revision Fix 2023-03-08 20:52:03 +01:00
henk717
487739911a Restore Pygmalion 6B Dev 2023-03-08 18:44:03 +01:00
Henk
da70e8e220 Merge branch 'main' into united 2023-03-08 18:09:22 +01:00
Henk
2ed6cdb411 Huggingface Hub Pin 2023-03-08 18:03:36 +01:00
henk717
b307cdff57 Merge pull request #301 from jojorne/jojorne-patch-use-str-for-wi-keys 
Access WI uid keys with str
 2023-03-06 21:15:44 +01:00
Henk
099c818c06 Experimental unbanning of <> 2023-03-06 20:56:15 +01:00