rixty/KoboldAI-Client
1
1
Fork 0
mirror of https://github.com/KoboldAI/KoboldAI-Client.git synced 2025-06-05 21:59:24 +02:00
Code Issues Projects Releases Wiki Activity
3,938 Commits 1 Branch 5 Tags
20a5587d660f651f108762ec99faf357a678285d
Commit Graph

3938 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
0cc4m
20a5587d66 Always use offloader script, because it speeds up multi gpu 2023-04-30 18:17:43 +02:00
0cc4m
d8949042d4 Merge latestgptq branch changes 2023-04-27 19:12:29 +02:00
0cc4m
18ac5dfce6 Update to Pytorch 1.13.1 and CUDA 11.7 2023-04-27 16:04:30 +02:00
0cc4m
aedb6388c5 Update README, remove experimental UI 2023-04-27 07:05:11 +02:00
0cc4m
99c4c3bae4 Show 4-bit toggle without experimental ui 2023-04-27 07:03:44 +02:00
0cc4m
05e2b52a1a Merge upstream changes, fix conflict 2023-04-27 06:50:05 +02:00
Henk
55625e5cde Linux Isolation 2023-04-26 19:31:20 +02:00
Henk
9eaa2aba47 Isolate OPT Tokenizer Fix to OPT models 2023-04-25 22:49:56 +02:00
0cc4m
cd289a9478 Use custom pip repo for wheels instead of modifying install_requirements scripts 2023-04-25 19:06:25 +02:00
0cc4m
b58e5f353f Add wheel links file for pip 2023-04-25 18:56:25 +02:00
nerodiafasciata
8d61d6b04a install instruction update: don't run as admin (#12) 
* Update README.md

Added note to tell windows users not to install as admin
 2023-04-25 07:25:28 +02:00
Henk
560c8d23fb Re-add UI Json Fix 2023-04-23 21:37:24 +02:00
Henk
b8cd5f4c03 Revert "Added comregex_ui and comregex_ai to the UI under other settings. Needs proper titles and descriptions still." 
This reverts commit d16a3f4dc3.
 2023-04-23 21:35:24 +02:00
Henk
1c36eb9f2c Further Isolation 2023-04-23 21:24:17 +02:00
Henk
83beac4162 Merge branch 'main' into united 2023-04-23 21:16:24 +02:00
henk717
b808f039ab Pin TPU driver 2023-04-23 20:21:28 +02:00
henk717
d88f109073 TPU Fix Fix 2023-04-23 18:49:25 +02:00
henk717
b4cb09590f Update requirements_mtj.txt 2023-04-23 18:23:38 +02:00
henk717
5f0e2001a7 Remove broken TPU disclaimer 2023-04-23 17:50:03 +02:00
henk717
dddde7dbc3 Merge pull request #306 from Zurnaz/tpu_fix 
Fix: TPU driver error
 2023-04-23 12:32:14 +02:00
Bogdan Drema
92a0bf9524 Fix: TPU driver error 
to_dlpack/from_dlpack was causing issues with tensor with new jax version
 2023-04-23 00:49:42 +01:00
henk717
8f44141f96 Pin driver to the one from JAX 0.3.25 2023-04-23 01:43:37 +02:00
henk717
df0ab18696 Merge pull request #335 from Zurnaz/tpu_driver_fix 
Fix: TPU driver error
 2023-04-23 01:31:55 +02:00
Bogdan Drema
4502a3f6b8 Fix: TPU driver error 
to_dlpack/from_dlpack was causing issues with tensor with new jax version
 2023-04-22 22:31:21 +01:00
henk717
e4c15fe1f6 Update install_requirements.sh 2023-04-21 03:00:52 +02:00
henk717
b432d55d99 Merge pull request #291 from Relys/patch-1 
Update install_requirements.sh
 2023-04-20 14:03:35 +02:00
0cc4m
934571857b Fix offloading 2023-04-18 22:52:54 +02:00
henk717
ee6e7e9b72 Colab description changes 2023-04-17 22:59:55 +02:00
nerodiafasciata
10c99a853c Added AMD instructions, added formatting 
Added AMD install instructions
Formatted the install/run section for improved readability
 2023-04-17 21:26:58 +02:00
0cc4m
12699aa229 Show 4-bit toggle without experimental ui 2023-04-17 07:26:03 +02:00
0cc4m
1ef515f4c2 Fix lazy-loading on 4-bit 2023-04-17 07:21:18 +02:00
henk717
5ae3c562fb Merge pull request #331 from ebolam/Upload_Fix 
Fix for uploading files in UI2
 2023-04-17 03:56:41 +02:00
ebolam
d16a3f4dc3 Added comregex_ui and comregex_ai to the UI under other settings. Needs proper titles and descriptions still. 2023-04-16 21:02:42 -04:00
ebolam
a34ce85d21 Fix for UI1 remote mode file loading from browser 2023-04-16 20:43:03 -04:00
ebolam
fcba26f631 Fix for uploading files in UI2 2023-04-16 20:32:51 -04:00
Henk
2926dac72b Don't print allowed_ips if unused 2023-04-16 23:59:13 +02:00
0cc4m
ded5542d3a Fix error in 4bit offloading initialization code when running with --nobreakmodel 2023-04-16 21:11:35 +02:00
Henk
b1d3a37fb0 <|comments|> now are [<|comments|>] to support OA 2023-04-16 19:31:17 +02:00
0cc4m
4d34f9b7de Move 4-bit loading code to separate inference_model file 2023-04-16 14:20:13 +02:00
0cc4m
05b1d36803 Merge latestgptq branch onto one-some's model-structure-and-maybe-rwkv branch 2023-04-16 09:06:12 +02:00
somebody
f9fb5eba89 Remove debug 2023-04-15 18:56:49 -05:00
somebody
5dd67d027a Workaround for socketio context errors for loading 2023-04-15 18:54:21 -05:00
somebody
08b4e317ff Fix double slashing 2023-04-15 13:30:05 -05:00
somebody
d3a73aaeba Fix api 2023-04-15 13:17:20 -05:00
somebody
4dcf570407 Fix legacy model loading 2023-04-15 12:57:35 -05:00
Syler Clayton
860b697a70 Update install_requirements.sh 
Made parameter case insensitive.
 2023-04-15 09:51:45 -07:00
somebody
2a977feb3e Merge branch 'model-structure-and-maybe-rwkv' of https://github.com/one-some/KoboldAI into model-structure-and-maybe-rwkv 2023-04-15 11:51:39 -05:00
somebody
a2ae87d1b7 Utils: Support safetensors aria2 download 2023-04-15 11:51:16 -05:00
0cc4m
fff2385173 Merge upstream changes 2023-04-15 18:35:54 +02:00
Henk
b68860b3de Workaround to make --host work again 2023-04-15 18:31:39 +02:00