Commit Graph

3967 Commits

Author SHA1 Message Date
0cc4m
9c3d578d6c Work on model download support 2023-05-02 21:32:20 +02:00
0cc4m
f83a0aa122 Merge latest changes, fix conflict 2023-05-01 08:01:54 +02:00
0cc4m
aa67135d42 Implement new model format
Remove 4bit toggle
2023-04-30 21:59:22 +02:00
0cc4m
20a5587d66 Always use offloader script, because it speeds up multi gpu 2023-04-30 18:17:43 +02:00
somebody
bfef79d2b8 Dynamic Fix 2023-04-28 18:55:38 -05:00
one-some
455b8257a9 Implement softprompt hack 2023-04-28 10:26:59 -05:00
one-some
fa6bb4b956 Potential fix for tpu dynamic 2023-04-28 10:17:48 -05:00
one-some
19817a271b More colab 2023-04-28 10:16:15 -05:00
one-some
b3614b64b1 Hello Colab 2023-04-28 10:10:26 -05:00
somebody
ace4364339 Two more time 2023-04-27 21:13:26 -05:00
somebody
446f38ee9d One more time 2023-04-27 21:07:34 -05:00
somebody
2eee535540 Actually fix decoding with soft prompts
it really wants a tensor
2023-04-27 21:01:12 -05:00
somebody
ffa7b22734 Experiment 2023-04-27 20:28:04 -05:00
somebody
cd1eb97c2a Debuuuug 2023-04-27 20:12:29 -05:00
somebody
4559112551 Potential fix 2023-04-27 19:51:10 -05:00
somebody
b256a8fbc7 Debug 2023-04-27 19:33:03 -05:00
0cc4m
d8949042d4 Merge latestgptq branch changes 2023-04-27 19:12:29 +02:00
one-some
f9d162c001 Cut out things until it works 2023-04-27 10:10:17 -05:00
0cc4m
18ac5dfce6 Update to Pytorch 1.13.1 and CUDA 11.7 2023-04-27 16:04:30 +02:00
0cc4m
aedb6388c5 Update README, remove experimental UI 2023-04-27 07:05:11 +02:00
0cc4m
99c4c3bae4 Show 4-bit toggle without experimental ui 2023-04-27 07:03:44 +02:00
0cc4m
05e2b52a1a Merge upstream changes, fix conflict 2023-04-27 06:50:05 +02:00
onesome
467f2f25eb More loading fixes 2023-04-26 16:58:33 -05:00
onesome
d4f7b60dc9 Fix for multiple paths 2023-04-26 16:49:12 -05:00
onesome
6776a71532 Add more info to custom model error 2023-04-26 16:36:52 -05:00
onesome
bbf4963d6e Fix custmodpth stuff for hf loading 2023-04-26 16:18:45 -05:00
onesome
c146ae9d84 Delete legacy gpt2 custom loader 2023-04-26 16:07:18 -05:00
Henk
55625e5cde Linux Isolation 2023-04-26 19:31:20 +02:00
onesome
9579298df7 Better fallback 2023-04-25 22:28:07 -05:00
onesome
6e3aebc1ea Zap debug 2023-04-25 21:13:17 -05:00
onesome
d496e861f4 Undo pretty code because I haven't cracked the jax enigma yet 2023-04-25 21:11:49 -05:00
onesome
1db9d9ba61 Lazyload: Whoops 2023-04-25 18:46:54 -05:00
onesome
e28e268a2d Use safetensors only when available 2023-04-25 18:32:37 -05:00
onesome
0268305cfe Change fallback notifications to warnings 2023-04-25 18:26:49 -05:00
onesome
98cd6aa246 Make RWKV experimental 2023-04-25 17:13:06 -05:00
onesome
b8bef641ff Merge branch 'united' of https://github.com/henk717/KoboldAI into model-structure-and-maybe-rwkv 2023-04-25 16:54:53 -05:00
Henk
9eaa2aba47 Isolate OPT Tokenizer Fix to OPT models 2023-04-25 22:49:56 +02:00
0cc4m
cd289a9478 Use custom pip repo for wheels instead of modifying install_requirements scripts 2023-04-25 19:06:25 +02:00
0cc4m
b58e5f353f Add wheel links file for pip 2023-04-25 18:56:25 +02:00
nerodiafasciata
8d61d6b04a install instruction update: don't run as admin (#12)
* Update README.md

Added note to tell windows users not to install as admin
2023-04-25 07:25:28 +02:00
Henk
560c8d23fb Re-add UI Json Fix 2023-04-23 21:37:24 +02:00
Henk
b8cd5f4c03 Revert "Added comregex_ui and comregex_ai to the UI under other settings. Needs proper titles and descriptions still."
This reverts commit d16a3f4dc3.
2023-04-23 21:35:24 +02:00
Henk
1c36eb9f2c Further Isolation 2023-04-23 21:24:17 +02:00
Henk
83beac4162 Merge branch 'main' into united 2023-04-23 21:16:24 +02:00
henk717
b808f039ab Pin TPU driver 2023-04-23 20:21:28 +02:00
henk717
d88f109073 TPU Fix Fix 2023-04-23 18:49:25 +02:00
henk717
b4cb09590f Update requirements_mtj.txt 2023-04-23 18:23:38 +02:00
henk717
5f0e2001a7 Remove broken TPU disclaimer 2023-04-23 17:50:03 +02:00
henk717
dddde7dbc3 Merge pull request #306 from Zurnaz/tpu_fix
Fix: TPU driver error
2023-04-23 12:32:14 +02:00
Bogdan Drema
92a0bf9524 Fix: TPU driver error
to_dlpack/from_dlpack was causing issues with tensor with new jax version
2023-04-23 00:49:42 +01:00