rixty/KoboldAI-Client
1
1
Fork 0
mirror of https://github.com/KoboldAI/KoboldAI-Client.git synced 2025-06-05 21:59:24 +02:00
Code Issues Projects Releases Wiki Activity
4,169 Commits 1 Branch 5 Tags
6f7e6422ef5fd038a561ab28b9c49f8d6289001f
Commit Graph

4169 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
somebody
6f7e6422ef Actually get correct primary device 2023-07-03 19:04:48 -05:00
somebody
59c731f805 Fix static primary_device 
and some small cleanup
 2023-07-03 18:37:48 -05:00
somebody
32917fd651 Remove unused file open 2023-07-03 17:51:54 -05:00
somebody
7f869a54d8 Just use accelerate on tpu 2023-07-03 17:18:48 -05:00
somebody
1bb2d2621c Make TPU in line with new lazyload behavior 2023-07-03 17:12:07 -05:00
somebody
31a3046a18 Load empty modules without accelerate 2023-07-03 17:07:18 -05:00
somebody
686c3d1592 Don't patch lazyload on TPU 2023-07-03 16:52:18 -05:00
one-some
39049e8a46 Merge pull request #20 from henk7171/accelerate-offloading 
Accelerate offloading fixes
 2023-07-03 16:06:20 -04:00
Henk
062e3ed27c Torch bump 2023-07-02 23:19:20 +02:00
Henk
4a45a0e551 Fix bar spam 2023-07-02 23:02:02 +02:00
Henk
51c4622694 Hide all Nvidia GPU's in CPU mode 2023-07-02 22:27:26 +02:00
Henk
81e72329af CPU fixes 2023-07-02 21:50:23 +02:00
one-some
e62e3560bf Merge pull request #19 from henk7171/accelerate-offloading 
Remove wrong usegpu behavior
 2023-06-22 15:05:03 -05:00
Henk
1da4580e8b Remove wrong usegpu behavior 2023-06-22 07:07:02 +02:00
somebody
5ee20bd7d6 Fix for CPU loading 2023-06-21 21:18:43 -05:00
somebody
b81f61b820 Clean debug 2023-06-21 18:35:56 -05:00
somebody
e319d383f6 Merge branch 'Model_Plugins' of https://github.com/ebolam/KoboldAI into accelerate-offloading 2023-06-21 18:25:22 -05:00
ebolam
03a0542f71 Fix for model backends that use toggles always returning true 2023-06-21 19:19:12 -04:00
somebody
d4b923a054 Remove debug 2023-06-21 17:41:15 -05:00
somebody
5278174a62 Materialize on cpu 2023-06-21 17:40:47 -05:00
somebody
947bcc58e4 Experiments 2023-06-21 17:33:14 -05:00
somebody
0012158eac Remove old 2023-06-21 16:58:59 -05:00
somebody
6bdcf2645e Merge branch 'united' of https://github.com/henk717/KoboldAI into accelerate-offloading 2023-06-21 16:58:39 -05:00
somebody
c40649a74e Probably fix f32 2023-06-21 16:54:41 -05:00
somebody
70f113141c Fix Transformers 4.30 2023-06-21 16:40:12 -05:00
somebody
c56214c275 Fix loading bar 2023-06-21 16:27:22 -05:00
Henk
adf108ecd6 TPU link fix 2023-06-21 22:21:22 +02:00
Henk
b41b868528 Remove duplicate links 2023-06-21 22:13:55 +02:00
Henk
a13c7d0f40 New link messages 2023-06-21 21:55:18 +02:00
Henk
fc4d659e13 Merge branch 'main' into united 2023-06-21 21:32:55 +02:00
somebody
aca2b532d7 Remove debug 2023-06-21 14:15:38 -05:00
somebody
5f224e1366 Restore choice of lazyload or not 2023-06-21 14:13:14 -05:00
somebody
0052ad401a Basic breakmodel ui support 
Seems to work
 2023-06-21 13:57:32 -05:00
Henk
0c19855587 HF_Hub bump 2023-06-21 19:40:07 +02:00
Henk
bbecdaeedb Silently disable MTJ when Jax is not installed 2023-06-21 17:08:45 +02:00
henk717
d46663ac0d Merge pull request #376 from LostRuins/concedo_united 
Updated Kobold Lite to v41
 2023-06-18 14:30:08 +02:00
LostRuins
e7f1f47d94 Merge branch 'henk717:united' into concedo_united 2023-06-18 15:40:19 +08:00
Concedo
f42d5a4b10 Updated Kobold Lite to v41 2023-06-18 15:37:38 +08:00
henk717
f863d5db2d Merge pull request #373 from ebolam/Model_Plugins 
Making model backends respond to a specific type in the aiserver menu for now
 2023-06-14 02:13:44 +02:00
ebolam
abe07a2e95 Fix for model loading from paths 2023-06-13 20:05:50 -04:00
ebolam
e2801fb5c1 Merge branch 'henk717:united' into Model_Plugins 2023-06-12 17:36:06 -04:00
ebolam
dfb097d048 Moving basic hf to a new branch 2023-06-12 17:35:34 -04:00
henk717
22b2a3f327 Merge pull request #371 from LostRuins/concedo_united 
updated kobold lite to v37
 2023-06-04 17:01:51 +02:00
Concedo
49a64fb655 updated kobold lite to v37 2023-06-04 22:27:52 +08:00
Henk
4d213ddc51 Update drive disconnect fix 2023-06-04 14:12:00 +02:00
ebolam
ac265723e4 Merge branch 'henk717:united' into Model_Plugins 2023-06-03 11:08:00 -04:00
henk717
0ac2800601 Merge pull request #370 from Zurnaz/tpu_bfloat16 
fix: tpu support models saved in bfloat16
 2023-06-03 14:06:21 +02:00
Bogdan Drema
18dc706944 fix: tpu support models saved in bfloat16 2023-06-03 12:21:52 +01:00
ebolam
36530b1743 Well, it generates "Something" 2023-06-02 16:19:41 -04:00
ebolam
339f501600 Added model_backend_type to allow the current menu to specify a class of backends rather than a specific backend. 
Added super basic hf backend (testing phase only)
 2023-06-02 16:11:40 -04:00