rixty/KoboldAI-Client
1
1
Fork 0
mirror of https://github.com/KoboldAI/KoboldAI-Client.git synced 2025-06-05 21:59:24 +02:00
Code Issues Projects Releases Wiki Activity
3,662 Commits 1 Branch 5 Tags
ffe4f253495599675b0349ac58b0bcefbb57e8d1
Commit Graph

101 Commits

Author SHA1 Message Date
somebody
ffe4f25349 Model: Work on stoppers and stuff 2023-02-25 17:12:16 -06:00
somebody
6b4905de30 Model: Port rest of models over 
Generation's still broke but it's a start
 2023-02-25 16:05:56 -06:00
somebody
f8c4158ebc Model: Successful load implementation 
The goal of this series of commits is to have an implementation-agnostic
interface for models, thus being less reliant on HF Transformers for model
support. A model object will have a method for generation, a list of callbacks
to be run on every token generation, a list of samplers that will modify
probabilities, etc. Basically anything HF can do should be easily
implementable with the new interface :^)

Currently I've tested the loading of pre-downloaded models with
breakmodel between GPUs and that works, though essentially no testing
has been done in the larger scheme of things. Currently this is about
the only supported configuration, and generation isn't very functional.
 2023-02-24 21:41:44 -06:00
Henk
cd566caf20 Revision Fixes (Removes the workaround) 2023-02-19 00:51:50 +01:00
Henk
a9a724e38c Merge branch 'main' into united 2023-02-18 18:14:03 +01:00
Henk
f57489f73c Revision Cleanup 2023-01-31 18:46:59 +01:00
Henk
257a535be5 Revision Fixes Fixes 2023-01-31 05:17:34 +01:00
Henk
739cccd8ed Revision Fixes 2023-01-31 04:48:46 +01:00
Henk
640bd64037 Revision Fixes (And Var Workaround) 2023-01-31 04:00:35 +01:00
Henk
f1739dd184 Chatmode Regex 2023-01-13 13:04:54 +01:00
ebolam
db2fbbb17a Colab Debug 2022-10-24 19:16:03 -04:00
ebolam
b01713875c Add status bar message and status bar for TPU loading 2022-10-24 18:34:45 -04:00
ebolam
e101e43132 Merge commit 'refs/pull/243/head' of https://github.com/ebolam/KoboldAI into UI2 2022-10-23 12:03:40 -04:00
ebolam
06ee1426a1 Progress Bar for UI1 fixed 
Console print for model loading fixed
 2022-10-22 21:05:07 -04:00
ebolam
fbc7a3ff3d Chat mode cleanup 2022-10-13 10:46:42 -04:00
ebolam
ea738180de Un-pegging Transformer version 2022-10-07 15:18:40 -04:00
vfbd
6758d5b538 Merge branch 'united' into mkultra 2022-09-28 14:30:34 -04:00
ebolam
f442c1c9b9 Merge pull request #150 from henk717/united 
Update to united
 2022-09-21 13:50:29 -04:00
Henk
fef946c173 Possible colab aria2 status fix 2022-09-21 19:48:17 +02:00
Henk
06f4d9addf No Aria2 spam 2022-09-21 19:36:57 +02:00
ebolam
09ae3d7c84 Merge commit 'refs/pull/149/head' of https://github.com/ebolam/KoboldAI into UI2 2022-09-21 13:35:32 -04:00
ebolam
8915ee7eb3 Fix for aria2 download status to UI 2022-09-21 13:09:27 -04:00
Henk
cca3ce3493 Aria2 Fixes 2022-09-21 18:57:09 +02:00
Henk
f62c740f7e Revert "Aria2 Fixes" 
This reverts commit 8d1c734df8.
 2022-09-21 18:47:13 +02:00
Henk
8d1c734df8 Aria2 Fixes 2022-09-21 18:21:48 +02:00
ebolam
4d8df761ba Colab Fix 2022-09-19 09:45:38 -04:00
ebolam
1a31e0994c Colab Fix 2022-09-19 09:40:49 -04:00
ebolam
cb5204731c Colab Fix 2022-09-19 09:38:03 -04:00
ebolam
2d058afe3b Colab Fix 2022-09-19 09:37:31 -04:00
ebolam
cd9e4175a9 Colab Fix 2022-09-19 09:31:37 -04:00
ebolam
48101f492d Colab Fix 2022-09-19 09:30:30 -04:00
ebolam
d1c56bc6b8 Colab Fix 2022-09-19 09:28:33 -04:00
ebolam
f5ce00622b Fix for UI2 download status bar 2022-09-19 09:21:08 -04:00
ebolam
90b5dab721 Fix 2022-09-19 08:05:08 -04:00
ebolam
8e26918752 merge fix 2022-09-18 20:34:21 -04:00
ebolam
fc5a5952f0 Fix 2022-09-18 20:31:21 -04:00
ebolam
d1562af472 Merge commit 'refs/pull/138/head' of https://github.com/ebolam/KoboldAI into UI2 2022-09-18 19:20:20 -04:00
vfbd
943614b5e6 Merge branch 'main' into dependency-fix 2022-09-15 17:33:48 -04:00
vfbd
463bf86bcc aria2_hook now uses new cache format if you have transformers 4.22 2022-09-15 16:50:43 -04:00
vfbd
551565c5ac Fix error in aria2_hook when transformers version is at least 4.22.0 
Some of the transformers.file_utils functions that were removed in
transformers v4.22.0 have equivalents in the huggingface_hub module.
 2022-09-15 13:37:50 -04:00
ebolam
e9678ceea3 Merge commit 'refs/pull/82/head' of https://github.com/ebolam/KoboldAI into UI2 2022-08-30 14:50:28 -04:00
vfbd
cbab98cc23 Merge branch 'united' into mkultra 2022-08-24 15:06:02 -04:00
henk717
6faa27ef87 Merge pull request #187 from VE-FORBRYDERNE/offline 
Fix the model selection GUI when there is no internet connection
 2022-08-24 20:13:02 +02:00
vfbd
51135e192b Merge branch 'united' into mkultra 2022-08-23 21:29:29 -04:00
vfbd
6ffaf43548 Repetition penalty is now sampler #6 in the sampler order 2022-08-23 15:10:21 -04:00
vfbd
a51e4f0651 aria2_hook now handles properly when vars is None 2022-08-22 21:52:40 -04:00
vfbd
3d5c83fc23 prompt_tuner.py now uses lazy loader and accelerate 2022-08-22 19:29:20 -04:00
vfbd
55f45c4912 Fix the model selection GUI when there is no internet connection 2022-08-22 14:45:02 -04:00
ebolam
8ba68e05ec Aria2 Status Bar Download Fix 2022-08-19 12:13:46 -04:00
ebolam
513f59791a Debug 2022-08-19 12:11:53 -04:00