Commit Graph

8 Commits

Author SHA1 Message Date
Gnome Ann f9e6a6da17 Slightly increased performance in breakmodel mode
Commit a283d34b27 made breakmodel mode
slower. Performance has been restored to how it was before that commit.
2021-10-05 10:25:06 -04:00
Gnome Ann a283d34b27 Multiple GPU support 2021-10-05 09:38:57 -04:00
Gnome Ann 0937bb33e7 Clarify licensing for breakmodel.py 2021-10-02 12:19:37 -04:00
Gnome Ann 4d9eab3785 K80 test 2021-09-23 20:57:18 -04:00
Gnome Ann b5c28f4e07 Fix for when breakmodel layers is 0 2021-08-28 02:19:51 -04:00
Gnome Ann 8bfcf86a8b Fix for non-rotary models without "rotary" in config.json 2021-08-20 13:00:53 -04:00
Gnome Ann eef0db8dee Specifically import torch.cuda.comm in breakmodel.py 2021-08-20 10:47:54 -04:00
Gnome Ann b1c13f832a Implement arrmansa's low VRAM patch 2021-08-20 10:25:03 -04:00