143 Commits

Author	SHA1	Message	Date
Henk	16240878bc	Restore --peft support	2023-07-04 20:42:29 +02:00
somebody	bce1a907e5	Update aux device to depend on primary device	2023-07-03 19:36:31 -05:00
somebody	6f7e6422ef	Actually get correct primary device	2023-07-03 19:04:48 -05:00
somebody	59c731f805	Fix static primary_device ... and some small cleanup	2023-07-03 18:37:48 -05:00
Henk	81e72329af	CPU fixes	2023-07-02 21:50:23 +02:00
Henk	1da4580e8b	Remove wrong usegpu behavior	2023-06-22 07:07:02 +02:00
somebody	5ee20bd7d6	Fix for CPU loading	2023-06-21 21:18:43 -05:00
somebody	b81f61b820	Clean debug	2023-06-21 18:35:56 -05:00
somebody	947bcc58e4	Experiments	2023-06-21 17:33:14 -05:00
somebody	0012158eac	Remove old	2023-06-21 16:58:59 -05:00
somebody	6bdcf2645e	Merge branch 'united' of https://github.com/henk717/KoboldAI into accelerate-offloading	2023-06-21 16:58:39 -05:00
somebody	c40649a74e	Probably fix f32	2023-06-21 16:54:41 -05:00
somebody	aca2b532d7	Remove debug	2023-06-21 14:15:38 -05:00
somebody	5f224e1366	Restore choice of lazyload or not	2023-06-21 14:13:14 -05:00
somebody	0052ad401a	Basic breakmodel ui support ... Seems to work	2023-06-21 13:57:32 -05:00
Henk	bbecdaeedb	Silently disable MTJ when Jax is not installed	2023-06-21 17:08:45 +02:00
ebolam	dfb097d048	Moving basic hf to a new branch	2023-06-12 17:35:34 -04:00
ebolam	36530b1743	Well, it generates "Something"	2023-06-02 16:19:41 -04:00
ebolam	339f501600	Added model_backend_type to allow the current menu to specify a class of backends rather than a specific backend. ... Added super basic hf backend (testing phase only)	2023-06-02 16:11:40 -04:00
ebolam	5c4d580aac	Fix for --nobreakmodel forcing CPU ... Put importing of colab packages into a if function so it doesn't error out	2023-06-02 12:58:59 -04:00
somebody	f326fc07e8	Seems to work	2023-05-31 14:42:05 -05:00
somebody	24b0b32829	Maybe works now...?	2023-05-31 14:31:08 -05:00
somebody	ac4384ef75	Auto _no_split_modules	2023-05-31 10:55:46 -05:00
Henk	bda8c931f8	Horde backend fix	2023-05-31 16:56:08 +02:00
somebody	58ffad237b	OPT hack	2023-05-29 13:34:11 -05:00
somebody	ceaefa9f5e	Not quite	2023-05-28 14:57:45 -05:00
somebody	ed0728188a	More cleaning	2023-05-28 13:22:32 -05:00
somebody	6f93150e4d	Work on lazyload	2023-05-28 12:25:31 -05:00
somebody	1546b9efaa	Hello its breaking breakmodel time	2023-05-27 16:31:53 -05:00
ebolam	47276c3424	Bug Fix	2023-05-27 08:49:21 -04:00
ebolam	cce5c1932c	Fix for custom model names	2023-05-26 21:40:39 -04:00
ebolam	9723154bed	Fix for --path	2023-05-26 20:10:11 -04:00
ebolam	51cea7eb9d	Added ability to add labels that are based on validation data in model loading settings	2023-05-26 12:43:17 -04:00
ebolam	0376ab5715	KoboldAI API model name fix	2023-05-26 11:42:29 -04:00
ebolam	52f5d87906	Fix horde tokenizer	2023-05-26 11:25:28 -04:00
ebolam	2c82e9c5e0	GooseAI Fixes	2023-05-26 11:08:30 -04:00
ebolam	0659b5062b	Added proper model name for horde	2023-05-25 18:46:35 -04:00
ebolam	adb77b8651	Fix for horde and multi-selected models	2023-05-25 18:43:56 -04:00
ebolam	c9523a340e	TPU Fix	2023-05-24 19:50:08 -04:00
ebolam	b0ed7da9dd	more tpu debugging	2023-05-24 19:47:45 -04:00
ebolam	ea4e3c477c	More debuging	2023-05-24 19:45:21 -04:00
ebolam	6a62726575	TPU Fix?	2023-05-24 19:30:23 -04:00
ebolam	703da112ee	TPU Fix	2023-05-24 19:17:51 -04:00
ebolam	6620df5350	debug info	2023-05-24 19:03:49 -04:00
ebolam	5fe8c71b2e	TPU Fixes	2023-05-24 18:55:31 -04:00
ebolam	1a1b79a16d	Change default for HF on non-breakmodel models to use GPU instead of CPU	2023-05-24 12:44:26 -04:00
ebolam	068173b24a	Potential BadWords fix	2023-05-24 09:08:34 -04:00
ebolam	9bd445c2a8	gpt2 fixed	2023-05-23 20:33:55 -04:00
ebolam	839d56ebf2	Potential fix for gpt-neo and gpt-j	2023-05-23 19:25:01 -04:00
ebolam	5561cc1f22	Fix for GPU generation	2023-05-23 08:33:19 -04:00