178 Commits

Author	SHA1	Message	Date
Henk	16240878bc	Restore --peft support	2023-07-04 20:42:29 +02:00
somebody	ebe478458f	Just use string sort on key ... Doesn't seem to affect cache hit number	2023-07-03 19:59:53 -05:00
somebody	bce1a907e5	Update aux device to depend on primary device	2023-07-03 19:36:31 -05:00
somebody	6f7e6422ef	Actually get correct primary device	2023-07-03 19:04:48 -05:00
somebody	59c731f805	Fix static primary_device ... and some small cleanup	2023-07-03 18:37:48 -05:00
somebody	7f869a54d8	Just use accelerate on tpu	2023-07-03 17:18:48 -05:00
somebody	31a3046a18	Load empty modules without accelerate	2023-07-03 17:07:18 -05:00
somebody	686c3d1592	Don't patch lazyload on TPU	2023-07-03 16:52:18 -05:00
Henk	4a45a0e551	Fix bar spam	2023-07-02 23:02:02 +02:00
Henk	81e72329af	CPU fixes	2023-07-02 21:50:23 +02:00
Henk	1da4580e8b	Remove wrong usegpu behavior	2023-06-22 07:07:02 +02:00
somebody	5ee20bd7d6	Fix for CPU loading	2023-06-21 21:18:43 -05:00
somebody	b81f61b820	Clean debug	2023-06-21 18:35:56 -05:00
somebody	5278174a62	Materialize on cpu	2023-06-21 17:40:47 -05:00
somebody	947bcc58e4	Experiments	2023-06-21 17:33:14 -05:00
somebody	0012158eac	Remove old	2023-06-21 16:58:59 -05:00
somebody	6bdcf2645e	Merge branch 'united' of https://github.com/henk717/KoboldAI into accelerate-offloading	2023-06-21 16:58:39 -05:00
somebody	c40649a74e	Probably fix f32	2023-06-21 16:54:41 -05:00
somebody	70f113141c	Fix Transformers 4.30	2023-06-21 16:40:12 -05:00
somebody	c56214c275	Fix loading bar	2023-06-21 16:27:22 -05:00
somebody	aca2b532d7	Remove debug	2023-06-21 14:15:38 -05:00
somebody	5f224e1366	Restore choice of lazyload or not	2023-06-21 14:13:14 -05:00
somebody	0052ad401a	Basic breakmodel ui support ... Seems to work	2023-06-21 13:57:32 -05:00
Henk	bbecdaeedb	Silently disable MTJ when Jax is not installed	2023-06-21 17:08:45 +02:00
ebolam	dfb097d048	Moving basic hf to a new branch	2023-06-12 17:35:34 -04:00
ebolam	36530b1743	Well, it generates "Something"	2023-06-02 16:19:41 -04:00
ebolam	339f501600	Added model_backend_type to allow the current menu to specify a class of backends rather than a specific backend. ... Added super basic hf backend (testing phase only)	2023-06-02 16:11:40 -04:00
ebolam	5c4d580aac	Fix for --nobreakmodel forcing CPU ... Put importing of colab packages into a if function so it doesn't error out	2023-06-02 12:58:59 -04:00
somebody	f326fc07e8	Seems to work	2023-05-31 14:42:05 -05:00
somebody	24b0b32829	Maybe works now...?	2023-05-31 14:31:08 -05:00
somebody	d0d215bb37	I have no idea why this was removed i swear it was there	2023-05-31 10:59:03 -05:00
somebody	ac4384ef75	Auto _no_split_modules	2023-05-31 10:55:46 -05:00
Henk	bda8c931f8	Horde backend fix	2023-05-31 16:56:08 +02:00
somebody	146806eba1	Remove old function	2023-05-29 13:36:15 -05:00
somebody	58ffad237b	OPT hack	2023-05-29 13:34:11 -05:00
somebody	ceaefa9f5e	Not quite	2023-05-28 14:57:45 -05:00
somebody	ed0728188a	More cleaning	2023-05-28 13:22:32 -05:00
somebody	14241fc156	Speed	2023-05-28 13:03:24 -05:00
somebody	6f93150e4d	Work on lazyload	2023-05-28 12:25:31 -05:00
somebody	1546b9efaa	Hello its breaking breakmodel time	2023-05-27 16:31:53 -05:00
ebolam	47276c3424	Bug Fix	2023-05-27 08:49:21 -04:00
ebolam	cce5c1932c	Fix for custom model names	2023-05-26 21:40:39 -04:00
ebolam	9723154bed	Fix for --path	2023-05-26 20:10:11 -04:00
ebolam	51cea7eb9d	Added ability to add labels that are based on validation data in model loading settings	2023-05-26 12:43:17 -04:00
ebolam	0376ab5715	KoboldAI API model name fix	2023-05-26 11:42:29 -04:00
ebolam	52f5d87906	Fix horde tokenizer	2023-05-26 11:25:28 -04:00
ebolam	2c82e9c5e0	GooseAI Fixes	2023-05-26 11:08:30 -04:00
ebolam	0659b5062b	Added proper model name for horde	2023-05-25 18:46:35 -04:00
ebolam	adb77b8651	Fix for horde and multi-selected models	2023-05-25 18:43:56 -04:00
ebolam	c9523a340e	TPU Fix	2023-05-24 19:50:08 -04:00