14 Commits

Author	SHA1	Message	Date
henk717	68110c5930	Merge branch 'KoboldAI:main' into united	2022-07-12 23:03:09 +02:00
vfbd	39d48495ce	Fix for lazy loader in PyTorch 1.12 ... There is no `torch._StorageBase` in PyTorch 1.12, but otherwise it still works.	2022-07-12 16:48:01 -04:00
Gnome Ann	8bdf17f598	Lazy loader can now use accelerate's init_empty_weights()	2022-06-16 18:56:16 -04:00
Gnome Ann	6803531384	Force grad to be off by default when loading with lazy loader	2022-04-19 12:26:02 -04:00
Gnome Ann	fabbdf2bb1	Lazy loader Python 3.6 compatibility ... The current lazy loader relies on a feature of the Python zipfile module that was added in Python 3.7.0: https://bugs.python.org/issue22908 This commit adds compatibility for Python 3.6.	2022-04-02 15:02:54 -04:00
Gnome Ann	ef21ab9c91	PyTorch 1.9 lazy loader compatibility bugfix	2022-03-17 14:10:51 -04:00
Gnome Ann	eaf190469d	Add PyTorch 1.11 support for lazy loader	2022-03-17 12:51:41 -04:00
Gnome Ann	1515996fca	Fix torch_lazy_loader seek offset calculation	2022-03-03 23:53:40 -05:00
Gnome Ann	24bc0f81ea	Remove duplicate torch_load definition	2022-03-03 19:55:31 -05:00
Gnome Ann	8e6e04be5f	(torch_lazy_loader.py) Add dematerialized modules setting	2022-03-03 11:17:59 -05:00
Gnome Ann	1ecc452dc8	(torch_lazy_loader.py) Add support for materializing from a ZipExtFile	2022-03-02 13:08:21 -05:00
Gnome Ann	c338b52d68	(torch_lazy_loader.py) Handle checkpoints with merged storage blocks	2022-03-02 01:02:35 -05:00
Gnome Ann	4fa4dbac50	Clean up when error is thrown in use_lazy_torch_load	2022-03-01 19:30:22 -05:00
Gnome Ann	a0344b429c	Upload torch_lazy_loader.py	2022-03-01 15:40:44 -05:00