Commit Graph

14 Commits

Author SHA1 Message Date
henk717 68110c5930
Merge branch 'KoboldAI:main' into united 2022-07-12 23:03:09 +02:00
vfbd 39d48495ce Fix for lazy loader in PyTorch 1.12
There is no `torch._StorageBase` in PyTorch 1.12, but otherwise it still
works.
2022-07-12 16:48:01 -04:00
Gnome Ann 8bdf17f598 Lazy loader can now use accelerate's `init_empty_weights()` 2022-06-16 18:56:16 -04:00
Gnome Ann 6803531384 Force grad to be off by default when loading with lazy loader 2022-04-19 12:26:02 -04:00
Gnome Ann fabbdf2bb1 Lazy loader Python 3.6 compatibility
The current lazy loader relies on a feature of the Python zipfile module
that was added in Python 3.7.0:

https://bugs.python.org/issue22908

This commit adds compatibility for Python 3.6.
2022-04-02 15:02:54 -04:00
Gnome Ann ef21ab9c91 PyTorch 1.9 lazy loader compatibility bugfix 2022-03-17 14:10:51 -04:00
Gnome Ann eaf190469d Add PyTorch 1.11 support for lazy loader 2022-03-17 12:51:41 -04:00
Gnome Ann 1515996fca Fix torch_lazy_loader seek offset calculation 2022-03-03 23:53:40 -05:00
Gnome Ann 24bc0f81ea Remove duplicate `torch_load` definition 2022-03-03 19:55:31 -05:00
Gnome Ann 8e6e04be5f (torch_lazy_loader.py) Add dematerialized modules setting 2022-03-03 11:17:59 -05:00
Gnome Ann 1ecc452dc8 (torch_lazy_loader.py) Add support for materializing from a ZipExtFile 2022-03-02 13:08:21 -05:00
Gnome Ann c338b52d68 (torch_lazy_loader.py) Handle checkpoints with merged storage blocks 2022-03-02 01:02:35 -05:00
Gnome Ann 4fa4dbac50 Clean up when error is thrown in `use_lazy_torch_load` 2022-03-01 19:30:22 -05:00
Gnome Ann a0344b429c Upload torch_lazy_loader.py 2022-03-01 15:40:44 -05:00