68110c5930
Merge branch 'KoboldAI:main' into united
2022-07-12 23:03:09 +02:00
39d48495ce
Fix for lazy loader in PyTorch 1.12
...
There is no `torch._StorageBase` in PyTorch 1.12, but otherwise it still
works.
2022-07-12 16:48:01 -04:00
8bdf17f598
Lazy loader can now use accelerate's `init_empty_weights()`
2022-06-16 18:56:16 -04:00
6803531384
Force grad to be off by default when loading with lazy loader
2022-04-19 12:26:02 -04:00
fabbdf2bb1
Lazy loader Python 3.6 compatibility
...
The current lazy loader relies on a feature of the Python zipfile module
that was added in Python 3.7.0:
https://bugs.python.org/issue22908
This commit adds compatibility for Python 3.6.
2022-04-02 15:02:54 -04:00
ef21ab9c91
PyTorch 1.9 lazy loader compatibility bugfix
2022-03-17 14:10:51 -04:00
eaf190469d
Add PyTorch 1.11 support for lazy loader
2022-03-17 12:51:41 -04:00
1515996fca
Fix torch_lazy_loader seek offset calculation
2022-03-03 23:53:40 -05:00
24bc0f81ea
Remove duplicate `torch_load` definition
2022-03-03 19:55:31 -05:00
8e6e04be5f
(torch_lazy_loader.py) Add dematerialized modules setting
2022-03-03 11:17:59 -05:00
1ecc452dc8
(torch_lazy_loader.py) Add support for materializing from a ZipExtFile
2022-03-02 13:08:21 -05:00
c338b52d68
(torch_lazy_loader.py) Handle checkpoints with merged storage blocks
2022-03-02 01:02:35 -05:00
4fa4dbac50
Clean up when error is thrown in `use_lazy_torch_load`
2022-03-01 19:30:22 -05:00
a0344b429c
Upload torch_lazy_loader.py
2022-03-01 15:40:44 -05:00
henk717
vfbd
Gnome Ann