rixty/KoboldAI-Client
1
1
Fork 0
mirror of https://github.com/KoboldAI/KoboldAI-Client.git synced 2025-06-05 21:59:24 +02:00
Code Issues Projects Releases Wiki Activity

Materialize on cpu

Browse Source
This commit is contained in:
somebody
2023-06-21 17:40:47 -05:00
parent 947bcc58e4
commit 5278174a62
1 changed files with 1 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
modeling/patches.py
View File

@@ -205,7 +205,7 @@ def patch_transformers_for_lazyload() -> None:
if isinstance(param, LazyTensor): if isinstance(param, LazyTensor):
# Should always be true # Should always be true
param = param.materialize() param = param.materialize(map_location="cpu")
utils.bar.update(1) utils.bar.update(1)
# END PATCH # END PATCH