rixty/KoboldAI-Client
1
1
Fork 0
mirror of https://github.com/KoboldAI/KoboldAI-Client.git synced 2025-06-05 21:59:24 +02:00
Code Issues Projects Releases Wiki Activity

critical change

Browse Source
This commit is contained in:
somebody
2023-07-24 17:17:57 -05:00
parent a73420c49c
commit ad4528b5a6
1 changed files with 0 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

1
modeling/inference_models/gptq_hf_torch/class.py
View File

@@ -103,7 +103,6 @@ def load_quant_offload_device_map(
print(device_map) print(device_map)
m, layers, remaining = find_layers(model) m, layers, remaining = find_layers(model)
type(m).non_offload_forward = type(m).forward type(m).non_offload_forward = type(m).forward
# Hook offload_forward into found model # Hook offload_forward into found model