Fix for CPU mode

Recent optimizations caused the CPU version to load in an incompatible format, now we convert it back to the correct format after loading it efficiently first.
2021-11-27 05:34:29 +01:00 · 2021-11-27 05:34:29 +01:00 · b56ee07ffa
parent 56c2e619f9
commit b56ee07ffa
1 changed files with 1 additions and 1 deletions
--- a/aiserver.py
+++ b/aiserver.py
@ -291,7 +291,7 @@ def device_config(model):
        print("Nothing assigned to a GPU, reverting to CPU only mode")
        vars.breakmodel = False
        vars.usegpu = False
-        model = model.to('cpu')
+        model = model.to('cpu').float()
        generator = model.generate
        return
    model.half().to('cpu')