rixty
/
KoboldAI-Client
mirror of https://github.com/KoboldAI/KoboldAI-Client.git
1
1
Fork 0
Code Issues Projects Releases Wiki Activity

Merge pull request #31 from VE-FORBRYDERNE/cpu 

Fix gen_in device logic in generate()
This commit is contained in:
henk717 2021-11-17 22:42:31 +01:00 committed by GitHub
parent e71271933a 2f0b673b28
commit 27ee45b9cc
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
1 changed files with 0 additions and 2 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
aiserver.py
View File

@ -1458,8 +1458,6 @@ def generate(txt, minimum, maximum, found_entries=None):
gen_in = gen_in.to(0) gen_in = gen_in.to(0)
elif(vars.hascuda and vars.breakmodel): elif(vars.hascuda and vars.breakmodel):
gen_in = gen_in.to(breakmodel.primary_device) gen_in = gen_in.to(breakmodel.primary_device)
elif(vars.hascuda):
gen_in = gen_in.to(0)
else: else:
gen_in = gen_in.to('cpu') gen_in = gen_in.to('cpu')