rixty/KoboldAI-Client
1
1
Fork 0
mirror of https://github.com/KoboldAI/KoboldAI-Client.git synced 2025-02-26 00:17:41 +01:00
Code Issues Projects Releases Wiki Activity

Hotfix for top_p parameter in generator call

Browse Source
This commit is contained in:
KoboldAI Dev 2021-05-11 14:16:34 -04:00
parent f520e859cf
commit fff77c5a88
1 changed files with 1 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

1
aiserver.py
View File

@ -642,6 +642,7 @@ def generate(txt, min, max):
min_length=min, min_length=min,
max_length=max, max_length=max,
repetition_penalty=vars.rep_pen, repetition_penalty=vars.rep_pen,
top_p=vars.top_p,
temperature=vars.temp temperature=vars.temp
)[0]["generated_text"] )[0]["generated_text"]
print("{0}{1}{2}".format(colors.CYAN, genout, colors.END)) print("{0}{1}{2}".format(colors.CYAN, genout, colors.END))