rixty/KoboldAI-Client
1
1
Fork 0
mirror of https://github.com/KoboldAI/KoboldAI-Client.git synced 2025-06-05 21:59:24 +02:00
Code Issues Projects Releases Wiki Activity

Fix float top-k value in horde

Browse Source 
This may be from my .v2_settings file from an older generation, but
for some reason my top-k was 0.0 instead of 0, which caused an error in
the API
This commit is contained in:
somebody
2022-12-10 21:47:19 -06:00
parent 99556bf86a
commit aa674a9e1f
1 changed files with 1 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
aiserver.py
View File

@@ -5852,7 +5852,7 @@ def cluster_raw_generate(
'rep_pen_range': gen_settings.rep_pen_range,
'temperature': gen_settings.temp,
'top_p': gen_settings.top_p,
'top_k': gen_settings.top_k,
'top_k': int(gen_settings.top_k),
'top_a': gen_settings.top_a,
'tfs': gen_settings.tfs,
'typical': gen_settings.typical,