rixty
/
KoboldAI-Client
mirror of https://github.com/KoboldAI/KoboldAI-Client.git
1
1
Fork 0
Code Issues Projects Releases Wiki Activity

Always pass 1.1 as repetition penalty to generator 

The `dynamic_processor_wrap` makes it so that the repetition penalty is
read directly from `vars`, but this only works if the initial repetition
sent to `generator` is not equal to 1. So we are now forcing the initial
repetition penalty to be something other than 1.
This commit is contained in:
Gnome Ann 2022-01-04 14:18:58 -05:00
parent 63bb76b073
commit f46ebd2359
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
aiserver.py
View File

@ -2560,7 +2560,7 @@ def _generate(txt, minimum, maximum, found_entries):
do_sample=True, do_sample=True,
min_length=minimum, min_length=minimum,
max_length=int(2e9), max_length=int(2e9),
repetition_penalty=vars.rep_pen, repetition_penalty=1.1,
bad_words_ids=vars.badwordsids, bad_words_ids=vars.badwordsids,
use_cache=True, use_cache=True,
num_return_sequences=numseqs num_return_sequences=numseqs