Fix error that occurs when using dynamic TPU backend

This commit is contained in:
vfbd 2022-08-27 17:42:49 -04:00
parent a282500da7
commit cbacfbdfac
1 changed files with 1 additions and 1 deletions

View File

@ -533,7 +533,7 @@ def sample_func(data, key, numseqs_aux, badwords, repetition_penalty, generated_
gen_length, gen_length,
rpslope, rpslope,
rprange, rprange,
) ),
**sampler_options, **sampler_options,
) )
# Remember what token was picked # Remember what token was picked