Fix error that occurs when using dynamic TPU backend

This commit is contained in:
vfbd 2022-08-27 17:42:49 -04:00
parent a282500da7
commit cbacfbdfac
1 changed files with 1 additions and 1 deletions

View File

@ -533,7 +533,7 @@ def sample_func(data, key, numseqs_aux, badwords, repetition_penalty, generated_
gen_length,
rpslope,
rprange,
)
),
**sampler_options,
)
# Remember what token was picked