rixty/KoboldAI-Client
1
1
Fork 0
mirror of https://github.com/KoboldAI/KoboldAI-Client.git synced 2025-06-05 21:59:24 +02:00
Code Issues Projects Releases Wiki Activity

Make sure stopping criteria still work with dynamic scan off

Browse Source
This commit is contained in:
Gnome Ann
2021-12-13 18:10:51 -05:00
parent 338d437ea3
commit 661cca63e8
1 changed files with 1 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
aiserver.py
View File

@ -762,7 +762,7 @@ if(not vars.model in ["InferKit", "Colab", "OAI", "ReadOnly", "TPUMeshTransforme
self.halt = vars.lua_warper.halt self.halt = vars.lua_warper.halt
if(not vars.dynamicscan): if(not vars.dynamicscan):
return False return self.regeneration_required or self.halt
tail = input_ids[..., self.head_length:] tail = input_ids[..., self.head_length:]
for i, t in enumerate(tail): for i, t in enumerate(tail):
decoded = tokenizer.decode(t) decoded = tokenizer.decode(t)