rixty
/
KoboldAI-Client
mirror of https://github.com/KoboldAI/KoboldAI-Client.git
1
1
Fork 0
Code Issues Projects Releases Wiki Activity

Enable Tokenizer Parralism 

Has proven to be safe in my internal testing and does help with the interface lag at boot.

Enabling this so it can get wider testing.
This commit is contained in:
henk717 2022-02-01 12:00:53 +01:00
parent ecd7b328ec
commit b8e08cdd63
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
aiserver.py
View File

@ -11,7 +11,7 @@ eventlet.monkey_patch(all=True, thread=False)
import os import os
os.system("") os.system("")
os.environ['EVENTLET_THREADPOOL_SIZE'] = '1' os.environ['EVENTLET_THREADPOOL_SIZE'] = '1'
os.environ['TOKENIZERS_PARALLELISM'] = 'false' os.environ['TOKENIZERS_PARALLELISM'] = 'true'
from eventlet import tpool from eventlet import tpool
from os import path, getcwd from os import path, getcwd