rixty/KoboldAI-Client
1
1
Fork 0
mirror of https://github.com/KoboldAI/KoboldAI-Client.git synced 2025-06-05 21:59:24 +02:00
Code Issues Projects Releases Wiki Activity

Enable Tokenizer Parralism

Browse Source 
Has proven to be safe in my internal testing and does help with the interface lag at boot.

Enabling this so it can get wider testing.
This commit is contained in:
henk717
2022-02-01 12:00:53 +01:00
parent ecd7b328ec
commit b8e08cdd63
1 changed files with 1 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
aiserver.py
View File

@@ -11,7 +11,7 @@ eventlet.monkey_patch(all=True, thread=False)
import os
os.system("")
os.environ['EVENTLET_THREADPOOL_SIZE'] = '1'
os.environ['TOKENIZERS_PARALLELISM'] = 'false'
os.environ['TOKENIZERS_PARALLELISM'] = 'true'
from eventlet import tpool
from os import path, getcwd