mirror of
https://github.com/SillyTavern/SillyTavern.git
synced 2025-02-23 15:37:50 +01:00
Filter mirostat block by API type.
Sources: - https://docs.vllm.ai/en/latest/dev/sampling_params.html - https://docs.together.ai/reference/completions-1 - https://github.com/theroyallab/tabbyAPI/blob/main/common/sampling.py#L326 - https://openrouter.ai/docs/parameters - https://github.com/ollama/ollama/blob/main/docs/api.md#generate-request-with-options - https://mancer.tech/docs-api/#/openai/post_oai_v1_completions - https://github.com/ggerganov/llama.cpp/blob/master/examples/server/README.md#api-endpoints - https://github.com/LostRuins/koboldcpp/blob/concedo/koboldcpp.py#L139 - https://github.com/PygmalionAI/aphrodite-engine/blob/main/aphrodite/common/sampling_params.py#L77 - https://huggingface.co/docs/huggingface_hub/en/package_reference/inference_types#huggingface_hub.TextGenerationInput - https://dreamgen.com/docs/api#openai-text
This commit is contained in:
parent
9deeca3eeb
commit
2876426c87
@ -1358,7 +1358,7 @@
|
||||
</div>
|
||||
</div>
|
||||
</div>
|
||||
<div data-newbie-hidden id="mirostat_block_ooba" class="wide100p">
|
||||
<div data-newbie-hidden data-tg-type="ooba,aphrodite,featherless,infermaticai,koboldcpp,llamacpp,mancer,ollama,tabby" id="mirostat_block_ooba" class="wide100p">
|
||||
<h4 class="wide100p textAlignCenter">
|
||||
<label data-i18n="Mirostat (mode=1 is only for llama.cpp)">Mirostat</label>
|
||||
<div class=" fa-solid fa-circle-info opacity50p " data-i18n="[title]Mirostat_desc" title="Mirostat is a thermostat for output perplexity. Mirostat matches the output perplexity to that of the input, thus avoiding the repetition trap (where, as the autoregressive inference produces text, the perplexity of the output tends toward zero) and the confusion trap (where the perplexity diverges). For details, see the paper Mirostat: A Neural Text Decoding Algorithm that Directly Controls Perplexity by Basu et al. (2020). Mode chooses the Mirostat version. 0=disable, 1=Mirostat 1.0 (llama.cpp only), 2=Mirostat 2.0."></div>
|
||||
|
Loading…
x
Reference in New Issue
Block a user