Advanced Settings

The settings provided in this section offer a more detailed level of control over the text generation process. It is important to be careful when making changes to these settings without proper consideration, as doing so may result in degraded quality of responses.

Single-line mode

In single-line mode the AI generates only one line per request. This allows for quicker generation of shorter prompts, but it does not produce responses that consist of more than one line.

Top P Sampling

This setting controls how much of the text generated is based on the most likely options. The top P words with the highest probabilities are considered. A word is then chosen at random, with a higher chance of selecting words with higher probabilities.

Set value to 1 to disable its effect.

Top K Sampling

This setting limits the number of words to choose from to the top K most likely options. Can be used together with Top P sampling.

Set value to 0 to disable its effect.

Top A Sampling

This setting allows for a more flexible version of sampling, where the number of words chosen from the most likely options is automatically determined based on the likelihood distribution of the options, but instead of choosing the top P or K words, it chooses all words with probabilities above a certain threshold.

Set value to 0 to disable its effect.

Typical Sampling

This setting selects words randomly from the list of possible words, with each word having an equal chance of being selected. This method can produce text that is more diverse but may also be less coherent.

Set value to 1 to disable its effect.

Tail Free Sampling

This setting removes the least probable words from consideration during text generation, which can improve the quality and coherence of the generated text.

Set value to 1 to disable its effect.

Repetition Penalty Slope

If both this and Repetition Penalty Range are above 0, then repetition penalty will have more effect closer to the end of the prompt. The higher the value, the stronger the effect.

Set value to 1 for linear interpolation or 0 to disable interpolation.