rixty
/
SillyTavern
mirror of https://github.com/SillyTavern/SillyTavern.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
SillyTavern/public/KoboldAI Settings/Deterministic.settings

23 lines
333 B
Plaintext
Raw Normal View History

Llama-2-KoboldAI-presets Here are two presets I've found very useful for Llama 2-based models: - Deterministic takes away the randomness and is good for testing/comparing models because same input equals same output. - Storywriter-Llama2 is the Storywriter preset adjusted for Llama 2's 4K context size. It also works well against Llama 2's repetition/looping issues.
2023-08-01 21:41:34 +02:00
{
"temp": 0,
"rep_pen": 1.1,
Update Deterministic.settings Go back down to 2048 tokens instead of 4096 to be in line with the other non-Llama 2-specific presets
2023-08-03 11:46:53 +02:00
"rep_pen_range": 2048,
Llama-2-KoboldAI-presets Here are two presets I've found very useful for Llama 2-based models: - Deterministic takes away the randomness and is good for testing/comparing models because same input equals same output. - Storywriter-Llama2 is the Storywriter preset adjusted for Llama 2's 4K context size. It also works well against Llama 2's repetition/looping issues.
2023-08-01 21:41:34 +02:00
"streaming_kobold": true,
"top_p": 0,
"top_a": 0,
"top_k": 1,
"typical": 1,
"tfs": 1,
"rep_pen_slope": 0.2,
"single_line": false,
"sampler_order": [
6,
0,
1,
3,
4,
2,
5
]
}