SillyTavern/public/KoboldAI Settings/Deterministic.settings

{
    "temp": 0,
    "rep_pen": 1.18,
    "rep_pen_range": 2048,
    "streaming_kobold": true,
    "top_p": 0,
    "top_a": 0,
    "top_k": 1,
    "typical": 1,
    "tfs": 1,
    "rep_pen_slope": 0,
    "single_line": false,
    "sampler_order": [
        6,
        0,
        1,
        3,
        4,
        2,
        5
    ]
}
Llama-2-KoboldAI-presets Here are two presets I've found very useful for Llama 2-based models: - Deterministic takes away the randomness and is good for testing/comparing models because same input equals same output. - Storywriter-Llama2 is the Storywriter preset adjusted for Llama 2's 4K context size. It also works well against Llama 2's repetition/looping issues. 2023-08-01 21:41:34 +02:00			`{`
			`"temp": 0,`
Update KoboldAI Deterministic.settings After extensive testing, I've adjusted repetition penalty slightly to be the same as simple-proxy-for-tavern's default preset and ooba's LLaMA-Precise settings preset. This fixed some models talking/acting as User. 2023-08-13 19:25:56 +02:00			`"rep_pen": 1.18,`
Update Deterministic.settings Go back down to 2048 tokens instead of 4096 to be in line with the other non-Llama 2-specific presets 2023-08-03 11:46:53 +02:00			`"rep_pen_range": 2048,`
Llama-2-KoboldAI-presets Here are two presets I've found very useful for Llama 2-based models: - Deterministic takes away the randomness and is good for testing/comparing models because same input equals same output. - Storywriter-Llama2 is the Storywriter preset adjusted for Llama 2's 4K context size. It also works well against Llama 2's repetition/looping issues. 2023-08-01 21:41:34 +02:00			`"streaming_kobold": true,`
			`"top_p": 0,`
			`"top_a": 0,`
			`"top_k": 1,`
			`"typical": 1,`
			`"tfs": 1,`
Update KoboldAI Deterministic.settings After extensive testing, I've adjusted repetition penalty slightly to be the same as simple-proxy-for-tavern's default preset and ooba's LLaMA-Precise settings preset. This fixed some models talking/acting as User. 2023-08-13 19:25:56 +02:00			`"rep_pen_slope": 0,`
Llama-2-KoboldAI-presets Here are two presets I've found very useful for Llama 2-based models: - Deterministic takes away the randomness and is good for testing/comparing models because same input equals same output. - Storywriter-Llama2 is the Storywriter preset adjusted for Llama 2's 4K context size. It also works well against Llama 2's repetition/looping issues. 2023-08-01 21:41:34 +02:00			`"single_line": false,`
			`"sampler_order": [`
			`6,`
			`0,`
			`1,`
			`3,`
			`4,`
			`2,`
			`5`
			`]`
			`}`