SillyTavern/public/instruct/Llama2.json

{
    "name": "Llama 2",
    "system_prompt": "Write {{char}}'s next reply in this fictional roleplay with {{user}}.\n<</SYS>>\n",
    "system_sequence": "[INST] <<SYS>>\n",
    "stop_sequence": "",
    "input_sequence": "[INST]",
    "output_sequence": "[/INST]",
    "last_output_sequence": "",
    "separator_sequence": "\n",
    "wrap": false
}
Created Llama2 instruct preset Tested on Llama 2 13B chat model provided by TheBloke. Based on these prompt example: https://huggingface.co/TheBloke/Llama-2-13B-chat-GPTQ#prompt-template-llama-2-chat 2023-07-22 13:24:17 +06:00			`{`
			`"name": "Llama 2",`
Fixed tags order in Llama2 instruct preset I didn't notice that the prompt wording implies impersonation, which is incorrect for common usage. Changed the order of tags used to generate the character's response to the user, rather than the vice versa. 2023-07-22 21:31:44 +06:00			`"system_prompt": "Write {{char}}'s next reply in this fictional roleplay with {{user}}.\n<</SYS>>\n",`
Created Llama2 instruct preset Tested on Llama 2 13B chat model provided by TheBloke. Based on these prompt example: https://huggingface.co/TheBloke/Llama-2-13B-chat-GPTQ#prompt-template-llama-2-chat 2023-07-22 13:24:17 +06:00			`"system_sequence": "[INST] <<SYS>>\n",`
			`"stop_sequence": "",`
			`"input_sequence": "[INST]",`
			`"output_sequence": "[/INST]",`
Add Last output sequence setting for instruct mode 2023-08-17 23:33:27 +03:00			`"last_output_sequence": "",`
Created Llama2 instruct preset Tested on Llama 2 13B chat model provided by TheBloke. Based on these prompt example: https://huggingface.co/TheBloke/Llama-2-13B-chat-GPTQ#prompt-template-llama-2-chat 2023-07-22 13:24:17 +06:00			`"separator_sequence": "\n",`
			`"wrap": false`
			`}`