mirror of
https://github.com/SillyTavern/SillyTavern.git
synced 2025-06-05 21:59:27 +02:00
Merge pull request #134 from gidzzz/main
This commit is contained in:
@ -1,6 +1,6 @@
|
|||||||
<html>
|
<html>
|
||||||
<head>
|
<head>
|
||||||
<title>TavernAI - Note - Character Derscriptions</title>
|
<title>TavernAI - Note - Character Descriptions</title>
|
||||||
<link rel="stylesheet" href="/css/notes.css">
|
<link rel="stylesheet" href="/css/notes.css">
|
||||||
<meta charset="utf-8">
|
<meta charset="utf-8">
|
||||||
<meta name="viewport" content="width=device-width, initial-scale=1">
|
<meta name="viewport" content="width=device-width, initial-scale=1">
|
||||||
@ -22,7 +22,7 @@
|
|||||||
<p>
|
<p>
|
||||||
For most Kobold's models the easiest way is to use a free form for description, and in each sentence it is desirable to specify the name of the character.<br><br>
|
For most Kobold's models the easiest way is to use a free form for description, and in each sentence it is desirable to specify the name of the character.<br><br>
|
||||||
The entire description should be in one line without hyphenation.<br><br>
|
The entire description should be in one line without hyphenation.<br><br>
|
||||||
For examle:<br><br>
|
For example:<br><br>
|
||||||
<code>
|
<code>
|
||||||
Chloe is a female elf. Chloe wears black-white maid dress with green collar and red glasses. Chloe has medium length black hair. Chloe's personality is...
|
Chloe is a female elf. Chloe wears black-white maid dress with green collar and red glasses. Chloe has medium length black hair. Chloe's personality is...
|
||||||
</code>
|
</code>
|
||||||
@ -33,11 +33,10 @@
|
|||||||
Details here: <a target="_blank" href="https://github.com/KoboldAI/KoboldAI-Client/wiki/Pro-Tips">Pro-Tips</a>
|
Details here: <a target="_blank" href="https://github.com/KoboldAI/KoboldAI-Client/wiki/Pro-Tips">Pro-Tips</a>
|
||||||
</p>
|
</p>
|
||||||
<hr>
|
<hr>
|
||||||
<br>
|
|
||||||
<p>
|
<p>
|
||||||
<u>A list of tags that are replaced when sending to generate:</u><br><br>
|
<u>A list of tags that are replaced when sending to generate:</u><br><br>
|
||||||
{{user}} and <USER> : replaced by the User's Name<br>
|
{{user}} and <USER> are replaced by the User's Name<br>
|
||||||
{{char}} and <BOT> : replaced by the Character's Name
|
{{char}} and <BOT> are replaced by the Character's Name
|
||||||
</p>
|
</p>
|
||||||
</div>
|
</div>
|
||||||
</div>
|
</div>
|
||||||
|
@ -13,7 +13,7 @@
|
|||||||
<div id="content">
|
<div id="content">
|
||||||
<h2>Chat import</h2>
|
<h2>Chat import</h2>
|
||||||
<h3>Import chats into TavernAI</h3>
|
<h3>Import chats into TavernAI</h3>
|
||||||
<p>For import Character.ai chats use tool: <a href="https://github.com/0x000011b/characterai-dumper">https://github.com/0x000011b/characterai-dumper</a></p>
|
<p>To import Character.AI chats, use this tool: <a href="https://github.com/0x000011b/characterai-dumper">https://github.com/0x000011b/characterai-dumper</a>.</p>
|
||||||
</div>
|
</div>
|
||||||
</div>
|
</div>
|
||||||
</body>
|
</body>
|
||||||
|
@ -21,10 +21,12 @@
|
|||||||
<br><br><START><br>
|
<br><br><START><br>
|
||||||
{{user}}: Hello<br>
|
{{user}}: Hello<br>
|
||||||
{{char}}: *excitedly* Hello there, dear! Are you new to Axel? Don't worry, I, Aqua the goddess of water, am here to help you! Do you need any assistance? And may I say, I look simply radiant today! *strikes a pose and looks at you with puppy eyes*</p>
|
{{char}}: *excitedly* Hello there, dear! Are you new to Axel? Don't worry, I, Aqua the goddess of water, am here to help you! Do you need any assistance? And may I say, I look simply radiant today! *strikes a pose and looks at you with puppy eyes*</p>
|
||||||
<hr><br>A list of tags that are replaced when sending to generate:<br><br>
|
<hr>
|
||||||
{{user}} and <USER> are replaced by User Name<br>
|
<p>
|
||||||
{{char}} and <BOT> are replaced by Character Name<br><br>
|
<u>A list of tags that are replaced when sending to generate:</u><br><br>
|
||||||
*for Pygmalion "{{user}}:" and "<USER>:" will be replaced by "You:"
|
{{user}} and <USER> are replaced by the User's Name<br>
|
||||||
|
{{char}} and <BOT> are replaced by the Character's Name
|
||||||
|
</p>
|
||||||
</div>
|
</div>
|
||||||
</div>
|
</div>
|
||||||
</body>
|
</body>
|
||||||
|
@ -18,8 +18,8 @@
|
|||||||
<hr>
|
<hr>
|
||||||
<p>
|
<p>
|
||||||
<u>A list of tags that are replaced when sending to generate:</u><br><br>
|
<u>A list of tags that are replaced when sending to generate:</u><br><br>
|
||||||
{{user}} and <USER> : replaced by User Name<br>
|
{{user}} and <USER> are replaced by the User's Name<br>
|
||||||
{{char}} and <BOT> : replaced by Character Name<br><br>
|
{{char}} and <BOT> are replaced by the Character's Name
|
||||||
</p>
|
</p>
|
||||||
</div>
|
</div>
|
||||||
</div>
|
</div>
|
||||||
|
@ -64,7 +64,7 @@
|
|||||||
Comment
|
Comment
|
||||||
</h3>
|
</h3>
|
||||||
<p>
|
<p>
|
||||||
A supplemental text comment for the your convenience, which is not utilized by the AI.
|
A supplemental text comment for your convenience, which is not utilized by the AI.
|
||||||
</p>
|
</p>
|
||||||
<h3>
|
<h3>
|
||||||
Constant
|
Constant
|
||||||
|
@ -13,7 +13,7 @@
|
|||||||
<div id="content">
|
<div id="content">
|
||||||
<h2>Personality summary</h2>
|
<h2>Personality summary</h2>
|
||||||
<p>
|
<p>
|
||||||
A brief description of the personality. It is added to the chat to a depth of 8-15 messages, so it has a significant impact on the character.
|
A brief description of the personality. It is added to the chat at a depth of 8-15 messages, so it has a significant impact on the character.
|
||||||
</p>
|
</p>
|
||||||
|
|
||||||
Example:
|
Example:
|
||||||
@ -26,13 +26,11 @@
|
|||||||
|
|
||||||
<p>*In Pygmalion model, it is used as a "Personality:" graph</p>
|
<p>*In Pygmalion model, it is used as a "Personality:" graph</p>
|
||||||
<hr>
|
<hr>
|
||||||
|
|
||||||
<p>
|
<p>
|
||||||
<u>List of tags that are replaced when sending to generate:</u><br><br>
|
<u>A list of tags that are replaced when sending to generate:</u><br><br>
|
||||||
{{user}} and <USER> : replaced by the User's Name<br>
|
{{user}} and <USER> are replaced by the User's Name<br>
|
||||||
{{char}} and <BOT> : replaced by the Character's Name<br><br>
|
{{char}} and <BOT> are replaced by the Character's Name
|
||||||
</p>
|
</p>
|
||||||
|
|
||||||
</div>
|
</div>
|
||||||
</div>
|
</div>
|
||||||
</body>
|
</body>
|
||||||
|
@ -21,15 +21,15 @@
|
|||||||
For example:
|
For example:
|
||||||
<br><br>
|
<br><br>
|
||||||
<code>
|
<code>
|
||||||
*I noticed you came inside, I walked up and stood right in front of you* Wellcome. I'm glad to see you here.
|
*I noticed you came inside, I walked up and stood right in front of you* Welcome. I'm glad to see you here.
|
||||||
*i said with toothy smug sunny smile looking you straight in the eye* What brings you...
|
*I said with toothy smug sunny smile looking you straight in the eye* What brings you...
|
||||||
</code>
|
</code>
|
||||||
<Br>
|
<Br>
|
||||||
<hr>
|
<hr>
|
||||||
<p>
|
<p>
|
||||||
A list of tags that are replaced when sending to generate:<br><br>
|
<u>A list of tags that are replaced when sending to generate:</u><br><br>
|
||||||
{{user}} and <USER> are replaced by User Name<br>
|
{{user}} and <USER> are replaced by the User's Name<br>
|
||||||
{{char}} and <BOT> are replaced by Character Name<br><br>
|
{{char}} and <BOT> are replaced by the Character's Name
|
||||||
</p>
|
</p>
|
||||||
</div>
|
</div>
|
||||||
</div>
|
</div>
|
||||||
|
@ -30,11 +30,11 @@
|
|||||||
<h3>Repetition penalty range</h3>
|
<h3>Repetition penalty range</h3>
|
||||||
<p>The range of influence of Repetition penalty in tokens.</p>
|
<p>The range of influence of Repetition penalty in tokens.</p>
|
||||||
<h3>Amount generation</h3>
|
<h3>Amount generation</h3>
|
||||||
<p>The maximum amount of tokens that a AI will generate to respond. One word is approximately 3-4 tokens.
|
<p>The maximum amount of tokens that the AI will generate to respond. One word is approximately 3-4 tokens.
|
||||||
The larger the parameter value, the longer the generation time takes.</p>
|
The larger the parameter value, the longer the generation time takes.</p>
|
||||||
<h3>Context size</h3>
|
<h3>Context size</h3>
|
||||||
<p>How much will the AI remember. Context size also affects the speed of generation.<br><br>
|
<p>How much will the AI remember. Context size also affects the speed of generation.<br><br>
|
||||||
<u>Important</u>: The setting of Context Size in TavernAI GUI override setting for KoboldAI GUI
|
<u>Important</u>: The setting of Context Size in TavernAI GUI overrides the setting for KoboldAI GUI
|
||||||
</p>
|
</p>
|
||||||
|
|
||||||
<h2>Advanced Settings</h2>
|
<h2>Advanced Settings</h2>
|
||||||
@ -51,8 +51,8 @@
|
|||||||
<h3>Top P Sampling</h3>
|
<h3>Top P Sampling</h3>
|
||||||
<p>
|
<p>
|
||||||
This setting controls how much of the text generated is based on the most likely options.
|
This setting controls how much of the text generated is based on the most likely options.
|
||||||
The top P words with the highest probabilities are considered. A word is then chosen at random, with a
|
Only words with the highest probabilities, together summing up to P, are considered. A word is then
|
||||||
higher chance of selecting words with higher probabilities.
|
chosen at random, with a higher chance of selecting words with higher probabilities.
|
||||||
</p>
|
</p>
|
||||||
<p>
|
<p>
|
||||||
Set value to 1 to disable its effect.
|
Set value to 1 to disable its effect.
|
||||||
|
@ -1,23 +0,0 @@
|
|||||||
<html>
|
|
||||||
<head>
|
|
||||||
<title>TavernAI - Note - Temperature</title>
|
|
||||||
<link rel="stylesheet" href="/css/notes.css">
|
|
||||||
<meta charset="utf-8">
|
|
||||||
<meta name="viewport" content="width=device-width, initial-scale=1">
|
|
||||||
<link rel="preconnect" href="https://fonts.googleapis.com">
|
|
||||||
<link rel="preconnect" href="https://fonts.gstatic.com" crossorigin="">
|
|
||||||
<link href="https://fonts.googleapis.com/css2?family=Noto+Sans:ital,wght@0,100;0,200;0,300;0,400;0,500;0,600;0,700;0,800;0,900;1,100;1,200;1,300;1,400;1,500;1,600;1,700;1,800;1,900&display=swap" rel="stylesheet">
|
|
||||||
</head>
|
|
||||||
<body>
|
|
||||||
<div id="main">
|
|
||||||
<div id="content">
|
|
||||||
<h2>Temperature</h2>
|
|
||||||
<p>
|
|
||||||
Value from 0.1 to 2.0.<br><br>
|
|
||||||
Less value - the answers are more logical, but less creative.<Br><br>
|
|
||||||
More value - the answers are more creative, but less logical.
|
|
||||||
</p>
|
|
||||||
</div>
|
|
||||||
</div>
|
|
||||||
</body>
|
|
||||||
</html>
|
|
@ -12,7 +12,7 @@
|
|||||||
<div id="main">
|
<div id="main">
|
||||||
<div id="content">
|
<div id="content">
|
||||||
<h2>NovelAI Models</h2>
|
<h2>NovelAI Models</h2>
|
||||||
<p>If your subscribe tier is Paper, Tablet or Scroll use only Euterpe model otherwise you can not get an answer from NovelAI api.</p>
|
<p>If your subscription tier is Paper, Tablet or Scroll use only Euterpe model otherwise you can not get an answer from NovelAI API.</p>
|
||||||
</div>
|
</div>
|
||||||
</div>
|
</div>
|
||||||
</body>
|
</body>
|
||||||
|
@ -17,7 +17,7 @@
|
|||||||
There are two types of anchors: <u>Character Anchor</u> and <u>Style Anchor</u>
|
There are two types of anchors: <u>Character Anchor</u> and <u>Style Anchor</u>
|
||||||
</p>
|
</p>
|
||||||
<p>
|
<p>
|
||||||
<u>Character Anchor</u> - affects the character played by the AI by motivating him to write longer messages.<br><br>
|
<u>Character Anchor</u> - affects the character played by the AI by motivating it to write longer messages.<br><br>
|
||||||
Looks like:
|
Looks like:
|
||||||
<code>[Elaborate speaker]</code>
|
<code>[Elaborate speaker]</code>
|
||||||
</p>
|
</p>
|
||||||
@ -31,10 +31,10 @@
|
|||||||
Anchors Order sets the location of anchors in the promt, the first anchor in the order is much further back in the context and thus has less influence than second.
|
Anchors Order sets the location of anchors in the promt, the first anchor in the order is much further back in the context and thus has less influence than second.
|
||||||
</p>
|
</p>
|
||||||
<p>
|
<p>
|
||||||
The second anchor is only turned on after 8-12 messages, because when the chat still only has a few message the first anchor creates enough effect ob its own.
|
The second anchor is only turned on after 8-12 messages, because when the chat still only has a few messages, the first anchor creates enough effect on its own.
|
||||||
</p>
|
</p>
|
||||||
<p>
|
<p>
|
||||||
Sometimes an AI model may not perceive anchors correctly or the AI model already generates sufficiently long messages.<br>
|
Sometimes an AI model may not perceive anchors correctly or the AI model already generates sufficiently long messages.
|
||||||
For these cases, you can disable the anchors by unchecking their respective boxes.
|
For these cases, you can disable the anchors by unchecking their respective boxes.
|
||||||
</p>
|
</p>
|
||||||
<p>
|
<p>
|
||||||
|
@ -17,8 +17,8 @@
|
|||||||
<div id="content">
|
<div id="content">
|
||||||
<h2>Advanced Formatting</h2>
|
<h2>Advanced Formatting</h2>
|
||||||
<p>
|
<p>
|
||||||
The settings provided in this section allow for a more control over the prompt building strategy.
|
The settings provided in this section allow for more control over the prompt building strategy.
|
||||||
Most specifics of the prompt building depend on whether a Pygmalion model is selected or special formatting is force enabled.
|
Most specifics of the prompt building depend on whether a Pygmalion model is selected or special formatting is force-enabled.
|
||||||
The core differences between the formatting schemas are listed below.
|
The core differences between the formatting schemas are listed below.
|
||||||
</p>
|
</p>
|
||||||
<h3>Custom Chat Separator</h3>
|
<h3>Custom Chat Separator</h3>
|
||||||
@ -28,24 +28,24 @@
|
|||||||
<h3>For <u>Pygmalion</u> formatting</h3>
|
<h3>For <u>Pygmalion</u> formatting</h3>
|
||||||
<h4>Disable description formatting</h4>
|
<h4>Disable description formatting</h4>
|
||||||
<p>
|
<p>
|
||||||
<code><b>NAME's Persona: </b></code> won't be prepended to the content your character's Description box.
|
<code><b>NAME's Persona: </b></code> won't be prepended to the content of your character's Description box.
|
||||||
</p>
|
</p>
|
||||||
<h4>Disable scenario formatting</h4>
|
<h4>Disable scenario formatting</h4>
|
||||||
<p>
|
<p>
|
||||||
<code><b>Scenario: </b></code> won't be prepended to the content your character's Scenario box.
|
<code><b>Scenario: </b></code> won't be prepended to the content of your character's Scenario box.
|
||||||
</p>
|
</p>
|
||||||
<h4>Disable personality formatting</h4>
|
<h4>Disable personality formatting</h4>
|
||||||
<p>
|
<p>
|
||||||
<code><b>Personality: </b></code> won't be prepended to the content your character's Personality box.
|
<code><b>Personality: </b></code> won't be prepended to the content of your character's Personality box.
|
||||||
</p>
|
</p>
|
||||||
<h4>Disable example chats formatting</h4>
|
<h4>Disable example chats formatting</h4>
|
||||||
<p>
|
<p>
|
||||||
<code><START></code> is not added at the beginning of each example message block.<br>
|
<code><START></code> won't be added at the beginning of each example message block.<br>
|
||||||
<i>(If custom separator is not set)</i>
|
<i>(If custom separator is not set)</i>
|
||||||
</p>
|
</p>
|
||||||
<h4>Disable chat start formatting</h4>
|
<h4>Disable chat start formatting</h4>
|
||||||
<p>
|
<p>
|
||||||
<code><START></code> is not added before the between the character card and the chat log.<br>
|
<code><START></code> won't be added between the character card and the chat log.<br>
|
||||||
<i>(If custom separator is not set)</i>
|
<i>(If custom separator is not set)</i>
|
||||||
</p>
|
</p>
|
||||||
<h4>Always add character's name to prompt</h4>
|
<h4>Always add character's name to prompt</h4>
|
||||||
@ -59,25 +59,25 @@
|
|||||||
</p>
|
</p>
|
||||||
<h4>Disable scenario formatting</h4>
|
<h4>Disable scenario formatting</h4>
|
||||||
<p>
|
<p>
|
||||||
<code><b>Circumstances and context of the dialogue: </b></code> won't be prepended to the content your character's Scenario box.
|
<code><b>Circumstances and context of the dialogue: </b></code> won't be prepended to the content of your character's Scenario box.
|
||||||
</p>
|
</p>
|
||||||
<h4>Disable personality formatting</h4>
|
<h4>Disable personality formatting</h4>
|
||||||
<p>
|
<p>
|
||||||
<code><b>NAME's personality: </b></code> won't be prepended to the content your character's Personality box.
|
<code><b>NAME's personality: </b></code> won't be prepended to the content of your character's Personality box.
|
||||||
</p>
|
</p>
|
||||||
<h4>Disable example chats formatting</h4>
|
<h4>Disable example chats formatting</h4>
|
||||||
<p>
|
<p>
|
||||||
<code>This is how <b>Character</b> should talk</code> is not added at the beginning of each example message block.<br>
|
<code>This is how <b>Character</b> should talk</code> won't be added at the beginning of each example message block.<br>
|
||||||
<i>(If custom separator is not set)</i>
|
<i>(If custom separator is not set)</i>
|
||||||
</p>
|
</p>
|
||||||
<h4>Disable chat start formatting</h4>
|
<h4>Disable chat start formatting</h4>
|
||||||
<p>
|
<p>
|
||||||
<code>Then the roleplay chat between <b>User</b> and <b>Character</b> begins</code> is not added before the between the character card and the chat log.<br>
|
<code>Then the roleplay chat between <b>User</b> and <b>Character</b> begins</code> won't be added between the character card and the chat log.<br>
|
||||||
<i>(If custom separator is not set)</i>
|
<i>(If custom separator is not set)</i>
|
||||||
</p>
|
</p>
|
||||||
<h4>Always add character's name to prompt</h4>
|
<h4>Always add character's name to prompt</h4>
|
||||||
<p>
|
<p>
|
||||||
Appends character's name to the prompt to force model to complete the message as a character:
|
Appends character's name to the prompt to force the model to complete the message as the character:
|
||||||
</p>
|
</p>
|
||||||
|
|
||||||
<code>
|
<code>
|
||||||
|
@ -1,7 +1,7 @@
|
|||||||
<html>
|
<html>
|
||||||
|
|
||||||
<head>
|
<head>
|
||||||
<title>Advanced Formatting</title>
|
<title>Group reply order strategies</title>
|
||||||
<link rel="stylesheet" href="/css/notes.css">
|
<link rel="stylesheet" href="/css/notes.css">
|
||||||
<meta charset="UTF-8">
|
<meta charset="UTF-8">
|
||||||
<meta name="viewport" content="width=device-width, initial-scale=1.0">
|
<meta name="viewport" content="width=device-width, initial-scale=1.0">
|
||||||
|
@ -1,7 +1,7 @@
|
|||||||
<html>
|
<html>
|
||||||
|
|
||||||
<head>
|
<head>
|
||||||
<title>Advanced Settings</title>
|
<title>OpenAI API key</title>
|
||||||
<link rel="stylesheet" href="/css/notes.css">
|
<link rel="stylesheet" href="/css/notes.css">
|
||||||
<meta charset="UTF-8">
|
<meta charset="UTF-8">
|
||||||
<meta name="viewport" content="width=device-width, initial-scale=1.0">
|
<meta name="viewport" content="width=device-width, initial-scale=1.0">
|
||||||
|
@ -15,6 +15,7 @@
|
|||||||
<body>
|
<body>
|
||||||
<div id="main">
|
<div id="main">
|
||||||
<div id="content">
|
<div id="content">
|
||||||
|
<h2>Gradio Streaming Function ID</h2>
|
||||||
<p>
|
<p>
|
||||||
To use streaming with Text Generation Web UI, a Gradio function index needs to be provided.
|
To use streaming with Text Generation Web UI, a Gradio function index needs to be provided.
|
||||||
It is impossible to be determined programmatically and should be typed in manually.
|
It is impossible to be determined programmatically and should be typed in manually.
|
||||||
|
@ -15,7 +15,7 @@
|
|||||||
<div id="content">
|
<div id="content">
|
||||||
<h2>Character Tokens</h2>
|
<h2>Character Tokens</h2>
|
||||||
|
|
||||||
<p><b>TLDR: If you're working with an AI model with a 2048 context token limit, your 1000 token character definition is cutting the AI's 'memory' in half.</b></p>
|
<p><b>TL;DR: If you're working with an AI model with a 2048 context token limit, your 1000 token character definition is cutting the AI's 'memory' in half.</b></p>
|
||||||
<p>To put this in perspective, a decent response from a good AI can easily be around 200-300 tokens. In this case, the AI would only be able to 'remember' about 3 exchanges worth of chat history.</p>
|
<p>To put this in perspective, a decent response from a good AI can easily be around 200-300 tokens. In this case, the AI would only be able to 'remember' about 3 exchanges worth of chat history.</p>
|
||||||
<hr>
|
<hr>
|
||||||
|
|
||||||
@ -23,7 +23,7 @@
|
|||||||
<p>When we see your character has over 1000 tokens in its definitions, we highlight it for you because this can lower the AI's capabilities to provide an enjoyable conversation.</p>
|
<p>When we see your character has over 1000 tokens in its definitions, we highlight it for you because this can lower the AI's capabilities to provide an enjoyable conversation.</p>
|
||||||
|
|
||||||
<h3>What happens if my Character has too many tokens?</h3>
|
<h3>What happens if my Character has too many tokens?</h3>
|
||||||
<p>Don't Worry - it won't break anything. At worst, if the Character's permanent tokens are too large, it simply means there will be less room left in the context for other things (see below).</p>
|
<p>Don't worry - it won't break anything. At worst, if the Character's permanent tokens are too large, it simply means there will be less room left in the context for other things (see below).</p>
|
||||||
<p>The only negative side effect this can have is the AI will have less 'memory', as it will have less chat history available to process.</p>
|
<p>The only negative side effect this can have is the AI will have less 'memory', as it will have less chat history available to process.</p>
|
||||||
<p>This is because every AI model has a limit to the amount of context it can process at one time.</p>
|
<p>This is because every AI model has a limit to the amount of context it can process at one time.</p>
|
||||||
<h3>'Context'?</h3>
|
<h3>'Context'?</h3>
|
||||||
|
Reference in New Issue
Block a user