2022-12-22 08:16:36 +04:00
2022-12-22 07:22:29 +04:00
2022-12-22 07:22:29 +04:00
2022-12-22 07:22:29 +04:00
2022-12-22 07:22:29 +04:00
2022-12-22 07:22:29 +04:00
2022-12-22 08:16:36 +04:00
2022-12-22 07:22:29 +04:00
2022-12-22 07:22:29 +04:00

TavernAI is a adventure chat shell for AI language models


Features

TavernAI helps the AI model is in the chat format and makes the answers longer. In most cases, the shell fixes the problem when the model tries to answer for the user. Through the interface, you can also easily create/edit characters and change the background on the fly.

Setup

  1. Download and Install Node.js v19.1.0
  2. Run Start.bat or use command: node server.js

Connecting to API

KoboldAI

To use KoboldAI install it locally, or run it through Google Colab. Details: KoboldAI

Compatibility

Tested on Windows 7/10 x64 (FireFox 108.0, Google Chrome 108.0, Microsoft Edge 108.0)

Additionally Tips

If the message is not finished, you can simply send the request again, TavernAI will understand that this is a continuation.


Later, it is planned to make TavernAI combine such messages into one.

KoboldAI Settings

In most cases, you can use available presets in TavernAI for any models, making minimal changes. Later they will be calibrated more accurately for each model.

It is recommended either not to use Repetition Penalty at all, or to set the minimum value in the region of 1.01 - 1.05 for small models. Also, highly strict sample settings force the AI to answer less long and more monosyllabic messages. Accordingly, settings with minimal sampling will produce longer, but less logical messages.

It's a little harder for Nerys to understand the chat format than Erebus models.

What's next?

  • Ability to create an examples of a character's messages
  • Wildcards for characters
  • Ability to edit all messages
  • Displaying whether a message is in context or not
  • Access for many chats for one character
  • Design presets

Donation

BTC 1LASziomyYNkZ2zk8Sa4ZLTkvczBMrjyjP
ETH 0x975E5C91042ce8168B3d37b17F99949c5eFB3Dfe
TRX TCiBKCt6xEGrsjpgQA2jDXWJLyUh1KN2Sn


Description
LLM Frontend for Power Users.
Readme AGPL-3.0 351 MiB
Languages
JavaScript 87.3%
HTML 9.3%
CSS 2.9%
Less 0.3%