Commit Graph

355 Commits

Author SHA1 Message Date
kingbri f31b996cb5 Text Generation: Add TabbyAPI support
TabbyAPI is an exllamav2 only API server that aims to provide a simple
experience for loading and chatting with exl2 models.

SillyTavern currently doesn't have the ability to load and unload models,
so only add the OAI compatible completion endpoints.

The repository can be found here:
https://github.com/theroyallab/tabbyAPI

Signed-off-by: kingbri <bdashore3@proton.me>
2023-11-17 00:37:39 -05:00
Cohee 323b338cdd Add images to quiet prompts if inlining enabled 2023-11-17 01:30:32 +02:00
Cohee e753246373 Add NAI Diffusion 3 model 2023-11-16 02:15:28 +02:00
Cohee 3fb26d3927 Add lazy loading of sentencepiece tokenizers 2023-11-15 19:39:55 +02:00
Tony Ribeiro a261c163a5 merging change to live2d assets listing 2023-11-13 23:22:19 +01:00
Tony Ribeiro 9169938448 Fix listing of live2d model file for non-model3 type models. 2023-11-13 23:20:36 +01:00
Cohee 5fe8f70eb1 #1345 Add API endpoint for web search interaction 2023-11-14 00:16:41 +02:00
Cohee aeac56c95d Reformat assets.js code 2023-11-12 23:02:07 +02:00
Tony Ribeiro f082420fc7 Use cross os separator for live2d assets path 2023-11-12 19:25:13 +01:00
Tony Ribeiro c5ea3cfce7 normalize path of live2d assets 2023-11-12 19:21:01 +01:00
Tony Ribeiro e7e4f75c86 fix new live2d asset listing for character folder. 2023-11-12 19:08:29 +01:00
Tony Ribeiro 7f8994c1fd update live2d assets detection to allow for subfolder organisation. 2023-11-12 18:56:01 +01:00
Cohee 6f061adc1e Add OpenAI TTS provider 2023-11-12 02:28:03 +02:00
Cohee 0cb9dc2f0b Don't send empty list of bad_word_ids to Novel 2023-11-10 15:07:19 +02:00
Cohee 1f89e5a02a Merge branch 'release' into staging 2023-11-09 23:30:12 +02:00
Cohee 0e89bf90bc Use correct tokenizers for logit bias for Mistral and Llama models over OpenRouter 2023-11-09 01:03:54 +02:00
Cohee 2d2ff5230c
Merge pull request #1318 from artisticMink/feature/bulk-edit-enhanced
Feature/bulk edit enhanced
2023-11-07 20:47:06 +02:00
Cohee 2639548bdb Adjustable caption prompt and template 2023-11-07 01:58:34 +02:00
Cohee 9698c94ee2 #1324 Add captions via OpenAI and Horde 2023-11-07 01:28:46 +02:00
Cohee 1896732f17 Add DALL-E to OpenAI plugin 2023-11-06 21:47:00 +02:00
artisticMink c584da2ea9 Accept both v1 and v2 spec for editcharacterattributes endpoint 2023-11-06 16:13:34 +01:00
artisticMink 42d838a0b3 Refactor TavernCardValidator error property 2023-11-06 16:13:34 +01:00
artisticMink 6eb6527d11 Prototyping 2023-11-06 16:13:34 +01:00
Cohee e8ba328a14 Add text chunks display to token counter 2023-11-06 02:42:51 +02:00
Cohee f248367ca3 Add Mistral tokenizer 2023-11-06 01:26:13 +02:00
Cohee f0c0949aa0 Add token ids viewer to tokenizer plugin 2023-11-05 22:45:37 +02:00
Cohee 21e0a42060 Fix arch in models list, remove log 2023-11-05 22:03:20 +02:00
Cohee fedc3b887f Add llama2 tokenizer for OpenRouter models 2023-11-05 21:54:19 +02:00
RossAscends 75c6e74d41 support for min P on Kobold API 2023-11-02 14:53:57 +09:00
yuxiang 0921cd6b9c fix the Chinese translation parameter error of deeplx 2023-10-30 22:31:52 +08:00
yuxiang de77abe152 Merge branch 'release' of https://github.com/SillyTavern/SillyTavern into release
# Conflicts:
#	src/translate.js
2023-10-30 22:10:27 +08:00
yuxiang 31c5036724 Merge branch 'release' of https://github.com/SillyTavern/SillyTavern into release
# Conflicts:
#	src/translate.js
2023-10-30 21:58:10 +08:00
Cohee 853cf20e6e Remove unreliable check for git installed
It will fail anyway if not installed
2023-10-29 23:46:56 +02:00
Cohee ea36d34942 Remove unreliable check for git installed
It will fail anyway if not installed
2023-10-29 23:46:13 +02:00
Cohee 0c36d113bf Add git disclaimer to asset downloader 2023-10-27 13:07:56 +03:00
Cohee 5dbe2ebf29 Add chat file backups 2023-10-24 22:09:55 +03:00
Tony Ribeiro 2b40fc7e76 Use proper path function for live2d asset of character folder 2023-10-24 15:44:40 +02:00
Tony Ribeiro 141850eda5
Merge branch 'SillyTavern:staging' into staging 2023-10-24 14:23:45 +02:00
Cohee e082138c18 Do shallow clone to speed-up extension installs 2023-10-23 13:27:04 +03:00
Cohee 9a647b96df Add error logging to SD generate endpoint 2023-10-23 13:03:01 +03:00
Tony Ribeiro 4bc2d7f6ac Add management of live2d model in assets folder. 2023-10-22 19:21:10 +02:00
Cohee c4e6b565a5 Add SD prompt expansion 2023-10-20 15:03:26 +03:00
Cohee b167eb9e22 Add raw token ids support to OAI logit bias. Fix token counting for turbo models 2023-10-19 13:37:08 +03:00
Tony Ribeiro 2149bee87f Add handling of multiple live2d asset per character 2023-10-19 00:36:19 +02:00
Tony Ribeiro 1dd747a24d
Merge branch 'SillyTavern:staging' into staging 2023-10-17 20:18:29 +02:00
Cohee 2a16d24760 Increase 0301 padding 2023-10-16 02:21:27 +03:00
Cohee 02dca52948 Add extra padding for 0301 turbo model. 2023-10-16 01:21:14 +03:00
Tony Ribeiro 2f3ded734f Added live2d asset category to allowed character assets. 2023-10-14 04:35:09 +02:00
Tony Ribeiro 93d1a264da Add official blip asset management. 2023-10-10 01:51:09 +02:00
Cohee 4f80085fa3 Add sanitation of Stable Horde prompts 2023-10-08 22:29:33 +03:00
Cohee 5a570ff283 Merge branch 'staging' of https://github.com/SillyTavern/SillyTavern into staging 2023-10-07 18:30:19 +03:00
Cohee 1dd6fa4b6a Add Sd.next source 2023-10-07 18:30:06 +03:00
Cohee 2f294b9f2b [chore] Reformat code 2023-10-06 15:55:11 +03:00
yuxiang 0b8295926e add bing translate 2023-10-06 15:51:04 +03:00
yuxiang 76507963d7 add bing translate 2023-10-06 19:39:03 +08:00
Cohee 165997c791 #1199 I'm not even sure anymore 2023-09-30 15:42:37 +03:00
Cohee bb47712696 Split oobabooga/mancer sources. Add aphrodite support 2023-09-28 19:10:00 +03:00
theunstableman 8f426a0184
[FIXED] Add PaLM vectorization source (#1182)
* Add PaLM vectorization source

* FIX

* Add API key check. Fix comment

---------

Co-authored-by: Cohee <18619528+Cohee1207@users.noreply.github.com>
2023-09-25 15:29:28 +03:00
Cohee a081f78bd8 (WIP) PaLM API 2023-09-23 20:48:56 +03:00
Cohee 2e5bbf0445 Fix server crash on local captioning 2023-09-22 23:04:26 +03:00
Maks 158aa79aed
add model gpt-3.5-turbo-instruct and 0914 variant (#1154) 2023-09-19 23:50:27 +03:00
Cohee 11e7ca76e1 Use simpleGit to get app version 2023-09-17 14:27:41 +03:00
Cohee dc1121b72a Remove tensorflow vector source. 2023-09-17 14:09:24 +03:00
Cohee 2c84c93f3d Add thumbnails quality config 2023-09-16 21:53:30 +03:00
Cohee bfdd071001 Move tokenizer endpoint and functions to separate file 2023-09-16 18:48:06 +03:00
Cohee ab9aa28fe4 Move missed endpoints 2023-09-16 18:03:31 +03:00
Cohee 61995bb33f Move preset management into a separate file 2023-09-16 17:36:54 +03:00
Cohee 38b63b07f5 Extract sprite and custom content endpoints to a separate files. Update constants references 2023-09-16 17:28:28 +03:00
Cohee 4e1630c17d Extract endpoints for secrets and assets to separate files 2023-09-16 16:39:07 +03:00
Cohee 6e562bd1ff Extract server endpoints for thumbnails and extensions into separate files 2023-09-16 16:16:48 +03:00
Cohee 599904d589 Move NovelAI endpoints to separate file 2023-09-15 17:54:13 +03:00
Cohee 0f1a0963fd Merge branch 'release' into staging 2023-09-15 15:06:13 +03:00
Cohee 2b3055a84a Webp cards format is no longer supported 2023-09-15 14:56:15 +03:00
Cohee 6ad786f348 Add alternative local vectors source.
x5 speed boost!!
2023-09-14 23:40:13 +03:00
Cohee 0cc048cb64 Refactor transformers.js usage 2023-09-14 23:12:33 +03:00
Cohee cb8d9ac71b Unset SD gen timeout 2023-09-14 21:49:29 +03:00
Cohee 179de92231 Use transformers WASM binaries from a local folder 2023-09-14 14:11:37 +03:00
mweldon e74090139c
Add copy to clipboard button on prompt itemization popup (#1124)
* Add copy to clipboard button on prompt itemization popup

* Minor fix for NovelAI Summarize and new bad words
2023-09-13 11:52:37 +03:00
Cohee 66ec17620f Move Horde and SD endpoints into separate files 2023-09-12 20:45:36 +03:00
Cohee f149fc9aaa Endpoint for local captioning pipeline 2023-09-11 04:47:14 +03:00
Cohee 7aeb098212 Fix config access. Add Top K to classification results 2023-09-11 01:49:47 +03:00
Cohee c76c76410c Add ability to override local classification model 2023-09-11 01:25:22 +03:00
Cohee d19c151669 Add DeepLX translation provider #1111 2023-09-10 18:53:52 +03:00
Cohee 70071312d3 Add OneRingTranslator #521 2023-09-10 17:27:50 +03:00
Cohee ec23356c99 Move translation endpoints into a separate file 2023-09-10 16:41:36 +03:00
Cohee af38971a01 Delete vectors on deleting chats 2023-09-09 22:15:47 +03:00
Cohee 4cf6a1f7da Cache and sample classification results 2023-09-09 17:31:27 +03:00
Cohee 180dcefe40 Patch onnx to always use wasm 2023-09-09 16:55:54 +03:00
Cohee 307e666c27 onnx runtime to web 2023-09-09 16:42:16 +03:00
Cohee b605b940eb Replace transformers.js with patched version 2023-09-09 16:29:11 +03:00
Cohee 967a084aad (WIP) Local emotion classification pipeline 2023-09-09 15:14:16 +03:00
Cohee a5acc7872d Add OpenAI vector source. 2023-09-08 13:57:27 +03:00
Cohee 96df705409 Change insertion strategy to an extension block 2023-09-08 01:26:26 +03:00
Cohee 9d45c0a018 Add UI plugin for vectors 2023-09-08 00:28:06 +03:00
Cohee 8c00f38a1f Add local vectors storage 2023-09-07 21:53:47 +03:00
Cohee 853736fa93 Remove legacy NovelAI models 2023-09-06 14:32:06 +03:00
Cohee 49b60e8dfb Ban {{}} sequence for Novel 2023-09-03 23:25:38 +03:00
Cohee 9660aaa2c2 Add NovelAI hypebot plugin 2023-08-27 18:27:34 +03:00
Cohee 48924d3696 Improve asset downloader 2023-08-24 22:47:07 +03:00
Cohee 72974d8a54 More clear message for character import failure 2023-08-01 18:13:50 +03:00
Mike Weldon 73ea029acd Fix rep penalty parameter name 2023-07-30 14:14:17 -07:00
Mike Weldon 27c6e5ecff Fix some presets, bad words, rep allowlist, and banned tokens 2023-07-30 14:03:28 -07:00
Cohee 053dbbd25c Onboarding experience and new default user avatar 2023-07-21 16:42:18 +03:00
Cohee b05d501f82 Add default content by contest winners 2023-07-21 15:28:32 +03:00
Cohee edd41989fd Initial commit 2023-07-20 20:32:15 +03:00