Commit Graph

36 Commits

Author SHA1 Message Date
sasha0552
2bd239fe81
Initial vLLM support 2024-05-02 22:40:40 +00:00
Cohee
27698fd024 Add ability to get model name with /model 2024-04-03 00:52:30 +03:00
DreamGenX
5c410986a4 Add support for DreamGen API.
API docs: https://dreamgen.com/docs/models/opus/v1
API keys: https://dreamgen.com/account/api-keys

I decided to base this on the text-completion API since it's more
flexible with SillyTavern's prompt formating capabilities.

This also means that custom context and instruct settings are required.

Will add documentation in a followup PR.
2024-03-07 12:25:48 +01:00
Cohee
95c49029f7 Add aphrodite model selector 2024-03-01 23:02:43 +02:00
Cohee
184fd1622f Limit to ooba only. Exclude from presets 2024-02-29 11:33:47 +02:00
Cohee
f962ad5c02 Add OpenRouter as a text completion source 2024-02-25 22:47:07 +02:00
Cohee
f966c398ef Increase preset command timeouts 2024-01-18 16:36:26 +02:00
Cohee
5f93c30a96 #1627 Bypass status check and custom model for textgen type 2024-01-05 19:15:07 +02:00
Cohee
dd661cf879 Instruct "Bind to context" is now an option 2023-12-21 15:12:30 +02:00
Cohee
c212a71425 Fix ignore list of preset manager 2023-12-20 15:51:00 +02:00
Cohee
a91f0f7ee5 Fix saving presets after deletion of the same name 2023-12-17 21:02:32 +02:00
Cohee
9176f46caf Add /preset command 2023-12-12 19:14:17 +02:00
valadaptive
9c33ddbafc Make textgen settings type checks more concise 2023-12-03 14:56:01 -05:00
Cohee
40b132176d Add preset restoration 2023-12-03 17:16:33 +02:00
Cohee
64a3564892 lint: Comma dangle 2023-12-02 22:06:57 +02:00
Cohee
c63cd87cc0 lint: Require semicolons 2023-12-02 21:11:06 +02:00
valadaptive
a37f874e38 Require single quotes 2023-12-02 13:04:51 -05:00
valadaptive
518bb58d5a Enable no-unused-vars lint
This is the big one. Probably needs thorough review to make sure I
didn't accidentally remove any setInterval or fetch calls.
2023-12-02 12:11:19 -05:00
valadaptive
c893e2165e Enable no-prototype-builtins lint 2023-12-02 12:10:31 -05:00
valadaptive
27e63a7a77 Enable no-case-declarations lint 2023-12-02 10:32:26 -05:00
Cohee
2c7b954a8d #1328 New API schema for ooba / mancer / aphrodite 2023-11-08 00:17:13 +02:00
Cohee
24f406917d Add seed to Kobold APi 2023-10-26 21:22:00 +03:00
kingbri
6e4236d5ee Presets: Add power user setting support
Settings such as adding character name, stopping strings, etc can be
preset specific. This change is mainly inspired because people (like myself)
often forget to change these settings after switching a preset, which
can cause weird responses from the model.

Signed-off-by: kingbri <bdashore3@proton.me>
2023-10-20 02:07:45 -04:00
Cohee
4f458ce93a Fix import of presets with spaces 2023-10-16 20:01:45 +03:00
SDS
5848ec498b
Assorted fixes and improvements (#1208)
* Kobold Presets fixed

* Help texts fixed

* Scale API for connectAPISlash

* Quick Reply checkboxes fixed

* New Instruct Mode Presets

* More date/time macros

* ChatML context template and instruct prompt format

* Mistral context template and instruct prompt format

* Removed use_default_badwordsids from kobold presets

* Renamed ChatML to Mistral-OpenOrca (ChatML)

* Renamed Mistral-OpenOrca (removed ChatML)

* Removed single_line from kobold presets

* Removed obsolete use_stop_sequence setting

* Ban EOS Token off by default

* Split AI Resp. Conf. in global and preset-specific settings

* Resolve conflicts

* Fix title

* Add translations for new help texts

* Fix i18n.json whitespace

* Make Mistral-OpenOrca system prompt more generic

* Renamed "Mistral-OpenOrca" to "ChatML" again

* More (UI) fixes and improvements

* Sendas hint fixed

---------

Co-authored-by: Cohee <18619528+Cohee1207@users.noreply.github.com>
2023-10-07 19:25:36 +03:00
Brian Dashore
bfda5a5492
Extra fixes (#1185) 2023-09-26 09:53:04 +03:00
Cohee
61995bb33f Move preset management into a separate file 2023-09-16 17:36:54 +03:00
Stefan Daniel Schwarz
3509e6b1d4 default context preset cannot be deleted 2023-08-26 14:52:23 +02:00
Stefan Daniel Schwarz
1d7165c047 context template preset manager 2023-08-26 12:09:47 +02:00
Cohee
c91ab3b5e0 Add Kobold tokenization to best match logic. Fix not being able to stop group chat regeneration 2023-08-24 21:23:35 +03:00
Cohee
07a9e493dc Fix preset saving stacking for instruct 2023-08-22 23:03:55 +03:00
Cohee
897ad28477 Apply preset manager for instruct presets 2023-08-21 00:56:53 +03:00
Cohee
6738ffe2a4 Add auto-select for instruct presets. Re-organize instruct mode code. Prepare for preset manager integration 2023-08-20 23:29:43 +03:00
Cohee
0f162c1803 Save Novel preamble to presets 2023-08-18 17:43:50 +03:00
Cohee
1f2394cada Apply preset manager for NovelAI 2023-08-16 21:43:38 +03:00
Cohee
130559d499 #746 Add preset manager for ooba/kobold 2023-07-23 23:52:31 +03:00