67dd52c21b
#1309 Ollama text completion backend
2023-12-19 16:38:11 +02:00
edd737e8bd
#371 Add llama.cpp inference server support
2023-12-18 22:38:28 +02:00
6e8104873e
#1569 Add logit bias for text completions
2023-12-18 18:57:10 +02:00
b0d9f14534
Re-add Together as a text completion source
2023-12-17 23:38:03 +02:00
5b3c96df50
Rename /textgenerationwebui endpoint
...
I'd like to migrate over to using "textgen" to mean text-generation APIs
in general, so I've renamed the /textgenerationwebui/* endpoints to
/backends/text-completions/*.
2023-12-12 16:40:14 -05:00
b0e7b73a32
Fix streaming processor error handler hooks
2023-12-08 02:01:08 +02:00
cdcd913805
Don't stream events if the API returned a 4xx code
2023-12-07 18:00:36 -05:00
5540c165cf
Refactor server-sent events parsing
...
Create one server-sent events stream class which implements the entire
spec (different line endings, chunking, etc) and use it in all the
streaming generators.
2023-12-07 18:00:36 -05:00
0a092629ce
Fix undefined variable reference
2023-12-03 23:24:39 +02:00
24ccef3aba
Fix "settings" variable being shadowed
2023-12-03 15:44:36 -05:00
9c33ddbafc
Make textgen settings type checks more concise
2023-12-03 14:56:01 -05:00
047c897ead
Remove is[API] functions
...
Just use an equality comparison. It's a bit longer, but only because
"textgenerationwebui_settings" is a long identifier.
2023-12-03 14:56:01 -05:00
ba54e3dea0
Replaces is_[api] params with api_type param
...
These were 5 mutually-exclusive booleans, which can be replaced with one
param that takes on 5 values, one for each API type.
2023-12-03 14:56:01 -05:00
939e938ba2
Disallow multiswipe for quiet gens
2023-12-03 20:56:25 +02:00
1786b0d340
#1403 Add Aphrodite multi-swipe
2023-12-03 20:40:09 +02:00
64a3564892
lint: Comma dangle
2023-12-02 22:06:57 +02:00
c63cd87cc0
lint: Require semicolons
2023-12-02 21:11:06 +02:00
a37f874e38
Require single quotes
2023-12-02 13:04:51 -05:00
60ac1aa1c7
Enable no-empty lint
2023-12-02 10:32:07 -05:00
61908935f5
Stop string for user-continue. Trim spaces after name2
2023-11-22 16:16:48 +02:00
ddbdceba64
Add sampler order for koboldcpp under text completions
2023-11-21 01:47:57 +02:00
1ebfddf07e
Use mistral and yi tokenizers for custom token bans
2023-11-21 01:04:27 +02:00
96caddfd71
Add koboldcpp as Text Completion source
2023-11-19 17:14:53 +02:00
f31b996cb5
Text Generation: Add TabbyAPI support
...
TabbyAPI is an exllamav2 only API server that aims to provide a simple
experience for loading and chatting with exl2 models.
SillyTavern currently doesn't have the ability to load and unload models,
so only add the OAI compatible completion endpoints.
The repository can be found here:
https://github.com/theroyallab/tabbyAPI
Signed-off-by: kingbri <bdashore3@proton.me>
2023-11-17 00:37:39 -05:00
f4630f9808
Add lastMessage macro. Substitute params in CFG negative prompts
2023-11-16 16:58:49 +02:00
61764a9a21
Change mancer base URL via debug menu
2023-11-13 11:13:39 +02:00
52c07e0895
setup Aphrodite-specific API flag handling
2023-11-13 16:36:01 +09:00
480099ee97
Mancer will work in legacy API mode. Remove Soft Prompt mentions.
2023-11-08 18:16:47 +02:00
738c1d82c4
Clarify legacy API notification
2023-11-08 17:54:08 +02:00
cbc0b41773
Prevent doubled legacy toast
2023-11-08 10:28:02 +02:00
b6d29d2980
Return force /api append for Legacy ooba with relaxed URL off
2023-11-08 10:25:49 +02:00
e76c18c104
Legacy ooba API compatibility shim
2023-11-08 10:13:28 +02:00
00c029a65a
only api format for ooba, more visible checkboxes
2023-11-08 14:08:51 +09:00
b2629d9718
Refactor status checks and indicators.
2023-11-08 02:52:03 +02:00
bda15ef007
Adjust aphro streaming error parser
2023-11-08 00:25:06 +02:00
2c7b954a8d
#1328 New API schema for ooba / mancer / aphrodite
2023-11-08 00:17:13 +02:00
a5b5dfdcb6
temperature last for ooba
2023-11-05 23:50:07 +09:00
937c5d7e5f
Min P for Ooba, fix preset loading for ZenSliders
2023-11-05 23:08:06 +09:00
447c43c9d7
placeholders for Aphro samplers
2023-11-04 11:16:12 +09:00
c79bf951b7
minor skill issue with slider overhaul
2023-10-26 20:41:12 +09:00
e9107870c0
Merge branch 'staging' of https://github.com/Cohee1207/SillyTavern into staging
2023-10-26 13:20:49 +09:00
d50124e937
appwide slider overhaul
2023-10-26 13:20:47 +09:00
4f67e9f38b
Ooba: Add frequency and presence penalty sliders
...
These options essentially supersede repetition penalty, but since
ooba also gives the option, add these new sliders in conjunction
with the repetition penalty ones.
More testing is needed to find good default values.
Signed-off-by: kingbri <bdashore3@proton.me>
2023-10-25 15:22:47 -04:00
c4fbc8373d
Add raw generate function
2023-10-11 17:56:52 +03:00
d265179f46
Don't crash ST server on invalid streaming URL
2023-10-08 23:42:28 +03:00
788bbe969f
Feature, ability to add banned words sequences from anywhere through {{banned "..."}} macro. ( #1202 )
...
* Add files via upload
* Add files via upload
* Add files via upload
* Add files via upload
* Add files via upload
* Fix constant assignment, reformat code
---------
Co-authored-by: Cohee <18619528+Cohee1207@users.noreply.github.com>
2023-10-05 13:10:41 +03:00
bb47712696
Split oobabooga/mancer sources. Add aphrodite support
2023-09-28 19:10:00 +03:00
306cf51da4
#1180 Add custom token bans. Return grammar strings
2023-09-27 22:09:09 +03:00
773d42b886
Suspend ooba grammar
2023-09-25 14:07:13 +03:00
86e9974410
Add grammar for ooba llama.cpp
2023-09-24 17:57:00 +03:00
Cohee
valadaptive
kingbri
RossAscends
valden80