Commit Graph

4633 Commits

Author SHA1 Message Date
kingbri
6b656bf380 Expressions: Classify using LLM
Rather than using a separate BERT model to classify the last message,
use the LLM itself to get the classified expression label as a JSON
and set that as the current sprite. Doing this should take more information
into consideration and cut down on extra processing.

This is made possible by the use of constrained generation with JSON
schemas. Only available to TabbyAPI since it's the only backend that
supports the use of JSON schemas, but there can hopefully be a way
to use this with other backends as well.

Intercepts the generation and sets top_k = 1 (for greedy sampling)
and the json_schema to an emotion enum. Doing this also prevents
reingestion of the entire context every time a message is sent and
then asked to be classified, which doesn't compromise the chat
experience.

Signed-off-by: kingbri <bdashore3@proton.me>
2024-04-12 01:55:16 -04:00
RossAscends
626c93a1ab Merge branch 'staging' of https://github.com/Cohee1207/SillyTavern into staging 2024-04-12 08:21:18 +09:00
RossAscends
94f14340ae add background image name reporting for /bg with no args 2024-04-12 08:21:17 +09:00
sasha0552
7348199f73 Add llama.cpp slots info endpoint (#2070) 2024-04-11 23:53:32 +03:00
Cohee
356f1f9c39 Clean-up non-character state checks 2024-04-11 23:50:01 +03:00
Cohee
123131074c Change built-in extensions template render to async 2024-04-11 23:38:44 +03:00
Cohee
16cabb38ad Fix init order in RA mods 2024-04-11 22:47:28 +03:00
Cohee
3da9fb4efe Switch to module exports 2024-04-11 22:39:42 +03:00
Cohee
369c3512c0 Add async template renderer 2024-04-11 22:36:23 +03:00
Cohee
6290dff3d9 #2065 Add option to translate text before classification 2024-04-11 22:09:05 +03:00
Cohee
210f388d7a Switch button style to use class 2024-04-11 21:33:15 +03:00
the big boss
063c81540d IVC + support new settings and turbo model (#2067) 2024-04-11 21:29:19 +03:00
CasualAutopsy
334178f6f9 Add New Icon (#2068)
* Revert Change

* Add files via upload
2024-04-11 20:52:57 +03:00
Cohee
05ae571971 Pass names to Cohere prompt converter 2024-04-11 19:53:45 +03:00
Cohee
ee62f77e96 Merge pull request #2063 from kingbased/goog
Gemini system prompt support
2024-04-11 19:49:20 +03:00
Cohee
58152a60c6 Append example names to converted Google sysprompt 2024-04-11 19:45:50 +03:00
Cohee
6e377fdbea Merge pull request #2066 from sirius422/fix-zh-cn-locales
Fix some errors in zh-cn.json and make the translations more concise
2024-04-11 19:33:49 +03:00
Cohee
9e08bd5522 Merge pull request #2064 from Yokayo/staging
Update Russian translation and add new localized strings
2024-04-11 19:23:01 +03:00
Cohee
d2ac782c3c Fix broken HTML and code style 2024-04-11 19:21:59 +03:00
deffcolony
008527de4b Update st-launcher.ico
remaster for the ST-launcher icon by casual_autopsy
2024-04-11 17:12:40 +02:00
sirius422
83cc094580 Fix some errors in zh-cn.json and make the translations more concise 2024-04-11 19:51:12 +08:00
Yokayo
0b06303442 Small fix 2024-04-11 15:04:31 +07:00
Yokayo
c9509c5c54 Proofread, edit and update translation 2024-04-11 15:02:23 +07:00
Yokayo
a5d3c98e01 Bind strings to locale 2024-04-11 15:00:29 +07:00
Yokayo
0486fe0126 Bind strings to locale 2024-04-11 14:58:07 +07:00
Yokayo
40cae057a5 Bind string to locale 2024-04-11 14:55:38 +07:00
Yokayo
f6b80c021a Localize more strings 2024-04-11 14:52:26 +07:00
based
4ac6bbd515 thought it looked a little strange 2024-04-11 17:01:19 +10:00
based
c4ec97aa50 cleanup 2024-04-11 16:51:05 +10:00
based
34bca69950 system prompt support for gemini 1.5 2024-04-11 16:38:20 +10:00
Cohee
afeaca0fe0 Merge pull request #2061 from SillyTavern/pollinations
Add Pollinations as image generation source
2024-04-10 21:23:24 +03:00
Cohee
5f6d895acf Add attribution links 2024-04-10 21:21:31 +03:00
Cohee
c90105e9f6 Merge branch 'staging' into pollinations 2024-04-10 21:14:36 +03:00
Cohee
53baa7aae7 #2051 #2031 Selectable prompt converter for custom OAI type 2024-04-10 21:12:57 +03:00
Cohee
a9a3d91e4f Fix char management dropdown on rectangular avatars 2024-04-10 20:31:38 +03:00
Cohee
b5d7d0a73f Merge pull request #2050 from Dakraid/feature/new-avatar-tag-layout
Update layout for avatar tags and controls
2024-04-10 20:27:31 +03:00
Cohee
9b97294799 Denser layout 2024-04-10 20:27:06 +03:00
Kristan Schlikow
b811d69068 Fix sizing on smaller resolutions 2024-04-10 19:10:15 +02:00
Cohee
91e93958b8 Merge pull request #2055 from kingbased/turbo
new turbo model
2024-04-10 14:30:06 +03:00
Kristan Schlikow
d4adbf496f Address styling issues 2024-04-10 12:15:51 +02:00
Kristan Schlikow
7d4e689bec Update layout for avatar tags and controls 2024-04-10 12:15:51 +02:00
Cohee
75857ae18c #2041 Fix WI checkboxes missing in localizations 2024-04-10 12:17:35 +03:00
Cohee
41d346bf00 Merge pull request #2057 from sasha0552/staging
Add some llama.cpp-specific endpoints
2024-04-10 11:37:24 +03:00
sasha0552
becd17d7d2 Add some llama.cpp-specific endpoints 2024-04-10 08:11:59 +00:00
Cohee
0783264900 Merge pull request #2054 from bdashore3/json-schema
JSON schema fixes
2024-04-10 10:41:22 +03:00
based
62ed8faef0 didn't really make sense to have these i guess 2024-04-10 14:33:38 +10:00
based
540cddf300 new turbo model 2024-04-10 14:24:43 +10:00
kingbri
b8b49f0012 TextgenSettings: Fix JSON schema fallback
Did not fall back if the provided string was empty, resulting in
errors

Signed-off-by: kingbri <bdashore3@proton.me>
2024-04-09 22:15:00 -04:00
Cohee
42e1ade148 Add a {{noop}} macro 2024-04-10 01:04:12 +03:00
Cohee
69d219cd7e Allow trimming chat start with {{trim}} macro 2024-04-10 00:32:53 +03:00