Commit Graph

113 Commits

Author SHA1 Message Date
f5955bdd37 Throw if couldn't classify 2024-04-14 20:02:34 +03:00
0ff5d0b5f1 Substitute macro is LLM prompt 2024-04-14 19:53:40 +03:00
6dca8b28fe Fix talkinghead check 2024-04-14 19:46:33 +03:00
3e60919289 Specify LLM prompt in case JSON schema is not supported 2024-04-14 17:13:54 +03:00
b02394008c Fix settings migration. Add lint rule. 2024-04-14 15:40:10 +03:00
913085ba74 Expressions: Let the user know if classification failed
Send a message if the classifer fails and fallback to the default
expression.

Signed-off-by: kingbri <bdashore3@proton.me>
2024-04-13 01:29:54 -04:00
8c4dd6ce1e Expressions: Ignore stopping strings
Don't use stopping strings when triggering a classify generation.

Signed-off-by: kingbri <bdashore3@proton.me>
2024-04-12 09:57:09 -04:00
6b656bf380 Expressions: Classify using LLM
Rather than using a separate BERT model to classify the last message,
use the LLM itself to get the classified expression label as a JSON
and set that as the current sprite. Doing this should take more information
into consideration and cut down on extra processing.

This is made possible by the use of constrained generation with JSON
schemas. Only available to TabbyAPI since it's the only backend that
supports the use of JSON schemas, but there can hopefully be a way
to use this with other backends as well.

Intercepts the generation and sets top_k = 1 (for greedy sampling)
and the json_schema to an emotion enum. Doing this also prevents
reingestion of the entire context every time a message is sent and
then asked to be classified, which doesn't compromise the chat
experience.

Signed-off-by: kingbri <bdashore3@proton.me>
2024-04-12 01:55:16 -04:00
356f1f9c39 Clean-up non-character state checks 2024-04-11 23:50:01 +03:00
123131074c Change built-in extensions template render to async 2024-04-11 23:38:44 +03:00
6290dff3d9 #2065 Add option to translate text before classification 2024-04-11 22:09:05 +03:00
e26c7827bc Fallback expression reset if custom expression deleted 2024-04-07 06:26:48 +02:00
2ffb44b4e1 Add extension setting for fallback expression 2024-04-07 06:12:52 +02:00
cdbd5c6130 /classify help text clarity 2024-04-06 00:45:38 +03:00
e75f5550e3 Add /classify command 2024-04-05 22:33:16 +03:00
c3129da879 [skip ci] Lint fix 2024-02-07 19:28:34 +02:00
b158a86c25 Firefox copium for expression images 2024-02-05 02:21:20 +02:00
ad48d6666a fix bug: when switching talkinghead off, set character expression 2024-02-05 00:47:14 +02:00
2a39db799a auto-pause Talkinghead when ST tab is hidden to save GPU resources 2024-02-05 00:46:44 +02:00
91c4de6605 add /th (alias /talkinghead) to toggle Talkinghead on/off 2024-02-05 00:46:23 +02:00
5ad2a0d064 refresh talkinghead char on expression zip upload 2024-02-05 00:45:50 +02:00
3b526ce207 remove some useless comments 2024-02-05 00:45:37 +02:00
169b1c2c63 talkinghead check: always check also whether the module is enabled 2024-02-05 00:45:20 +02:00
9e8f3e0def one more debug message 2024-02-05 00:44:46 +02:00
eb634d597f add comment on TTS 2024-02-05 00:44:39 +02:00
24b315a149 comments
The tech is "Talkinghead" (capital T), the Extras module is
"talkinghead" (lowercase t).
2024-02-05 00:44:26 +02:00
83e264db9e add some debug messages 2024-02-05 00:40:03 +02:00
2846d0fd58 #1720 Fetch no-cache images when uploading 2024-01-20 19:48:56 +02:00
b528520693 read and send talkinghead per-character configs 2024-01-12 18:26:14 +02:00
810667e8e7 Slight increase processing delay 2024-01-09 20:17:17 +02:00
63ab16161f Add check for enabled module 2024-01-09 19:52:49 +02:00
87b05e2e2d enable talkinghead's talking animation while the LLM is streaming 2024-01-08 00:47:59 +02:00
39c485ab25 some missed refactorings 2024-01-08 00:47:40 +02:00
1184ea2c3b clarity 2024-01-08 00:47:18 +02:00
3f3e68c492 document some functions 2024-01-08 00:46:54 +02:00
ad94ba57b1 Move clear function names 2024-01-07 21:14:29 +02:00
5bc08ab8c1 check also that expressions is running with extras 2024-01-06 02:48:39 +02:00
e6ade18b58 ehm, once more, correctly. 2024-01-06 02:23:10 +02:00
d1e9c59e72 meh, don't check for static sprite, correctly 2024-01-06 02:17:07 +02:00
2d85d7e1e1 talkinghead mode: don't check for existence of static emote sprite 2024-01-06 02:10:09 +02:00
a7c6f4f56e refresh live char when a new talkinghead image is uploaded 2024-01-06 02:09:34 +02:00
7f4a45a4a3 add comment 2024-01-06 02:09:27 +02:00
6c03e81d8d chore: format fix 2024-01-05 15:45:05 +02:00
77c11b8f2b set_emotion is not supported by old talkinghead versions 2024-01-05 12:15:24 +02:00
059f61fee8 add "/emote xxx" support for talkinghead (when VN mode off) 2024-01-02 02:18:54 +02:00
30732ada32 Lint fix 2024-01-01 16:08:24 +02:00
a2aa8ba6a0 add export and slash command for last set expressions 2023-12-30 11:37:13 +00:00
e1afe41c91 Fix custom expression duplication 2023-12-21 16:50:30 +02:00
64a3564892 lint: Comma dangle 2023-12-02 22:06:57 +02:00
c63cd87cc0 lint: Require semicolons 2023-12-02 21:11:06 +02:00