Commit Graph

132 Commits

Author SHA1 Message Date
deffcolony
0252b21901 move expression buttons above Sprite set
+moves the buttons above the Sprite set so user does not have to scroll all the way down to find the buttons now it will be directly visiable
2024-05-09 16:33:04 +02:00
Cohee
5e7c214c89 Substitute macros in text to classify 2024-05-06 22:02:13 +03:00
Cohee
478be72659 #2181 Unstuck moving images 2024-05-04 14:20:59 +03:00
Cohee
6ac6c7cfda #2159 Move debounce constants to a separate module 2024-04-28 19:47:53 +03:00
Wolfsblvt
d7ade487b8 Refactor common enum for debounce timeouts 2024-04-28 06:21:47 +02:00
Cohee
62cf611fdc
Merge pull request #2138 from Wolfsblvt/fix-expression-list-resolve
Fix expression list resolve
2024-04-25 11:00:34 +03:00
Wolfsblvt
161e512805 Fix expression list resolve
- New expression api "LLM" still queried local classify model for expressions, fixed by returning default list
- Fixed failed API calls crashing Expressions extension
2024-04-25 04:29:20 +02:00
Cohee
bc9c70556e Clean-up mentions of /public/ 2024-04-21 23:53:46 +03:00
Cohee
b3bbec83b6 Merge branch 'staging' into neo-server 2024-04-20 02:56:05 +03:00
Cohee
366e2abb8b Move expressions LLM request setting mode listener 2024-04-19 23:01:31 +03:00
Cohee
88637adfe2 Merge branch 'staging' into neo-server 2024-04-17 19:39:57 +03:00
Cohee
341f02e425 Fix default classify API migration 2024-04-15 04:04:30 +03:00
Cohee
022c180b62 Lint and clean-up 2024-04-15 00:39:15 +03:00
Cohee
f5955bdd37 Throw if couldn't classify 2024-04-14 20:02:34 +03:00
Cohee
0ff5d0b5f1 Substitute macro is LLM prompt 2024-04-14 19:53:40 +03:00
Cohee
6dca8b28fe Fix talkinghead check 2024-04-14 19:46:33 +03:00
Cohee
3e60919289 Specify LLM prompt in case JSON schema is not supported 2024-04-14 17:13:54 +03:00
Cohee
b02394008c Fix settings migration. Add lint rule. 2024-04-14 15:40:10 +03:00
kingbri
913085ba74 Expressions: Let the user know if classification failed
Send a message if the classifer fails and fallback to the default
expression.

Signed-off-by: kingbri <bdashore3@proton.me>
2024-04-13 01:29:54 -04:00
kingbri
8c4dd6ce1e Expressions: Ignore stopping strings
Don't use stopping strings when triggering a classify generation.

Signed-off-by: kingbri <bdashore3@proton.me>
2024-04-12 09:57:09 -04:00
kingbri
bea63a2efe Expressions: Remove TalkingHead from choices
This is a sub-choice under extras.

Signed-off-by: kingbri <bdashore3@proton.me>
2024-04-12 01:59:44 -04:00
kingbri
6b656bf380 Expressions: Classify using LLM
Rather than using a separate BERT model to classify the last message,
use the LLM itself to get the classified expression label as a JSON
and set that as the current sprite. Doing this should take more information
into consideration and cut down on extra processing.

This is made possible by the use of constrained generation with JSON
schemas. Only available to TabbyAPI since it's the only backend that
supports the use of JSON schemas, but there can hopefully be a way
to use this with other backends as well.

Intercepts the generation and sets top_k = 1 (for greedy sampling)
and the json_schema to an emotion enum. Doing this also prevents
reingestion of the entire context every time a message is sent and
then asked to be classified, which doesn't compromise the chat
experience.

Signed-off-by: kingbri <bdashore3@proton.me>
2024-04-12 01:55:16 -04:00
Cohee
356f1f9c39 Clean-up non-character state checks 2024-04-11 23:50:01 +03:00
Cohee
123131074c Change built-in extensions template render to async 2024-04-11 23:38:44 +03:00
Cohee
6290dff3d9 #2065 Add option to translate text before classification 2024-04-11 22:09:05 +03:00
Wolfsblvt
e26c7827bc Fallback expression reset if custom expression deleted 2024-04-07 06:26:48 +02:00
Wolfsblvt
2ffb44b4e1 Add extension setting for fallback expression 2024-04-07 06:12:52 +02:00
Cohee
cdbd5c6130 /classify help text clarity 2024-04-06 00:45:38 +03:00
Cohee
e75f5550e3 Add /classify command 2024-04-05 22:33:16 +03:00
Cohee
c3129da879 [skip ci] Lint fix 2024-02-07 19:28:34 +02:00
Cohee
b158a86c25 Firefox copium for expression images 2024-02-05 02:21:20 +02:00
Juha Jeronen
ad48d6666a fix bug: when switching talkinghead off, set character expression 2024-02-05 00:47:14 +02:00
Juha Jeronen
2a39db799a auto-pause Talkinghead when ST tab is hidden to save GPU resources 2024-02-05 00:46:44 +02:00
Juha Jeronen
91c4de6605 add /th (alias /talkinghead) to toggle Talkinghead on/off 2024-02-05 00:46:23 +02:00
Juha Jeronen
5ad2a0d064 refresh talkinghead char on expression zip upload 2024-02-05 00:45:50 +02:00
Juha Jeronen
3b526ce207 remove some useless comments 2024-02-05 00:45:37 +02:00
Juha Jeronen
169b1c2c63 talkinghead check: always check also whether the module is enabled 2024-02-05 00:45:20 +02:00
Juha Jeronen
9e8f3e0def one more debug message 2024-02-05 00:44:46 +02:00
Juha Jeronen
eb634d597f add comment on TTS 2024-02-05 00:44:39 +02:00
Juha Jeronen
24b315a149 comments
The tech is "Talkinghead" (capital T), the Extras module is
"talkinghead" (lowercase t).
2024-02-05 00:44:26 +02:00
Juha Jeronen
83e264db9e add some debug messages 2024-02-05 00:40:03 +02:00
Cohee
2846d0fd58 #1720 Fetch no-cache images when uploading 2024-01-20 19:48:56 +02:00
Juha Jeronen
b528520693 read and send talkinghead per-character configs 2024-01-12 18:26:14 +02:00
Cohee
810667e8e7 Slight increase processing delay 2024-01-09 20:17:17 +02:00
Cohee
63ab16161f Add check for enabled module 2024-01-09 19:52:49 +02:00
Juha Jeronen
87b05e2e2d enable talkinghead's talking animation while the LLM is streaming 2024-01-08 00:47:59 +02:00
Juha Jeronen
39c485ab25 some missed refactorings 2024-01-08 00:47:40 +02:00
Juha Jeronen
1184ea2c3b clarity 2024-01-08 00:47:18 +02:00
Juha Jeronen
3f3e68c492 document some functions 2024-01-08 00:46:54 +02:00
Cohee
ad94ba57b1 Move clear function names 2024-01-07 21:14:29 +02:00