879 Commits

Author SHA1 Message Date
Cohee
a3f6ce52e4 Fix manual vectorization of files 2024-04-19 18:43:35 +03:00
Cohee
19ea1ee56c Fix field style 2024-04-19 18:41:40 +03:00
Cohee
9d6a791443 Merge branch 'staging' into neo-server 2024-04-19 01:15:30 +03:00
Cohee
eab545cafc Error handling for Comfy request 2024-04-19 00:39:04 +03:00
Cohee
901ffa3cdc Add char and user avatar placeholders to ComfyUI workflow editor
They resolve to base64 encoded data URIs of respective avatars.
2024-04-19 00:32:38 +03:00
Cohee
80de3fdd4c Add buttons to process and purge file vectors for current chat 2024-04-19 00:16:23 +03:00
Cohee
25cb598694 Add Cohere as embedding source 2024-04-19 00:07:12 +03:00
Cohee
2eafa2a212 Clean-up vectors upon deleting a file from Data Bank 2024-04-18 23:07:16 +03:00
Cohee
8434f6e6cf Clear toast upon inserting file 2024-04-18 22:59:42 +03:00
Cohee
16a2ac0bbe Add missing awaiters to getQueryText 2024-04-18 22:58:14 +03:00
Cohee
16785ae005 Merge branch 'staging' into neo-server 2024-04-18 22:57:27 +03:00
Cohee
cc1c3f173c
Merge pull request #2097 from Dakraid/feature/summarize-before-embedding
Summarize the chat messages handed to the embedding beforehand
2024-04-18 22:49:34 +03:00
Cohee
5e18b1872b Hide vector summarization unless chat vectors is enabled 2024-04-18 22:32:01 +03:00
Cohee
f4f0a59e90 Save character data bank attachments as non-exportable 2024-04-18 22:16:51 +03:00
Cohee
d281767867 Add /caption command 2024-04-18 16:22:33 +03:00
Cohee
59bb04f1b3 Implement generic interface for adding Data Bank scrapers 2024-04-18 00:14:41 +03:00
Kristan Schlikow
abd8acd9fc
Add experimental flask icon with title 2024-04-17 20:35:51 +02:00
Kristan Schlikow
977c1d4ac4
Add missing hr to the settings html 2024-04-17 20:35:51 +02:00
Kristan Schlikow
21b5bb5a29
Rearrange settings 2024-04-17 20:35:51 +02:00
Kristan Schlikow
10692523f0
Improve settings, add settings for prompt, sent message summarize toggle 2024-04-17 20:35:50 +02:00
Kristan Schlikow
a022c9eccb
Set css class for summary dropdown in vectors 2024-04-17 20:35:50 +02:00
Kristan Schlikow
4cfd0c71cf
Add extras summarization API, fix missing substitution of placeholders 2024-04-17 20:35:49 +02:00
Kristan Schlikow
a1473dedd0
Make summarization toggleable 2024-04-17 20:35:49 +02:00
Kristan Schlikow
59abee3043
Summarize the chat messages handed to the embedding beforehand 2024-04-17 20:35:48 +02:00
Cohee
88637adfe2 Merge branch 'staging' into neo-server 2024-04-17 19:39:57 +03:00
Cohee
9a1ea7f226 Implement Data Bank vectors querying 2024-04-17 02:09:22 +03:00
Cohee
4665db62f4 #1954 Remove backtick wrapping for inserted files 2024-04-16 22:28:10 +03:00
Cohee
ab5b497562 Add filters to data bank manager 2024-04-16 22:23:59 +03:00
Cohee
5a614b5173 Integrate data bank with Fandom plugin 2024-04-16 20:16:21 +03:00
Cohee
57314443ed Add names display to data bank 2024-04-16 02:36:46 +03:00
Cohee
242d57c14b Add Data Bank manager 2024-04-16 02:14:34 +03:00
Cohee
341f02e425 Fix default classify API migration 2024-04-15 04:04:30 +03:00
Cohee
022c180b62 Lint and clean-up 2024-04-15 00:39:15 +03:00
Cohee
f5955bdd37 Throw if couldn't classify 2024-04-14 20:02:34 +03:00
Cohee
0ff5d0b5f1 Substitute macro is LLM prompt 2024-04-14 19:53:40 +03:00
Cohee
6dca8b28fe Fix talkinghead check 2024-04-14 19:46:33 +03:00
Cohee
bd6fe19bf1 Merge branch 'staging' into llm-expressions 2024-04-14 19:43:34 +03:00
Cohee
3e60919289 Specify LLM prompt in case JSON schema is not supported 2024-04-14 17:13:54 +03:00
Cohee
b02394008c Fix settings migration. Add lint rule. 2024-04-14 15:40:10 +03:00
Cohee
306bff0a92 #2085 Switch to async token counters 2024-04-13 21:33:19 +03:00
kingbri
913085ba74 Expressions: Let the user know if classification failed
Send a message if the classifer fails and fallback to the default
expression.

Signed-off-by: kingbri <bdashore3@proton.me>
2024-04-13 01:29:54 -04:00
kingbri
8c4dd6ce1e Expressions: Ignore stopping strings
Don't use stopping strings when triggering a classify generation.

Signed-off-by: kingbri <bdashore3@proton.me>
2024-04-12 09:57:09 -04:00
kingbri
bea63a2efe Expressions: Remove TalkingHead from choices
This is a sub-choice under extras.

Signed-off-by: kingbri <bdashore3@proton.me>
2024-04-12 01:59:44 -04:00
kingbri
6b656bf380 Expressions: Classify using LLM
Rather than using a separate BERT model to classify the last message,
use the LLM itself to get the classified expression label as a JSON
and set that as the current sprite. Doing this should take more information
into consideration and cut down on extra processing.

This is made possible by the use of constrained generation with JSON
schemas. Only available to TabbyAPI since it's the only backend that
supports the use of JSON schemas, but there can hopefully be a way
to use this with other backends as well.

Intercepts the generation and sets top_k = 1 (for greedy sampling)
and the json_schema to an emotion enum. Doing this also prevents
reingestion of the entire context every time a message is sent and
then asked to be classified, which doesn't compromise the chat
experience.

Signed-off-by: kingbri <bdashore3@proton.me>
2024-04-12 01:55:16 -04:00
Cohee
356f1f9c39 Clean-up non-character state checks 2024-04-11 23:50:01 +03:00
Cohee
123131074c Change built-in extensions template render to async 2024-04-11 23:38:44 +03:00
Cohee
3da9fb4efe Switch to module exports 2024-04-11 22:39:42 +03:00
Cohee
6290dff3d9 #2065 Add option to translate text before classification 2024-04-11 22:09:05 +03:00
Cohee
210f388d7a Switch button style to use class 2024-04-11 21:33:15 +03:00
the big boss
063c81540d
IVC + support new settings and turbo model (#2067) 2024-04-11 21:29:19 +03:00