Commit Graph

1078 Commits

Author SHA1 Message Date
Cohee c43ddd9d62
Merge pull request #2178 from Yokayo/staging
Localization enhancements
2024-05-08 13:59:52 +03:00
Yokayo dfa8c6c3d4 Remove cases 2024-05-07 13:11:59 +07:00
Cohee 5e7c214c89 Substitute macros in text to classify 2024-05-06 22:02:13 +03:00
Cohee 12eabd167d #2187 Add negative prefix arg to /sd command 2024-05-06 21:39:07 +03:00
Cohee 55d31a976f Add generic mediawiki downloader 2024-05-05 22:26:13 +03:00
Cohee 478be72659 #2181 Unstuck moving images 2024-05-04 14:20:59 +03:00
Yokayo a02f5ead7e Some localization fixes 2024-05-04 03:37:55 +07:00
Yokayo 29e2e8f607 Add localizable strings to two extensions & translate them 2024-05-04 02:44:15 +07:00
Cohee d9d76ba16d #2164 Add error toasts to VecStore 2024-04-30 00:17:39 +03:00
Cohee 993284f9c1 #2164 Disable-able data bank attachments 2024-04-30 00:06:14 +03:00
Cohee e0df5783f8 Allow macros in positive and negative prompts 2024-04-29 13:50:55 +03:00
Cohee e4de6da5b8 Add server plugin support for MS Edge TTS 2024-04-29 01:07:19 +03:00
Cohee 6ac6c7cfda #2159 Move debounce constants to a separate module 2024-04-28 19:47:53 +03:00
Cohee de2bb7938a Utilize import for vector store 2024-04-28 14:35:35 +03:00
Wolfsblvt d7ade487b8 Refactor common enum for debounce timeouts 2024-04-28 06:21:47 +02:00
Azariel Del Carmen fc158ca176
Merge branch 'staging' into staging 2024-04-27 21:49:02 +01:00
Bronya-Rand fb71d3b562 chore: remove miHoYo parser from first-party scrapers 2024-04-27 21:27:14 +01:00
Cohee ea050b98ef
Merge pull request #2150 from evpeople/release
add a button to translate input message
2024-04-27 21:23:26 +03:00
Cohee b30d69b2a6 Clean-up styles and JQuery use 2024-04-27 21:22:50 +03:00
Cohee 60e099e852 Clean-up diff pt.2 2024-04-27 21:15:44 +03:00
Cohee c49b37f968 Clean-up diff 2024-04-27 21:11:41 +03:00
evpeople 4521dde455
add a button to translate input message 2024-04-27 13:46:13 +08:00
sirius422 a96e1903a3 Change the naming rule of regex exporting 2024-04-27 00:05:10 +08:00
Cohee 62cf611fdc
Merge pull request #2138 from Wolfsblvt/fix-expression-list-resolve
Fix expression list resolve
2024-04-25 11:00:34 +03:00
Wolfsblvt 161e512805 Fix expression list resolve
- New expression api "LLM" still queried local classify model for expressions, fixed by returning default list
- Fixed failed API calls crashing Expressions extension
2024-04-25 04:29:20 +02:00
Cohee 2bba186c9e Add slash command and d&d hint for data bank 2024-04-24 02:37:57 +03:00
Cohee 61241df0d4 Add download and move for DB attachments 2024-04-24 02:33:16 +03:00
Cohee b6b9b542d7 Add drag&drop to data bank 2024-04-24 01:51:54 +03:00
Cohee 75372ad0cc Use Map for caches instead of objects 2024-04-23 16:15:54 +03:00
Cohee d97f0a4c4d Add new NAI Diffusion model 2024-04-23 03:18:45 +03:00
Cohee 4370db6bdc Implement World Info activation using Vector Storage 2024-04-23 03:09:52 +03:00
Bronya-Rand 770f3e5da3 chore: apply align-items center and img sample for img only scraper icons 2024-04-22 19:12:02 +01:00
Bronya-Rand 0f0895f345 feat: implement miHoYo scraper 2024-04-22 19:11:00 +01:00
Cohee 776260c85a Add Data Bank to attachments extension display name 2024-04-22 16:25:46 +03:00
Cohee 5a5463bd5d #2095 Suppress auto-execution on streamed swiped generations. 2024-04-22 16:02:50 +03:00
Cohee bc9c70556e Clean-up mentions of /public/ 2024-04-21 23:53:46 +03:00
Cohee 5fd6202e60 Merge branch 'staging' into neo-server 2024-04-21 21:56:36 +03:00
Cohee d5c0aed973 Replace Comfy avatar placeholders with empty pixel if message fails to load 2024-04-21 21:13:50 +03:00
Cohee 5992c34fb5 Add DB attachment editor 2024-04-21 18:23:41 +03:00
Cohee bae74fbbd7 Add notepad data bank file creator 2024-04-21 18:11:03 +03:00
Cohee ca89be8930 Add experimental setting for file translation 2024-04-21 03:24:01 +03:00
Cohee 344146d837 Merge branch 'staging' into neo-server 2024-04-21 01:04:03 +03:00
Cohee dcb98b2969 Substitute macros in TTS text before narrating 2024-04-21 01:02:49 +03:00
Cohee db78346bef Add YT script loader for data bank 2024-04-20 19:58:29 +03:00
Cohee b3bbec83b6 Merge branch 'staging' into neo-server 2024-04-20 02:56:05 +03:00
Cohee 78d1d48ea9 Add EPUB import for data bank 2024-04-20 01:24:46 +03:00
Cohee 366e2abb8b Move expressions LLM request setting mode listener 2024-04-19 23:01:31 +03:00
Cohee a3f6ce52e4 Fix manual vectorization of files 2024-04-19 18:43:35 +03:00
Cohee 19ea1ee56c Fix field style 2024-04-19 18:41:40 +03:00
Cohee 9d6a791443 Merge branch 'staging' into neo-server 2024-04-19 01:15:30 +03:00
Cohee eab545cafc Error handling for Comfy request 2024-04-19 00:39:04 +03:00
Cohee 901ffa3cdc Add char and user avatar placeholders to ComfyUI workflow editor
They resolve to base64 encoded data URIs of respective avatars.
2024-04-19 00:32:38 +03:00
Cohee 80de3fdd4c Add buttons to process and purge file vectors for current chat 2024-04-19 00:16:23 +03:00
Cohee 25cb598694 Add Cohere as embedding source 2024-04-19 00:07:12 +03:00
Cohee 2eafa2a212 Clean-up vectors upon deleting a file from Data Bank 2024-04-18 23:07:16 +03:00
Cohee 8434f6e6cf Clear toast upon inserting file 2024-04-18 22:59:42 +03:00
Cohee 16a2ac0bbe Add missing awaiters to getQueryText 2024-04-18 22:58:14 +03:00
Cohee 16785ae005 Merge branch 'staging' into neo-server 2024-04-18 22:57:27 +03:00
Cohee cc1c3f173c
Merge pull request #2097 from Dakraid/feature/summarize-before-embedding
Summarize the chat messages handed to the embedding beforehand
2024-04-18 22:49:34 +03:00
Cohee 5e18b1872b Hide vector summarization unless chat vectors is enabled 2024-04-18 22:32:01 +03:00
Cohee f4f0a59e90 Save character data bank attachments as non-exportable 2024-04-18 22:16:51 +03:00
Cohee d281767867 Add /caption command 2024-04-18 16:22:33 +03:00
Cohee 59bb04f1b3 Implement generic interface for adding Data Bank scrapers 2024-04-18 00:14:41 +03:00
Kristan Schlikow abd8acd9fc
Add experimental flask icon with title 2024-04-17 20:35:51 +02:00
Kristan Schlikow 977c1d4ac4
Add missing hr to the settings html 2024-04-17 20:35:51 +02:00
Kristan Schlikow 21b5bb5a29
Rearrange settings 2024-04-17 20:35:51 +02:00
Kristan Schlikow 10692523f0
Improve settings, add settings for prompt, sent message summarize toggle 2024-04-17 20:35:50 +02:00
Kristan Schlikow a022c9eccb
Set css class for summary dropdown in vectors 2024-04-17 20:35:50 +02:00
Kristan Schlikow 4cfd0c71cf
Add extras summarization API, fix missing substitution of placeholders 2024-04-17 20:35:49 +02:00
Kristan Schlikow a1473dedd0
Make summarization toggleable 2024-04-17 20:35:49 +02:00
Kristan Schlikow 59abee3043
Summarize the chat messages handed to the embedding beforehand 2024-04-17 20:35:48 +02:00
Cohee 88637adfe2 Merge branch 'staging' into neo-server 2024-04-17 19:39:57 +03:00
Cohee 9a1ea7f226 Implement Data Bank vectors querying 2024-04-17 02:09:22 +03:00
Cohee 4665db62f4 #1954 Remove backtick wrapping for inserted files 2024-04-16 22:28:10 +03:00
Cohee ab5b497562 Add filters to data bank manager 2024-04-16 22:23:59 +03:00
Cohee 5a614b5173 Integrate data bank with Fandom plugin 2024-04-16 20:16:21 +03:00
Cohee 57314443ed Add names display to data bank 2024-04-16 02:36:46 +03:00
Cohee 242d57c14b Add Data Bank manager 2024-04-16 02:14:34 +03:00
Cohee 341f02e425 Fix default classify API migration 2024-04-15 04:04:30 +03:00
Cohee 022c180b62 Lint and clean-up 2024-04-15 00:39:15 +03:00
Cohee f5955bdd37 Throw if couldn't classify 2024-04-14 20:02:34 +03:00
Cohee 0ff5d0b5f1 Substitute macro is LLM prompt 2024-04-14 19:53:40 +03:00
Cohee 6dca8b28fe Fix talkinghead check 2024-04-14 19:46:33 +03:00
Cohee bd6fe19bf1 Merge branch 'staging' into llm-expressions 2024-04-14 19:43:34 +03:00
Cohee 3e60919289 Specify LLM prompt in case JSON schema is not supported 2024-04-14 17:13:54 +03:00
Cohee b02394008c Fix settings migration. Add lint rule. 2024-04-14 15:40:10 +03:00
Cohee 306bff0a92 #2085 Switch to async token counters 2024-04-13 21:33:19 +03:00
kingbri 913085ba74 Expressions: Let the user know if classification failed
Send a message if the classifer fails and fallback to the default
expression.

Signed-off-by: kingbri <bdashore3@proton.me>
2024-04-13 01:29:54 -04:00
kingbri 8c4dd6ce1e Expressions: Ignore stopping strings
Don't use stopping strings when triggering a classify generation.

Signed-off-by: kingbri <bdashore3@proton.me>
2024-04-12 09:57:09 -04:00
kingbri bea63a2efe Expressions: Remove TalkingHead from choices
This is a sub-choice under extras.

Signed-off-by: kingbri <bdashore3@proton.me>
2024-04-12 01:59:44 -04:00
kingbri 6b656bf380 Expressions: Classify using LLM
Rather than using a separate BERT model to classify the last message,
use the LLM itself to get the classified expression label as a JSON
and set that as the current sprite. Doing this should take more information
into consideration and cut down on extra processing.

This is made possible by the use of constrained generation with JSON
schemas. Only available to TabbyAPI since it's the only backend that
supports the use of JSON schemas, but there can hopefully be a way
to use this with other backends as well.

Intercepts the generation and sets top_k = 1 (for greedy sampling)
and the json_schema to an emotion enum. Doing this also prevents
reingestion of the entire context every time a message is sent and
then asked to be classified, which doesn't compromise the chat
experience.

Signed-off-by: kingbri <bdashore3@proton.me>
2024-04-12 01:55:16 -04:00
Cohee 356f1f9c39 Clean-up non-character state checks 2024-04-11 23:50:01 +03:00
Cohee 123131074c Change built-in extensions template render to async 2024-04-11 23:38:44 +03:00
Cohee 3da9fb4efe Switch to module exports 2024-04-11 22:39:42 +03:00
Cohee 6290dff3d9 #2065 Add option to translate text before classification 2024-04-11 22:09:05 +03:00
Cohee 210f388d7a Switch button style to use class 2024-04-11 21:33:15 +03:00
the big boss 063c81540d
IVC + support new settings and turbo model (#2067) 2024-04-11 21:29:19 +03:00
Cohee 5f6d895acf Add attribution links 2024-04-10 21:21:31 +03:00
Cohee c90105e9f6 Merge branch 'staging' into pollinations 2024-04-10 21:14:36 +03:00
based 540cddf300 new turbo model 2024-04-10 14:24:43 +10:00
Cohee fc1896dcff #2047 (WIP) Refactor TTS worker to use event source 2024-04-09 17:50:27 +03:00
Cohee 235afb5d15 Fix asset title for non-extension types 2024-04-09 11:30:24 +03:00
LenAnderson b461c6f0bb use generic popups for QR editor 2024-04-08 18:43:21 -04:00
RossAscends d56722a4b6 helper text and repo link tooltip for asset list items 2024-04-09 02:48:39 +09:00
Cohee c55181f955 Fix control alignment funkiness 2024-04-08 14:55:31 +03:00
LenAnderson 63cbfda9b1 add ctrl-enter to execute from editor 2024-04-07 17:01:26 -04:00
LenAnderson 21d3a7dc3e add tab size setting to QR editor 2024-04-07 17:01:02 -04:00
LenAnderson 3ed0564d73 add default value to qr editor wrap setting 2024-04-07 16:59:50 -04:00
Wolfsblvt e26c7827bc Fallback expression reset if custom expression deleted 2024-04-07 06:26:48 +02:00
Wolfsblvt 2ffb44b4e1 Add extension setting for fallback expression 2024-04-07 06:12:52 +02:00
Cohee 7cedce01a8 Merge branch 'release' into staging 2024-04-06 15:29:22 +03:00
johnbenac 3b6c32113f
added await to tts to properly catch the error on this async function 2024-04-05 18:57:51 -04:00
johnbenac 6cf897219e
Added toastr messages to tts index file 2024-04-05 18:41:36 -04:00
Cohee cdbd5c6130 /classify help text clarity 2024-04-06 00:45:38 +03:00
Cohee e75f5550e3 Add /classify command 2024-04-05 22:33:16 +03:00
Cohee 9e4b765db1 #2012 Replace all comfy seeds 2024-04-05 17:59:12 +03:00
Cohee acb623c6d8 Adjust automation id layout 2024-04-05 17:27:08 +03:00
Cohee 75ebdf394a Add pollinations as image generation source 2024-04-04 20:40:47 +03:00
Cohee 4d01000751 Switch default summary prompt builder to classic 2024-04-03 02:13:09 +03:00
Cohee d6b700483f Allow hyphens in SD prompts 2024-04-03 00:29:34 +03:00
Cohee 9221ddde57 +OpenRouter captioning models 2024-04-02 23:17:51 +03:00
Cohee c0fffde739 Fix SD "Raw last message" in groups 2024-04-02 13:15:31 +03:00
Cohee 9c6d8e6895 Update auto summary interval calculation algorithms 2024-04-01 18:57:42 +03:00
Cohee a5d00d356b Auto-calculate summary words 2024-04-01 02:11:52 +03:00
Cohee 159404c3e2 Hide "no WI/AN" in Extras summary mode 2024-04-01 01:18:29 +03:00
Cohee b990eb523b #1980 Add raw summary prompt builder mode 2024-03-31 21:22:27 +03:00
Cohee 2e28f24251 Fix summary controls disappearing when switching Chat Completion sources 2024-03-31 14:27:43 +03:00
Cohee a17206dd38 Merge branch 'staging' into instruct-rework 2024-03-30 14:56:37 +02:00
Cohee 9c7e29115f
Merge pull request #1989 from kir-gadjello/sd-drawthings-api
Implement drawthings local app api support for sd extension
2024-03-30 14:50:07 +02:00
Cohee 652987ae01 Add missing auth header 2024-03-30 14:23:50 +02:00
kir-gadjello dddcac9af8
implement drawthings local app api support for sd extension 2024-03-30 01:12:29 -03:00
Cohee 39768b78ce Decrease brightness of disabled inputs 2024-03-28 00:27:00 +02:00
LenAnderson dedb1625aa Merge branch 'staging' into qr-editor-wordwrap 2024-03-25 09:05:49 -04:00
LenAnderson 7c3ffcb3b1 qr editor wrap toggle 2024-03-25 09:04:41 -04:00
Cohee 67e78fa456 Add roles to summary injects 2024-03-23 19:18:43 +02:00
Cohee b0fbe9434d Fix token counter chunk sanitation 2024-03-21 20:18:02 +02:00
Cohee 176befcf8c Fix more than 9 regex groups 2024-03-21 12:12:22 +02:00
Cohee c606cd1295 Add SMEA/DYN controls for NAI Diffusion 2024-03-20 21:23:56 +02:00
Cohee b261c8c4a9 Extract API endpoints for images 2024-03-20 00:59:06 +02:00
Cohee 7dcd39c806 Extract API endpoints for quick replies 2024-03-20 00:46:46 +02:00
Cohee a97917d3f0 Remove asterisks from Novel TTS 2024-03-18 00:31:28 +02:00
Cohee d2f0a2fa60 Add option to replace <tagged> blocks in TTS 2024-03-18 00:31:16 +02:00
Cohee 6e5f4a86ba Fix skip codeblocks setting not loading 2024-03-18 00:17:17 +02:00
Cohee 8ead536da6 Add asset filters 2024-03-17 21:32:21 +02:00
Cohee 51f959c06b Replace quote extract separator for Silero TTS 2024-03-14 14:56:58 +02:00
Cohee 6ac8ef1b48 Add koboldcpp as a multimodal captioning source 2024-03-14 01:03:51 +02:00
Cohee 1f20833f44 Add Claude 3 Haiku 2024-03-13 23:56:08 +02:00
XTer 6c44f5b3fd 增加了提示性信息 2024-03-14 01:21:04 +08:00
XTer 42083b371b 添加了第一版GSVI的TTS适配 2024-03-14 00:36:56 +08:00
Cohee 5efdecc825 Add new OpenAI embedding models for selection 2024-03-12 21:41:30 +02:00
Kristian Schlikow 44a7dd3d74
Add NomicAI for vectorization (#1922)
* Crudely add NomicAi for vectorization

* Move NomicAI to its own endpoint, properly handle API key

* Adjust clear button html

* Remove leftover nomicai http header code

* Revert changes to openai-vectors.js

* Fix UI issues

* Revert change to settings, fix UI

---------

Co-authored-by: Cohee <18619528+Cohee1207@users.noreply.github.com>
2024-03-12 21:10:25 +02:00
Cohee 62a073c51a Merge branch 'release' into staging 2024-03-10 00:43:08 +02:00
johnbenac d9ff9e796b
Add tip to AllTalk endpoint field. 2024-03-09 15:57:01 -05:00
Cohee ae378789fe Merge branch 'release' into staging 2024-03-08 08:35:19 +02:00
johnbenac 8036a07df4
clarified placeholder comfyui text 2024-03-06 21:34:31 -05:00
based 3e1d44fc29 remove deprecated option + reverse proxy support in claude vision 2024-03-06 02:47:00 +10:00
based 64d9c9dc5d anthropic captioning 2024-03-05 07:07:38 +10:00
Cohee b490978142 Refactor vector models code 2024-03-02 23:16:18 +02:00
Kristan Schlikow adfb9c5097
Implement TogetherAI as vectorization provider 2024-03-01 23:52:49 +01:00
Cohee d1ca855d23 Debounce token counting in popup plugin 2024-03-01 21:42:49 +02:00
Cohee 9e5505a7d4 Autocomplete for WI automation IDs 2024-02-25 03:54:40 +02:00
Cohee 3441667336 #1853 Add WI/Script link by entry automation id 2024-02-24 17:22:51 +02:00
Cohee 7b8ac8f4c4 Properly use vector insert setting 2024-02-24 15:57:26 +02:00
Cohee 737a0bd3ae Fix purge extras and mistral vectors 2024-02-23 22:37:00 +02:00
Cohee cb536a7611 Save a list of safe to export secret keys 2024-02-23 21:41:54 +02:00
berbant eb89337f51
Update index.js 2024-02-22 23:49:47 +04:00
Cohee 3c2113a6e7 Add ability to preserve file names when loading from assets downloader 2024-02-19 00:17:23 +02:00
Cohee c06fe6abfc Add character asset type 2024-02-16 20:42:56 +02:00
Cohee 0da0d490c7 #1796 Attempt to fix alltalk on remote servers 2024-02-14 19:44:47 +02:00
Cohee 6ab918605e Allow single quotes in generated SD prompts 2024-02-14 15:39:56 +02:00
Cohee 8d4c4c1945 Only snap resolution if pixel counts change 2024-02-13 11:40:37 +02:00
Cohee b8387df15e #1826 Allow snapping to known resolutions for face/bg generations 2024-02-12 17:28:39 +02:00
Cohee df97f5364b Regex import/export 2024-02-10 21:57:22 +02:00
Cohee 867c42cb6d Add cyrillic special quotes to tts option 2024-02-09 18:33:01 +02:00
Cohee c3129da879 [skip ci] Lint fix 2024-02-07 19:28:34 +02:00
Cohee b158a86c25 Firefox copium for expression images 2024-02-05 02:21:20 +02:00
Juha Jeronen ad48d6666a fix bug: when switching talkinghead off, set character expression 2024-02-05 00:47:14 +02:00
Juha Jeronen 2a39db799a auto-pause Talkinghead when ST tab is hidden to save GPU resources 2024-02-05 00:46:44 +02:00
Juha Jeronen 91c4de6605 add `/th` (alias `/talkinghead`) to toggle Talkinghead on/off 2024-02-05 00:46:23 +02:00
Juha Jeronen 5ad2a0d064 refresh talkinghead char on expression zip upload 2024-02-05 00:45:50 +02:00
Juha Jeronen 3b526ce207 remove some useless comments 2024-02-05 00:45:37 +02:00
Juha Jeronen 169b1c2c63 talkinghead check: always check also whether the module is enabled 2024-02-05 00:45:20 +02:00
Juha Jeronen 9e8f3e0def one more debug message 2024-02-05 00:44:46 +02:00
Juha Jeronen eb634d597f add comment on TTS 2024-02-05 00:44:39 +02:00
Juha Jeronen 24b315a149 comments
The tech is "Talkinghead" (capital T), the Extras module is
"talkinghead" (lowercase t).
2024-02-05 00:44:26 +02:00
Juha Jeronen 83e264db9e add some debug messages 2024-02-05 00:40:03 +02:00
Cohee b7921f1edd #1630 Fix regex depth application 2024-02-04 21:34:17 +02:00
Cohee bdf7602fab Add SpeechT5 TTS provider 2024-02-04 20:31:20 +02:00
berbant ed875ec77d
Update index.js
Added new translateProvider: Lingva Translate
2024-01-31 22:42:28 +04:00
Cohee f732b8ae4c Add optional module to vectors manifest 2024-01-27 23:09:41 +02:00
Cohee 3cf01e765a #1741 Filter non-unique chunks 2024-01-26 04:18:15 +02:00
Cohee e627e89722
Merge pull request #1726 from Technologicat/tooltips-vol1
add/improve tooltips
2024-01-24 22:50:02 +02:00
Cohee 3f3529ef89 #1630 Add min/max depth for prompt/display regex scripts. 2024-01-24 22:48:58 +02:00
Cohee e537def312 Add return value to /sd command and quiet flag 2024-01-24 20:15:10 +02:00
Juha Jeronen 0683d7a538 Merge branch 'staging' into tooltips-vol1 2024-01-24 17:05:09 +02:00
Cohee 532c86b051
Merge pull request #1737 from Technologicat/vectordb-with-extras
Initial support for Extras vectorizer, for Vector Storage
2024-01-24 17:01:54 +02:00
Cohee 0ad756c923 Add check for "embeddings" module. 2024-01-24 16:51:57 +02:00
Cohee b4e7ee05e6 Remove regex replace strategy selector 2024-01-24 16:10:50 +02:00
Juha Jeronen 8b43535352 Initial support for Extras vectorizer, for Vector Storage 2024-01-24 15:16:55 +02:00
Juha Jeronen 6a03980db6 add/improve tooltips 2024-01-22 15:56:12 +02:00