6b656bf380
Expressions: Classify using LLM
...
Rather than using a separate BERT model to classify the last message,
use the LLM itself to get the classified expression label as a JSON
and set that as the current sprite. Doing this should take more information
into consideration and cut down on extra processing.
This is made possible by the use of constrained generation with JSON
schemas. Only available to TabbyAPI since it's the only backend that
supports the use of JSON schemas, but there can hopefully be a way
to use this with other backends as well.
Intercepts the generation and sets top_k = 1 (for greedy sampling)
and the json_schema to an emotion enum. Doing this also prevents
reingestion of the entire context every time a message is sent and
then asked to be classified, which doesn't compromise the chat
experience.
Signed-off-by: kingbri <bdashore3@proton.me>
2024-04-12 01:55:16 -04:00
356f1f9c39
Clean-up non-character state checks
2024-04-11 23:50:01 +03:00
123131074c
Change built-in extensions template render to async
2024-04-11 23:38:44 +03:00
3da9fb4efe
Switch to module exports
2024-04-11 22:39:42 +03:00
6290dff3d9
#2065 Add option to translate text before classification
2024-04-11 22:09:05 +03:00
210f388d7a
Switch button style to use class
2024-04-11 21:33:15 +03:00
063c81540d
IVC + support new settings and turbo model ( #2067 )
2024-04-11 21:29:19 +03:00
5f6d895acf
Add attribution links
2024-04-10 21:21:31 +03:00
c90105e9f6
Merge branch 'staging' into pollinations
2024-04-10 21:14:36 +03:00
540cddf300
new turbo model
2024-04-10 14:24:43 +10:00
fc1896dcff
#2047 (WIP) Refactor TTS worker to use event source
2024-04-09 17:50:27 +03:00
235afb5d15
Fix asset title for non-extension types
2024-04-09 11:30:24 +03:00
b461c6f0bb
use generic popups for QR editor
2024-04-08 18:43:21 -04:00
d56722a4b6
helper text and repo link tooltip for asset list items
2024-04-09 02:48:39 +09:00
c55181f955
Fix control alignment funkiness
2024-04-08 14:55:31 +03:00
63cbfda9b1
add ctrl-enter to execute from editor
2024-04-07 17:01:26 -04:00
21d3a7dc3e
add tab size setting to QR editor
2024-04-07 17:01:02 -04:00
3ed0564d73
add default value to qr editor wrap setting
2024-04-07 16:59:50 -04:00
e26c7827bc
Fallback expression reset if custom expression deleted
2024-04-07 06:26:48 +02:00
2ffb44b4e1
Add extension setting for fallback expression
2024-04-07 06:12:52 +02:00
7cedce01a8
Merge branch 'release' into staging
2024-04-06 15:29:22 +03:00
3b6c32113f
added await to tts to properly catch the error on this async function
2024-04-05 18:57:51 -04:00
6cf897219e
Added toastr messages to tts index file
2024-04-05 18:41:36 -04:00
cdbd5c6130
/classify help text clarity
2024-04-06 00:45:38 +03:00
e75f5550e3
Add /classify command
2024-04-05 22:33:16 +03:00
9e4b765db1
#2012 Replace all comfy seeds
2024-04-05 17:59:12 +03:00
acb623c6d8
Adjust automation id layout
2024-04-05 17:27:08 +03:00
75ebdf394a
Add pollinations as image generation source
2024-04-04 20:40:47 +03:00
4d01000751
Switch default summary prompt builder to classic
2024-04-03 02:13:09 +03:00
d6b700483f
Allow hyphens in SD prompts
2024-04-03 00:29:34 +03:00
9221ddde57
+OpenRouter captioning models
2024-04-02 23:17:51 +03:00
c0fffde739
Fix SD "Raw last message" in groups
2024-04-02 13:15:31 +03:00
9c6d8e6895
Update auto summary interval calculation algorithms
2024-04-01 18:57:42 +03:00
a5d00d356b
Auto-calculate summary words
2024-04-01 02:11:52 +03:00
159404c3e2
Hide "no WI/AN" in Extras summary mode
2024-04-01 01:18:29 +03:00
b990eb523b
#1980 Add raw summary prompt builder mode
2024-03-31 21:22:27 +03:00
2e28f24251
Fix summary controls disappearing when switching Chat Completion sources
2024-03-31 14:27:43 +03:00
a17206dd38
Merge branch 'staging' into instruct-rework
2024-03-30 14:56:37 +02:00
9c7e29115f
Merge pull request #1989 from kir-gadjello/sd-drawthings-api
...
Implement drawthings local app api support for sd extension
2024-03-30 14:50:07 +02:00
652987ae01
Add missing auth header
2024-03-30 14:23:50 +02:00
dddcac9af8
implement drawthings local app api support for sd extension
2024-03-30 01:12:29 -03:00
39768b78ce
Decrease brightness of disabled inputs
2024-03-28 00:27:00 +02:00
dedb1625aa
Merge branch 'staging' into qr-editor-wordwrap
2024-03-25 09:05:49 -04:00
7c3ffcb3b1
qr editor wrap toggle
2024-03-25 09:04:41 -04:00
67e78fa456
Add roles to summary injects
2024-03-23 19:18:43 +02:00
b0fbe9434d
Fix token counter chunk sanitation
2024-03-21 20:18:02 +02:00
176befcf8c
Fix more than 9 regex groups
2024-03-21 12:12:22 +02:00
c606cd1295
Add SMEA/DYN controls for NAI Diffusion
2024-03-20 21:23:56 +02:00
b261c8c4a9
Extract API endpoints for images
2024-03-20 00:59:06 +02:00
7dcd39c806
Extract API endpoints for quick replies
2024-03-20 00:46:46 +02:00
a97917d3f0
Remove asterisks from Novel TTS
2024-03-18 00:31:28 +02:00
d2f0a2fa60
Add option to replace <tagged> blocks in TTS
2024-03-18 00:31:16 +02:00
6e5f4a86ba
Fix skip codeblocks setting not loading
2024-03-18 00:17:17 +02:00
8ead536da6
Add asset filters
2024-03-17 21:32:21 +02:00
51f959c06b
Replace quote extract separator for Silero TTS
2024-03-14 14:56:58 +02:00
6ac8ef1b48
Add koboldcpp as a multimodal captioning source
2024-03-14 01:03:51 +02:00
1f20833f44
Add Claude 3 Haiku
2024-03-13 23:56:08 +02:00
6c44f5b3fd
增加了提示性信息
2024-03-14 01:21:04 +08:00
42083b371b
添加了第一版GSVI的TTS适配
2024-03-14 00:36:56 +08:00
5efdecc825
Add new OpenAI embedding models for selection
2024-03-12 21:41:30 +02:00
44a7dd3d74
Add NomicAI for vectorization ( #1922 )
...
* Crudely add NomicAi for vectorization
* Move NomicAI to its own endpoint, properly handle API key
* Adjust clear button html
* Remove leftover nomicai http header code
* Revert changes to openai-vectors.js
* Fix UI issues
* Revert change to settings, fix UI
---------
Co-authored-by: Cohee <18619528+Cohee1207@users.noreply.github.com>
2024-03-12 21:10:25 +02:00
62a073c51a
Merge branch 'release' into staging
2024-03-10 00:43:08 +02:00
d9ff9e796b
Add tip to AllTalk endpoint field.
2024-03-09 15:57:01 -05:00
ae378789fe
Merge branch 'release' into staging
2024-03-08 08:35:19 +02:00
8036a07df4
clarified placeholder comfyui text
2024-03-06 21:34:31 -05:00
3e1d44fc29
remove deprecated option + reverse proxy support in claude vision
2024-03-06 02:47:00 +10:00
64d9c9dc5d
anthropic captioning
2024-03-05 07:07:38 +10:00
b490978142
Refactor vector models code
2024-03-02 23:16:18 +02:00
adfb9c5097
Implement TogetherAI as vectorization provider
2024-03-01 23:52:49 +01:00
d1ca855d23
Debounce token counting in popup plugin
2024-03-01 21:42:49 +02:00
9e5505a7d4
Autocomplete for WI automation IDs
2024-02-25 03:54:40 +02:00
3441667336
#1853 Add WI/Script link by entry automation id
2024-02-24 17:22:51 +02:00
7b8ac8f4c4
Properly use vector insert setting
2024-02-24 15:57:26 +02:00
737a0bd3ae
Fix purge extras and mistral vectors
2024-02-23 22:37:00 +02:00
cb536a7611
Save a list of safe to export secret keys
2024-02-23 21:41:54 +02:00
eb89337f51
Update index.js
2024-02-22 23:49:47 +04:00
3c2113a6e7
Add ability to preserve file names when loading from assets downloader
2024-02-19 00:17:23 +02:00
c06fe6abfc
Add character asset type
2024-02-16 20:42:56 +02:00
0da0d490c7
#1796 Attempt to fix alltalk on remote servers
2024-02-14 19:44:47 +02:00
6ab918605e
Allow single quotes in generated SD prompts
2024-02-14 15:39:56 +02:00
8d4c4c1945
Only snap resolution if pixel counts change
2024-02-13 11:40:37 +02:00
b8387df15e
#1826 Allow snapping to known resolutions for face/bg generations
2024-02-12 17:28:39 +02:00
df97f5364b
Regex import/export
2024-02-10 21:57:22 +02:00
867c42cb6d
Add cyrillic special quotes to tts option
2024-02-09 18:33:01 +02:00
c3129da879
[skip ci] Lint fix
2024-02-07 19:28:34 +02:00
b158a86c25
Firefox copium for expression images
2024-02-05 02:21:20 +02:00
ad48d6666a
fix bug: when switching talkinghead off, set character expression
2024-02-05 00:47:14 +02:00
2a39db799a
auto-pause Talkinghead when ST tab is hidden to save GPU resources
2024-02-05 00:46:44 +02:00
91c4de6605
add `/th` (alias `/talkinghead`) to toggle Talkinghead on/off
2024-02-05 00:46:23 +02:00
5ad2a0d064
refresh talkinghead char on expression zip upload
2024-02-05 00:45:50 +02:00
3b526ce207
remove some useless comments
2024-02-05 00:45:37 +02:00
169b1c2c63
talkinghead check: always check also whether the module is enabled
2024-02-05 00:45:20 +02:00
9e8f3e0def
one more debug message
2024-02-05 00:44:46 +02:00
eb634d597f
add comment on TTS
2024-02-05 00:44:39 +02:00
24b315a149
comments
...
The tech is "Talkinghead" (capital T), the Extras module is
"talkinghead" (lowercase t).
2024-02-05 00:44:26 +02:00
83e264db9e
add some debug messages
2024-02-05 00:40:03 +02:00
b7921f1edd
#1630 Fix regex depth application
2024-02-04 21:34:17 +02:00
bdf7602fab
Add SpeechT5 TTS provider
2024-02-04 20:31:20 +02:00
ed875ec77d
Update index.js
...
Added new translateProvider: Lingva Translate
2024-01-31 22:42:28 +04:00
f732b8ae4c
Add optional module to vectors manifest
2024-01-27 23:09:41 +02:00
3cf01e765a
#1741 Filter non-unique chunks
2024-01-26 04:18:15 +02:00
e627e89722
Merge pull request #1726 from Technologicat/tooltips-vol1
...
add/improve tooltips
2024-01-24 22:50:02 +02:00
3f3529ef89
#1630 Add min/max depth for prompt/display regex scripts.
2024-01-24 22:48:58 +02:00
e537def312
Add return value to /sd command and quiet flag
2024-01-24 20:15:10 +02:00
0683d7a538
Merge branch 'staging' into tooltips-vol1
2024-01-24 17:05:09 +02:00
532c86b051
Merge pull request #1737 from Technologicat/vectordb-with-extras
...
Initial support for Extras vectorizer, for Vector Storage
2024-01-24 17:01:54 +02:00
0ad756c923
Add check for "embeddings" module.
2024-01-24 16:51:57 +02:00
b4e7ee05e6
Remove regex replace strategy selector
2024-01-24 16:10:50 +02:00
8b43535352
Initial support for Extras vectorizer, for Vector Storage
2024-01-24 15:16:55 +02:00
6a03980db6
add/improve tooltips
2024-01-22 15:56:12 +02:00
e2becdf7a9
Add typedefs for TTS audioJob
2024-01-21 15:19:13 +02:00
f3fc3f12a7
Merge pull request #1716 from Tony-sama/staging
...
VRM extension support
2024-01-21 15:12:44 +02:00
ffbf35e468
Update index.js
2024-01-21 15:11:47 +02:00
b2509f8de4
Rethrow AllTalk init error
2024-01-20 20:44:11 +02:00
570d5a30bd
[skip ci] Lint fix
2024-01-20 20:40:40 +02:00
2846d0fd58
#1720 Fetch no-cache images when uploading
2024-01-20 19:48:56 +02:00
b741f32ae9
Clean comments
2024-01-19 09:34:32 +01:00
5b201bce7a
Merge branch 'SillyTavern:staging' into staging
2024-01-19 09:26:28 +01:00
9ce2771dad
make finalizeInit blocking just to be sure
2024-01-18 20:47:46 +00:00
65d9c944d8
await init and wait for APP_READY
2024-01-18 20:43:31 +00:00
8874ffffc5
Adjust UI label.
...
Group members are peacenik
2024-01-18 18:23:00 +02:00
4f55824d7f
QR auto-execute on group member draft
2024-01-18 18:08:38 +02:00
d19ba9a68c
Fix format
2024-01-18 02:36:18 +02:00
05d292e055
Merge branch 'staging' into erew123/release
2024-01-18 02:35:26 +02:00
9aa4b50a86
Merge pull request #1709 from LenAnderson/qr-autoexec-queue
...
queue all auto-executes until APP_READY
2024-01-18 01:11:19 +02:00
3af2164187
AllTalk Updates
...
Streaming passed URL to global ST audio.
Localstorage removed for saving TTS elements.
Styles stored in CSS
Duplicate checks on fetchresponse removed.
2024-01-17 21:55:24 +00:00
f293c20e9f
Merge branch 'SillyTavern:release' into release
2024-01-17 21:28:08 +00:00
12a40c25a0
fix QR settings UI out of sync after update via API
2024-01-17 20:41:59 +00:00
6fe17a1bed
queue all auto-executes until APP_READY
2024-01-17 20:32:25 +00:00
617cabd7b5
Merge pull request #1707 from LenAnderson/qr-fixes
...
Several QR fixes
2024-01-17 11:12:38 +02:00
1a50c9f976
use isTrueBoolean on all bools
2024-01-16 22:40:40 +00:00
9f4ae351db
fix bools in /qr-update
2024-01-16 22:37:12 +00:00
acaae1b973
fix type in helpstring
2024-01-16 22:36:55 +00:00
7af43023b1
init quick replies immediately
2024-01-16 21:04:25 +00:00
a8a993c5ba
Update tts processing to keep track of character for VRM lip sync.
2024-01-16 04:54:14 +01:00
baab494ed4
Merge branch 'SillyTavern:staging' into staging
2024-01-16 00:15:13 +01:00
25a695c783
Await QR auto-execution
2024-01-15 19:30:14 +02:00
d72b5125ac
Merge branch 'SillyTavern:release' into release
2024-01-15 14:51:47 +00:00
017ac8a515
Added vrm tts lip sync call
2024-01-14 04:26:06 +01:00
b78350cc8e
AllTalk initial commit
...
AllTalk TTS initial commit from https://github.com/erew123/alltalk_tts
ST index.js is updated to have "Pass Asterisks to TTS Engine" which allows AllTalk to split text as character/narrator voices. This setting has been left disabled as standard, so wont affect other TTS engines. The setting will save along with other settings on the page (if checked).
2024-01-13 19:43:38 +00:00
b528520693
read and send talkinghead per-character configs
2024-01-12 18:26:14 +02:00
c1010edb37
Merge pull request #1641 from bdashore3/regex-upgrade
...
Regex: Updates
2024-01-11 02:56:41 +02:00
a126bd3422
Specify that overlay doesn't work
2024-01-11 02:42:08 +02:00
8a7519c6e7
Replace match with $0
2024-01-11 02:41:00 +02:00
8c67823cb2
Add hints
2024-01-11 02:40:11 +02:00
810667e8e7
Slight increase processing delay
2024-01-09 20:17:17 +02:00
63ab16161f
Add check for enabled module
2024-01-09 19:52:49 +02:00
e4efb3a10a
Merge branch 'staging' into talkinghead-talkinganim
2024-01-09 19:45:03 +02:00
1f8513ae6f
Merge pull request #1659 from LenAnderson/gallery-list-command
...
add /list-gallery command to gallery extension
2024-01-08 20:37:33 +02:00
6d37519220
add /list-gallery command to gallery extension
2024-01-08 11:15:09 +00:00
87b05e2e2d
enable talkinghead's talking animation while the LLM is streaming
2024-01-08 00:47:59 +02:00
39c485ab25
some missed refactorings
2024-01-08 00:47:40 +02:00
1184ea2c3b
clarity
2024-01-08 00:47:18 +02:00
3f3e68c492
document some functions
2024-01-08 00:46:54 +02:00
ec86466d11
Merge pull request #1639 from Technologicat/talkinghead-nospritecheck
...
Talkinghead nospritecheck
2024-01-07 21:24:05 +02:00
ad94ba57b1
Move clear function names
2024-01-07 21:14:29 +02:00
53c86c66eb
fix API added sets without listeners
...
fixes #1647
2024-01-07 11:13:56 +00:00
e3d1008aa1
Merge pull request #1646 from LenAnderson/qr-fix-run
2024-01-07 02:34:57 +02:00
e264bc0ac4
Merge pull request #1645 from LenAnderson/qr-fix-macros
2024-01-07 02:34:25 +02:00
00041ca01a
fix missing return from execute
2024-01-07 00:16:44 +00:00
fffdd8e5d8
fix missing substituteParams when executing non-command QRs
2024-01-07 00:11:30 +00:00
5594aa456b
fix jQuery sortable breaking select elements
2024-01-06 18:21:08 +00:00
97cca9467b
Regex: Switch filterString to foreach
...
Foreach is more performat than for const. That was used for debugging.
Signed-off-by: kingbri <bdashore3@proton.me>
2024-01-06 00:33:52 -05:00
a0a69e357d
Regex: Update to capture group logic
...
Currently doesn't support the overlay method for regex scripts. That
will have to be added in a future commit.
People can refer to capture groups using $1, $2, etc. {{match}} gets
aliased to $1.
Signed-off-by: kingbri <bdashore3@proton.me>
2024-01-06 00:30:25 -05:00
5bc08ab8c1
check also that expressions is running with extras
2024-01-06 02:48:39 +02:00
e6ade18b58
ehm, once more, correctly.
2024-01-06 02:23:10 +02:00
d1e9c59e72
meh, don't check for static sprite, correctly
2024-01-06 02:17:07 +02:00
2d85d7e1e1
talkinghead mode: don't check for existence of static emote sprite
2024-01-06 02:10:09 +02:00
a7c6f4f56e
refresh live char when a new talkinghead image is uploaded
2024-01-06 02:09:34 +02:00
7f4a45a4a3
add comment
2024-01-06 02:09:27 +02:00
f14a1da55f
Make big QR editor monospace
2024-01-05 19:31:26 +02:00
7aa0368a13
improve modal editor for small screens
2024-01-05 16:54:26 +00:00
741fc10a9c
Merge branch 'qr-rewrite' of https://github.com/LenAnderson/SillyTavern into qr-rewrite
2024-01-05 16:45:42 +00:00
7049ec0e12
add empty string fallbacks for old QRs
2024-01-05 16:45:36 +00:00
e117c9da4e
reduce size of show buttons checkbox
2024-01-05 16:44:57 +00:00
f3f6923619
Merge branch 'staging' into qr-rewrite
2024-01-05 17:35:35 +02:00
6c03e81d8d
chore: format fix
2024-01-05 15:45:05 +02:00
38fcbe0bdf
Merge branch 'staging' into talkinghead-emote
2024-01-05 15:40:20 +02:00
77c11b8f2b
set_emotion is not supported by old talkinghead versions
2024-01-05 12:15:24 +02:00
b57b42d26a
Merge branch 'staging' into qr-rewrite
2024-01-04 22:37:38 +00:00
926f94b01d
Add regex test mode
2024-01-04 04:34:38 +02:00
03f9d8d278
Fix settings UI loading
2024-01-03 21:35:04 +02:00
446445ab90
Put streaming checkbox on top
2024-01-03 21:25:08 +02:00
f0a330455f
More smooth speed step
2024-01-03 21:23:01 +02:00
dc8e742502
Only change remote setting if endpoint is configured
2024-01-03 21:19:46 +02:00
7168dbe508
Lint fix
2024-01-03 21:17:36 +02:00
f06443fe7c
Merge branch 'staging' into xtts-more-controls
2024-01-03 21:15:56 +02:00
18b11825b3
#1629 Use string replace instead of while loop
2024-01-03 19:53:24 +02:00
04d3dcf39f
Respect match index in regex scripts replacement
2024-01-03 12:28:56 +02:00
cc2df97959
Increased the maximum limit of tokens for xtts streaming
2024-01-02 20:13:45 +03:00
8ef91ae181
Add ability to customize xtts stream chunk size
2024-01-02 19:50:13 +03:00
36db08d6b8
Remove error about updating xtts parameters
2024-01-02 19:23:42 +03:00
757eba1ef8
add missing space
2024-01-02 19:07:30 +03:00
4190e9f16d
change xtts generation settings
2024-01-02 19:01:12 +03:00
99244a0c11
Add support for XTTS streaming
2024-01-02 07:04:32 +02:00
059f61fee8
add "/emote xxx" support for talkinghead (when VN mode off)
2024-01-02 02:18:54 +02:00
70d6e6d37f
prevent inject on auto-execute
2024-01-01 23:08:18 +00:00
473326b3fb
remove unused import
2024-01-01 22:40:12 +00:00
67f1127f8d
Merge branch 'qr-rewrite' of https://github.com/LenAnderson/SillyTavern into qr-rewrite
2024-01-01 22:35:00 +00:00
95d5cf509d
fix auto exec on chat changed
2024-01-01 22:34:57 +00:00
kingbri
Cohee
the big boss
based
LenAnderson
RossAscends
Wolfsblvt
johnbenac
kir-gadjello
XTer
Kristian Schlikow
Kristan Schlikow
berbant
Juha Jeronen
Tony Ribeiro
Tony Ribeiro
erew123
Danil Boldyrev