Commit Graph

359 Commits

Author SHA1 Message Date
Tony Ribeiro
ca9e6583c6 Moved path of defaulf bgm/ambient sounds 2023-08-21 23:33:31 +02:00
Tony Ribeiro
84e397c429 - Audio
- refactored dynamic bgm to handle solo and group chat
        - added bgm cooldown variable, user can custom in the ui
2023-08-21 23:33:31 +02:00
Tony Ribeiro
61827d6cf8 - RVC
- Added user to character list for mapping
    - Audio
        - Corrected initialization of extension settings
        - reduce debug logs
    - Coqui:
        - Added user to character list for mapping
2023-08-21 23:33:31 +02:00
Tony Ribeiro
58b33240a2 Add initialization of audio module key in extension settings. 2023-08-21 23:33:31 +02:00
Tony Ribeiro
25daa61e83 Audio module proper extension code. Dedicated Audio extension scripts. Simple UI to adjust bgm/ambient. Load bgm per character from character folder and switch audio dynamically w.r.t. expression. Ambient sound updated when background change. 2023-08-21 23:33:30 +02:00
Tony Ribeiro
8590de7229 Redesigned RVC UI for easier use and intelligibility 2023-08-21 23:33:30 +02:00
Tony Ribeiro
51fdff5ea3 Prototype of dynamic background music using expression extension 2023-08-21 23:33:30 +02:00
Tony Ribeiro
c39e4ce274 Prototype of RVC+classification pipeline 2023-08-21 23:33:30 +02:00
Cohee
f5624d4392 Add ability to disable auto-summarization 2023-08-21 23:56:22 +03:00
city-unit
189895bd01 Just added uploading via drag/drop 2023-08-21 12:16:10 -04:00
city-unit
c7d9eb39f5 Remove img filter, move file loader to utils 2023-08-21 11:21:32 -04:00
Cohee
1da5ea5280 #988 Experimental fix for 11labs 2023-08-21 14:40:38 +03:00
city-unit
7177fec50c Refactor 2023-08-21 00:55:28 -04:00
city-unit
3f04a5bfa0 Merge branch 'staging' of https://github.com/city-unit/SillyTavern into feature/exorcism 2023-08-21 00:47:35 -04:00
city-unit
82adc4c780 Merge branch 'feature/exorcism' of https://github.com/city-unit/SillyTavern into feature/exorcism 2023-08-21 00:46:47 -04:00
city-unit
18e6d3ad17 A gallery viewer, powered by nanogallery2. 2023-08-21 00:46:25 -04:00
city-unit
0d7d68d9dc Err the actual lib 2023-08-21 00:44:55 -04:00
city-unit
bbc476b839 Add gallery libs (can move to libs) 2023-08-21 00:44:18 -04:00
Cohee
4ea9e481a8
Merge branch 'staging' into staging 2023-08-21 01:51:12 +03:00
kingbri
ad2be21531 Generate: Fix appends on continue
Continue was in a semi-working state. However, the generated prompt
by continue was a mess and didn't remove essential parts such as
character name and prompt bias. This caused duplication and bad
generations.

Now, append the prompt bias after the CFG has been appended and then
clean up the continued cache before adding it to the final prompt.

Signed-off-by: kingbri <bdashore3@proton.me>
2023-08-20 17:36:35 -04:00
Cohee
01cdcfa198 Remove substitutions in extensions where not necessary 2023-08-20 21:37:17 +03:00
Cohee
106f7afdcb Slight performance increase for opening large World Infos 2023-08-20 13:15:02 +03:00
Cohee
94754af013 Reformat code 2023-08-20 12:37:38 +03:00
Cohee
84e5a63c34 Fix SD group gen bugs 2023-08-20 12:29:20 +03:00
Cohee
692c1a5e60 Fix background SD gens 2023-08-20 12:16:29 +03:00
kingbri
ac319dbd30 CFG: Add positive prompt support and fixes
Positive prompts are the opposite of negative prompts. This helps
make the mixing process more accurate by keeping the negative differences
as close as possible to the positive ones by including this prompt.

In addition, fix prompt insertion order at a depth of 0 by hijacking
the same function used for Author's Note as a zero depth anchor.

Signed-off-by: kingbri <bdashore3@proton.me>
2023-08-20 02:22:23 -04:00
city-unit
e8c996ff61 Move to char+timestamp for img naming. 2023-08-20 01:41:58 -04:00
kingbri
92e6c6a998 CFG: Use ST prompt builder for negatives
Make the generate function build a negative prompt in addition to the
normal one. This allows for nonconflicting insertion with other extension
prompts and World Info.

Signed-off-by: kingbri <bdashore3@proton.me>
2023-08-20 00:44:39 -04:00
city-unit
f70baff95e Comment tweaks 2023-08-20 00:33:37 -04:00
city-unit
3ce8343016 Add comments and stuff 2023-08-20 00:15:57 -04:00
city-unit
c1d43c9e68 Remove base64 from groups too 2023-08-19 23:53:34 -04:00
city-unit
2f09efcd7f Exorcised base64 image stuff 2023-08-19 23:01:09 -04:00
kingbri
7191f7a8ad CFG: Add insertion depth and custom separator
Insertion depth allows for CFG to variably inject itself into the
negative prompt. This is similar to how Author's note works.

However, this method of insertion depth conflicts with AN and
world info where negatives can be meshed between two lines
of those specific insertions.

A custom separator must be wrapped in quotes, otherwise the default
separator is a newline for negative cascading.

Signed-off-by: kingbri <bdashore3@proton.me>
2023-08-19 01:29:59 -04:00
kingbri
cdbca6d9fd CFG: Include the entire prompt with negative prompt
CFG with LLMs works differently than stable diffusion. The main principle
is prompt mixing and utilizing the differences between the two prompts
rather than a full "negative prompt" of what the user doesn't want.

SillyTavern its own way of formatting a prompt sent to an LLM backend.
Therefore, take that prompt and add negatives to it.

Signed-off-by: kingbri <bdashore3@proton.me>
2023-08-18 22:18:09 -04:00
deffcolony
33a5a026d5 removes width: 100% from img.expression
this will fix the image resolution on mobile
2023-08-18 15:13:41 +02:00
Cohee
9bd9ddb9e1 Fix expressions display 2023-08-18 14:47:59 +03:00
Cohee
c4d8d70103 Improve phone usability of sortable drags 2023-08-18 13:41:46 +03:00
Cohee
75378eff4e #937 Add dynamic chat backgrounds generation 2023-08-18 00:41:21 +03:00
Tony Ribeiro
16f3949e0b merging with myself :p 2023-08-17 21:39:19 +02:00
Tony Ribeiro
a5c95c7151 Added full coqui-api model list available via new origin in Coqui UI: Coqui API (Experimental). Some model might not work, need to be tested. 2023-08-17 21:33:06 +02:00
Cohee
50005b5617 Reformat rvc/tts plugins 2023-08-17 12:05:17 +03:00
Tony Ribeiro
58123f5c29 Added RVC upload functionality, allow to send rvc model archive (zip/7z format) to extras, automatically installed properly on server side. 2023-08-17 04:47:41 +02:00
Tony Ribeiro
a07637aa43 Coqui TTS UI, added a button to remove choosen character from the voice map. Fixed the request spam to extras when there is no local coqui model or no rvc model in extras folder. 2023-08-17 01:16:57 +02:00
Tony Ribeiro
6dce566cb9 Coqui TTS UI, corrected hiding model div when origin select is none 2023-08-16 21:31:51 +02:00
Tony Ribeiro
cd097df42f Change RVC pitch extraction "" label to "None" 2023-08-16 20:13:29 +02:00
Tony Ribeiro
05504ebbb2
Merge branch 'SillyTavern:staging' into staging 2023-08-16 19:19:29 +02:00
Tony Ribeiro
735066fe10 Added Coqui TTS extension option to use local models (no language/no speakers) 2023-08-16 19:19:13 +02:00
Cohee
99c3a09b8e Reduce unnecessary console spam 2023-08-16 18:54:52 +03:00
Cohee
1fa281b03c
Merge pull request #946 from Tony-sama/staging
RVC extension new UI and per character settings
2023-08-16 17:49:24 +03:00
Cohee
3682924624 Round context messages to nearest 5 for auto-adjust 2023-08-16 17:22:42 +03:00
Tony Ribeiro
a64130c71c Remove toastr error for character without RVC model assigned, just show it in console info to allow group chat with/withou RVC per character. 2023-08-15 21:35:07 +02:00
Tony Ribeiro
3cb2b7a4a9
Merge branch 'SillyTavern:staging' into staging 2023-08-15 21:15:45 +02:00
Tony Ribeiro
84845ae911 Updated RVC UI to allow per characters settings without manual voice map text. 2023-08-15 21:15:31 +02:00
Cohee
ba8fa8bd0c Merge branch 'release' into staging 2023-08-15 21:38:51 +03:00
joe
f0d208f929 Add speed-speech due to fast processing time 2023-08-15 19:37:15 +09:00
joe
36c6f57d96 Added stop to lip sync when user stops TTS early 2023-08-15 19:25:42 +09:00
Cohee
3850e6b50a Replace object stores for Chroma and token cache 2023-08-14 22:19:14 +03:00
Cohee
32745609a2
Merge pull request #936 from Tony-sama/staging
Refactoring of Coqui TTS extension
2023-08-14 14:00:45 +03:00
Cohee
a0bfc67632 Add hint for CFG scale 2023-08-14 12:50:00 +03:00
Tony Ribeiro
f97cc5694d refresh character even when module is not detected 2023-08-14 05:14:21 +02:00
Tony Ribeiro
213099dd6d removed debug messages 2023-08-14 05:05:10 +02:00
Tony Ribeiro
5816d2d6a6 Correct typo in tts index file that cause tts provider settings to be destroyed. 2023-08-14 05:03:42 +02:00
Tony Ribeiro
40d4123f08 Correct typo in tts index file that cause tts provider settings to be destroyed. 2023-08-14 04:59:11 +02:00
Tony Ribeiro
e97863a0da Merge branch 'staging' of https://github.com/Tony-sama/SillyTavern into staging 2023-08-14 04:03:34 +02:00
Tony Ribeiro
c414606c81 Finished new version of coqui TTS UI. 2023-08-14 04:03:28 +02:00
Tony Ribeiro
fdc9349f68
Merge branch 'SillyTavern:staging' into staging 2023-08-14 04:01:32 +02:00
Cohee
c0bc425c8b Debounce manager changes 2023-08-13 18:43:17 +03:00
Cohee
bd3933bcbf
Merge pull request #905 from bdashore3/cfg-window
Add CFG side panel
2023-08-13 14:55:03 +03:00
kingbri
43e91b150a CFG: Add groupchat support
Groupchats have their CFG defined a little differently. Chat and
global CFGs are publicly accessible within the window. As a compromise,
individual character CFGs can be injected as part of each character's
prompt. However, these CFG settings need to be adjusted in the character's
individual chats which will carry over to the group.

In addition, make this character logic gated under a checkbox to
always prefer chat unless explicitly specified. Negative cascading
is still open, so individual character negatives can be included
at any time.

Signed-off-by: kingbri <bdashore3@proton.me>
2023-08-12 22:52:34 -04:00
Tony Ribeiro
e60f91ce42 Finished unefficient full coqui pipeline, UI generated through request to extras. Need to be pruned 2023-08-13 02:18:46 +02:00
kingbri
4a21ee0337 CFG: Add ability to combine negative prompts
This allows for flexibility with global, character, and chat negative
prompts. Combining prompts is very useful for users who want to maintain
a set of global negatives and then add extra layers on top of that. The
ordering is chat -> character -> global tags due to the specificity of
each.

The guidance scale follows the cascade of chat -> character -> global
due to being one number that is set when CFG is fired. If the guidance
scale is 1, nothing happens.

Signed-off-by: kingbri <bdashore3@proton.me>
2023-08-12 16:25:35 -04:00
Tony Ribeiro
1eb4dd9a4f
Merge branch 'SillyTavern:staging' into staging 2023-08-12 14:36:23 +02:00
Cohee1207
b77cc8672d #923 Fix chroma checkbox not saving 2023-08-12 15:32:18 +03:00
Tony Ribeiro
395de0fab8 Started refactoring of Coqui-tts extension. 2023-08-12 06:05:39 +02:00
Tony Ribeiro
362df6b144 Merge branch 'staging' of https://github.com/Tony-sama/SillyTavern into staging 2023-08-11 14:50:25 +02:00
Tony Ribeiro
a7cf04f057 Change RVC voice map syntax to use ":" in place of "=". Add toastr info feed for both success and failed map on apply. 2023-08-11 14:50:04 +02:00
joe
9fec82bd31 Add / Update talking lips animations 2023-08-11 14:43:53 +09:00
kingbri
5bb6c89868 CFG: Add per-chat CFG and fixes
Per-chat CFG applies a CFG setting per-chat only rather than character
or globally. This overrides all other CFG settings (this will be changed).

Also add fixes to remove character CFG entries properly and not to
apply CFG if the scale is 1 as that won't do anything to generation.

Signed-off-by: kingbri <bdashore3@proton.me>
2023-08-11 01:39:15 -04:00
kingbri
63ee7d4e10 CFG: Add per-character support
Adds per-character CFG as a drop-in replacement for global CFG. If
the use character CFG checkbox isn't checked, the global one will be
used.

Signed-off-by: kingbri <bdashore3@proton.me>
2023-08-11 01:39:15 -04:00
kingbri
0c94740560 Extensions: Add global CFG support
CFG is bundled as an extension which is more flexible in terms of
storing settings and consolidating code.

Global CFG is currently supported and the old power user setting
is auto-migrated.

Signed-off-by: kingbri <bdashore3@proton.me>
2023-08-11 01:39:15 -04:00
joe
5feebd4897 live2d -> talking head 2023-08-11 06:55:05 +09:00
joe
e4f22fdc99 live2d -> talkinghead 2023-08-11 06:52:14 +09:00
Tony Ribeiro
21a2bdac67 return original audio when RVC voice map has no model for the character 2023-08-10 17:12:37 +02:00
Tony Ribeiro
0c33860eb1 cleanup RVC extension code 2023-08-10 15:59:00 +02:00
Tony-sama
9e2ebdb43e
Merge branch 'SillyTavern:staging' into staging 2023-08-10 15:23:56 +02:00
Cohee
2e81e47967 Fix default expressions 2023-08-10 12:47:56 +03:00
Cohee
2622999284 #911 Fix expressions 2023-08-10 12:42:52 +03:00
Tony Ribeiro
33359f2c46 Add log to check audio type sent to extras 2023-08-10 02:47:53 +02:00
Tony-sama
479923051b
Merge branch 'SillyTavern:staging' into staging 2023-08-09 20:25:32 +02:00
Tony Ribeiro
8bea721721 Add extension for RVC postprocessing of TTS audio using ST extras 2023-08-09 03:30:26 +02:00
Cohee
e343f2461d Fix block width 2023-08-08 20:51:31 +03:00
ouoertheo
5ea30d9d4d Fix objective gen toastr messsage 2023-08-08 07:49:21 -05:00
Cohee
cd8a24a712 Fix bulk edit 2023-08-04 14:41:00 +03:00
Cohee
14827d6135 Fix bulk-edit extension manifest 2023-08-04 13:42:20 +03:00
joe
c18a845f64 Fix duplicate call by mistake 2023-08-04 16:35:30 +09:00
joe
853d81e67c Bug and performance Fix's 2023-08-04 14:54:01 +09:00
joe
791b18d78e Removed old code 2023-08-04 11:25:58 +09:00
joe
708b065300 Merge branch 'staging' 2023-08-04 09:32:02 +09:00
joe
140b86d822 updates 2023-08-04 09:27:01 +09:00
pyrater
8f1321f09d
Update index.js 2023-08-04 09:26:17 +09:00
pyrater
9333340175
Update index.js
somehow display:none; was missing from line 1183
2023-08-04 09:21:52 +09:00
joe
4698f0f765 Perfomance Increase for unloading animation 2023-08-04 08:29:39 +09:00
pyrater
f106666ded
Merge branch 'SillyTavern:staging' into staging 2023-08-04 06:43:17 +09:00
Cohee
bcffaec6a6 Fix invalid function reference 2023-08-03 19:30:19 +03:00
Cohee
008d8fa6fc
Merge pull request #859 from city-unit/feature/bulk
Bulk Editing
2023-08-03 19:29:33 +03:00
Cohee
2a153e3b15 #866 Wait for group to stop generating before auto-summarizing 2023-08-03 17:17:58 +03:00
Cohee
0a12fe0bdb Unhide expression holder on setting live2d sprite 2023-08-03 14:07:50 +03:00
joe
56a4a6eb83 Bug fix 2023-08-03 20:01:35 +09:00
joe
4b7c837fe3 Removed unneeded IF 2023-08-03 19:29:48 +09:00
joe
aebdd6cd42 Fallback expression and tweak 2023-08-03 19:23:15 +09:00
pyrater
0ad3c86e17
Merge branch 'SillyTavern:staging' into staging 2023-08-03 19:06:04 +09:00
joe
9f44a72d76 Setting Tracking Live2d 2023-08-03 19:05:21 +09:00
RossAscends
5a67d72fea /qr, /qrset & ctrl+1~9 hotkeys for QRs 2023-08-03 14:44:23 +09:00
city-unit
9712e4bbb0 Moved bulk edit from external to internal extension. 2023-08-03 00:15:09 -04:00
Cohee
f6f51d21c5
Merge pull request #841 from ouoertheo/ouoertheo/objectives6
Objective: currentTask fix in MESSAGE_RECEIVED, ignore swipes
2023-08-02 01:45:20 +03:00
ouoertheo
9a4d62ca6f
add lastMessageWasSwipe=false to resetState 2023-08-01 16:16:52 -05:00
Cohee
9d023dc3b1 Load live2d by posting a file 2023-08-01 23:57:04 +03:00
Cohee
7f86551ab4 Don't try to load live2d if variable is disabled or module is not loaded to Extras 2023-08-01 16:33:30 +03:00
Cohee
e5f3a70860 #843 Wait for group to stop generating before checking objectives 2023-08-01 15:53:10 +03:00
Cohee
bad7892baa Adjust chromadb auto% for character description 2023-08-01 14:16:03 +03:00
ouoertheo
6f4fd15095 currentTask fix in MESSAGE_RECEIVED, ingore swipes 2023-08-01 04:24:55 -05:00
Cohee
16b45f1ea9 Reformat new code 2023-07-31 20:56:05 +03:00
Cohee
435d319090
Merge pull request #835 from pyrater/staging
Live2d Changes
2023-07-31 20:53:45 +03:00
Tony Ribeiro
192c82b180 Restored streaming mode as a new provider "Streaming", recording is done on server side, voice detection with vosk and transcript with whisper. 2023-07-31 18:47:33 +02:00
ouoertheo
6768c56e2b fix regression on task selection 2023-07-31 07:56:49 -05:00
joe
4939387bbf Updated based on feedback 2023-07-31 19:14:15 +09:00
joe
4c14b8ee2d Updated Static URL 2023-07-31 19:01:45 +09:00
joe
0bbcf0db83 Updated non static URL Calls 2023-07-31 18:54:50 +09:00
joe
0c919bf32d Talking Animation 2023-07-31 18:21:32 +09:00
pyrater
9f92b19004
Merge branch 'SillyTavern:staging' into staging 2023-07-31 16:10:22 +09:00
joe
7824a18103 Live2d Commits 2023-07-31 16:09:36 +09:00
joe
0eef05908d live2d addition 2023-07-31 14:52:30 +09:00
ouoertheo
d5e40e0271 fix for allowing root task as. notify on manual check 2023-07-30 19:15:05 -05:00
Cohee
40f466b2c3 Summary plugin improvements: In-chat position, customizable template, force insert after X words 2023-07-30 23:10:37 +03:00
ouoertheo
4f76a8b0ce fix task counter decrement 2023-07-30 09:27:31 -05:00
ouoertheo
3fc2b81433 help text update 2023-07-30 09:19:17 -05:00
ouoertheo
23a514bba8 full templating for all prompts. prompt mgmt 2023-07-30 09:15:12 -05:00
RossAscends
80a0cb2bc4 MPV of QuickReply Presets 2023-07-30 06:22:03 +09:00
Cohee
0e7c10b26f
Merge pull request #812 from ouoertheo/ouoertheo/objective5-tree 2023-07-29 13:04:47 +03:00
ouoertheo
27eb95cb36 add migration 2023-07-29 01:58:26 -05:00
ouoertheo
ee81a8d88c add in objective tree 2023-07-28 23:21:55 -05:00
Cohee1207
49186dbfc1 #796 Round portrait height to nearest 64 2023-07-27 23:38:08 +03:00
Tony Ribeiro
8d794ed03f merge new speech-recognition module with staging branch. 2023-07-27 19:29:36 +02:00
ouoertheo
111b91b1ed simple css fix for prompt edit 2023-07-27 07:26:05 -05:00
joe
99a18be5fc Fix for dropdown list not populating 2023-07-27 20:04:01 +09:00
Cohee
62e5f71cf9 Reformat coqui code 2023-07-26 22:57:05 +03:00
Cohee
f56834bb96
Merge pull request #775 from pyrater/staging
Coqui TTS Addition
2023-07-26 21:41:47 +03:00
Cohee
1ad361593f
Merge pull request #779 from ouoertheo/ouoertheo/objective4
Objective: Custom Prompts, Current Task Highlight
2023-07-25 16:58:40 +03:00
ouoertheo
ae850fdde7 protect default objective prompt, cleanup 2023-07-25 08:45:07 -05:00
ouoertheo
c8b3bce8b9 current task highlight/edit prompts 2023-07-25 08:36:27 -05:00
kingbri
0e45aa7e58 Regex: Fix saving logic
- Don't save if the name is empty or undefined
- Warn if the find regex isn't found
- Warn if the "Affects" checkbox isn't selected

This allows for edits to be preserved even if a user incorrectly
changes something with the regex script itself.

Signed-off-by: kingbri <bdashore3@proton.me>
2023-07-24 23:21:54 -04:00
joe
ce3d76d662 Coqui TTS Addition 2023-07-25 09:59:08 +09:00
Cohee
dd69fd3934 Auto-scrollheight for SD char prefix 2023-07-23 00:28:23 +03:00
Cohee
83252617be #612 Character-specific prompt prefixes for SD 2023-07-22 23:57:48 +03:00
Cohee
a9f8506218 Possible chroma auto-adjust fix 2023-07-22 22:21:37 +03:00
Cohee
d3fe20c119 Add editable prompt templates 2023-07-22 21:12:23 +03:00
Cohee
3feffaabe5 SD refine mode for paintbrush button 2023-07-22 20:32:58 +03:00
RossAscends
e2c7f770e4 fix default expressions 2023-07-21 06:06:00 +09:00
Cohee
edd41989fd Initial commit 2023-07-20 20:32:15 +03:00