bmen25124
d42a81f97c
New connection manager events, ConnectionManagerRequestService ( #3603 )
2025-03-16 16:58:34 +02:00
bmen25124
7d568dd4e0
Generic generate methods ( #3566 )
...
* sendOpenAIRequest/getTextGenGenerationData methods are improved, now it can use custom API, instead of active ones
* Added missing model param
* Removed unnecessary variable
* active_oai_settings -> settings
* settings -> textgenerationwebui_settings
* Better presetToSettings names, simpler settings name in getTextGenGenerationData,
* Removed unused jailbreak_system
* Reverted most core changes, new custom-request.js file
* Forced stream to false, removed duplicate method, exported settingsToUpdate
* Rewrite typedefs to define props one by one
* Added extractData param for simplicity
* Fixed typehints
* Fixed typehints (again)
---------
Co-authored-by: Cohee <18619528+Cohee1207@users.noreply.github.com >
2025-03-03 10:30:20 +02:00
Cohee
5ecfbf3933
Fix element id for nsigma
2025-03-02 23:01:34 +02:00
Wolfsblvt
810d954d12
Add missing samplers to TC restore preset
2025-03-02 00:26:47 +01:00
Cohee
5f024823a9
Improve JSdocs
2025-02-25 10:22:03 +00:00
bmen25124
092ef26144
Exported getTextGenServer, extractMessageFromData, getPresetManager methods. Added optional parameters to some methods for generic usage.
2025-02-25 13:20:06 +03:00
Yokayo
890d10d811
Work on tl
2025-02-16 18:43:57 +07:00
Cohee
1f41124844
Remove pointless return
2025-02-16 02:13:08 +02:00
Cohee
23f0b6ed09
Add a blank line
2025-02-15 12:38:45 +02:00
Cohee
c87e203b4a
Refactor banned strings kill switch functions into a single toggle function
2025-02-15 12:37:48 +02:00
Cohee
c37c9051a6
Fix bug when only global bans are defined
2025-02-15 00:34:07 +02:00
Cohee
8a4cf86b65
Integrate killswitch into the block
2025-02-15 00:28:38 +02:00
Cohee
a2a15b9978
Merge branch 'Banned-Strings-Killswitch' into tc-global-banlist
2025-02-15 00:12:16 +02:00
Cohee
412d638e9e
Text Completion: Add global banned strings list
2025-02-13 22:07:36 +02:00
Cohee
d5959a4681
Add awaits to event emissions
2025-02-08 19:13:05 +02:00
RossAscends
c5dad20fc4
add killswitch for banned strings
2025-02-02 12:00:01 +09:00
pcpthm
753a99faf9
Support reasoning for OpenRouter text completion
2025-01-31 21:41:56 +09:00
Cohee
e3f0a8d35b
TC: Trim spaces in server URLs
2025-01-30 00:25:02 +02:00
Cohee
afae8d02be
The THONKening
2025-01-23 02:52:52 +02:00
Cohee
e4290140bc
TC: Remove -1 seeds from request body
...
Closes #3336
2025-01-22 22:45:30 +02:00
Isaac McFadyen
d14f2f3c77
llama.cpp: fixed wording in comment for logprobs
2024-12-27 01:15:35 -05:00
Isaac McFadyen
77414045d9
llama.cpp: fixed logprobs for newest server version
2024-12-27 01:00:55 -05:00
Cohee
4232f6c5f4
More null checks for llamacpp logprobs parser
2024-12-20 22:00:36 +02:00
DocShotgun
6193eb14da
Add DRY to llama.cpp sampler order
2024-12-18 19:04:49 -08:00
Cohee
cd0b834291
Implement "except" mode for type-specific controls in settings
2024-12-13 20:58:16 +02:00
Cohee
3167019faf
Add generic text completion API type (100% OAI compatible)
2024-12-13 01:12:10 +02:00
Cohee
cc73a45d1f
Make lint happy
2024-12-09 17:32:23 +02:00
AlpinDale
bcbfcb87b5
aphrodite: send an empty sampler priority list if using the default order
2024-12-09 14:05:33 +00:00
Cohee
323b9407df
Small cosmetic fixes
2024-12-09 15:26:57 +02:00
Cohee
3ed5d892f7
Fix bugs with the settings
2024-12-09 15:13:19 +02:00
AlpinDale
add108b821
fix the JS issue where both ooba and aphro were using the same container ID
2024-12-07 12:36:10 +00:00
AlpinDale
a1115ab4ff
Merge remote-tracking branch 'alpin/staging' into sampler_order
2024-12-07 12:27:55 +00:00
Cohee
77841dbc21
Add types for SillyTavern.getContext
2024-12-06 16:41:26 +02:00
Cohee
2ef095c273
Merge branch 'release' into staging
2024-12-04 01:35:50 +02:00
Cohee
e6be28acea
llama.cpp: Don't send empty DRY sequence breakers
...
Fixes #3048
2024-12-04 01:32:27 +02:00
Cohee
7ce2841588
Add trim_stop to koboldcpp requests
...
Fixes #3143
2024-12-03 14:49:20 +00:00
AlpinDale
80c8e83f09
use strings instead of IDs
2024-12-03 01:46:51 +00:00
AlpinDale
e664806990
add DRY, skew, and no repeat ngram penalty
2024-11-25 22:28:58 +00:00
Cohee
fdd798e2da
Merge branch 'staging' into top-nsigma
2024-11-25 00:08:38 +02:00
ceruleandeep
0383ea52e9
Linting and commenting
...
Linting and commenting
Linting and commenting
Linting and commenting
Linting and commenting
2024-11-22 11:55:27 +11:00
AlpinDale
ec4cff72fe
feat: add top nsigma sampler support
2024-11-19 23:05:23 +00:00
Beinsezii
c599f46269
Remove best_of for VLLM
...
It defaults to `n` anyways, and for some reason it was being incorrectly
received on 0.6.4.post1
2024-11-16 02:05:35 -08:00
Cohee
07feccbe35
koboldcpp: parse logprobs
2024-11-01 11:38:31 +02:00
Cohee
00f0f755fc
Support comma-separated list of llama.cpp sequence breakers #3026
2024-10-28 11:44:26 +00:00
Cohee
542f77aeb8
Safe sequence breakers parse
2024-10-28 11:39:59 +00:00
Beinsezii
ace2902cb8
llama.cpp Enable dry w/ array convert
...
The new PR that was merged needs an array instead of a str
https://github.com/ggerganov/llama.cpp/pull/9702
2024-10-26 16:07:07 -07:00
Cohee
725cfdebca
Merge pull request #2993 from theo77186/llamacpp_xtc
...
Enable XTC support for llama.cpp
2024-10-16 20:52:06 +03:00
Cohee
276316ae62
Auto-add missing samplers for llama.cpp
2024-10-16 20:51:32 +03:00
theo77186
37f3a24ac6
Enable XTC support for llama.cpp
2024-10-16 18:30:46 +02:00
Cohee
24884b3206
TextGenWebUI: remove legacy API mode
2024-10-15 00:32:56 +03:00
