222 Commits

Author SHA1 Message Date
AlpinDale
bcbfcb87b5 aphrodite: send an empty sampler priority list if using the default order 2024-12-09 14:05:33 +00:00
Cohee
323b9407df Small cosmetic fixes 2024-12-09 15:26:57 +02:00
Cohee
3ed5d892f7 Fix bugs with the settings 2024-12-09 15:13:19 +02:00
AlpinDale
add108b821 fix the JS issue where both ooba and aphro were using the same container ID 2024-12-07 12:36:10 +00:00
AlpinDale
a1115ab4ff Merge remote-tracking branch 'alpin/staging' into sampler_order 2024-12-07 12:27:55 +00:00
Cohee
77841dbc21 Add types for SillyTavern.getContext 2024-12-06 16:41:26 +02:00
Cohee
2ef095c273 Merge branch 'release' into staging 2024-12-04 01:35:50 +02:00
Cohee
e6be28acea llama.cpp: Don't send empty DRY sequence breakers
Fixes #3048
2024-12-04 01:32:27 +02:00
Cohee
7ce2841588 Add trim_stop to koboldcpp requests
Fixes #3143
2024-12-03 14:49:20 +00:00
AlpinDale
80c8e83f09 use strings instead of IDs 2024-12-03 01:46:51 +00:00
AlpinDale
e664806990 add DRY, skew, and no repeat ngram penalty 2024-11-25 22:28:58 +00:00
Cohee
fdd798e2da Merge branch 'staging' into top-nsigma 2024-11-25 00:08:38 +02:00
ceruleandeep
0383ea52e9 Linting and commenting
Linting and commenting

Linting and commenting

Linting and commenting

Linting and commenting
2024-11-22 11:55:27 +11:00
AlpinDale
ec4cff72fe feat: add top nsigma sampler support 2024-11-19 23:05:23 +00:00
Beinsezii
c599f46269 Remove best_of for VLLM
It defaults to `n` anyways, and for some reason it was being incorrectly
received on 0.6.4.post1
2024-11-16 02:05:35 -08:00
Cohee
07feccbe35 koboldcpp: parse logprobs 2024-11-01 11:38:31 +02:00
Cohee
00f0f755fc Support comma-separated list of llama.cpp sequence breakers #3026 2024-10-28 11:44:26 +00:00
Cohee
542f77aeb8 Safe sequence breakers parse 2024-10-28 11:39:59 +00:00
Beinsezii
ace2902cb8 llama.cpp Enable dry w/ array convert
The new PR that was merged needs an array instead of a str

https://github.com/ggerganov/llama.cpp/pull/9702
2024-10-26 16:07:07 -07:00
Cohee
725cfdebca
Merge pull request #2993 from theo77186/llamacpp_xtc
Enable XTC support for llama.cpp
2024-10-16 20:52:06 +03:00
Cohee
276316ae62 Auto-add missing samplers for llama.cpp 2024-10-16 20:51:32 +03:00
theo77186
37f3a24ac6 Enable XTC support for llama.cpp 2024-10-16 18:30:46 +02:00
Cohee
24884b3206 TextGenWebUI: remove legacy API mode 2024-10-15 00:32:56 +03:00
Cohee
80f9d90918 Merge branch 'staging' into featherless-models 2024-10-09 21:51:59 +03:00
Cohee
151a77cd36 Initialize page on load 2024-10-09 21:51:31 +03:00
Cohee
3335dbf1a7 Add empty tool calls to streaming processors 2024-10-02 01:59:53 +03:00
Cohee
ac1bc95551 Xtra Type Cafety 2024-09-28 13:59:03 +03:00
Cohee
b1bb41313f Insert missing ooba samplers 2024-09-28 13:56:57 +03:00
Cohee
8bd1c88d15 Enable XTC 2024-09-28 13:52:55 +03:00
Cohee
e59dacc27f Merge branch 'staging' into xtc-ooba 2024-09-28 13:49:49 +03:00
Cohee
aaf8fa13e5 Remove condition 2024-09-21 13:18:52 +03:00
AlpinDale
a5fea35f12 chore: update aphrodite samplers 2024-09-21 08:18:06 +00:00
Cohee
0207794a2b Fix Qwen and Command tokenizers not used for logit bias 2024-09-17 13:01:19 +00:00
Alexander Abushady
eb6097b1e8 Fixed Aphrodite Seed
Aphrodite's seed value needs to be undefined to be random.
2024-09-16 08:21:56 -04:00
Cohee
2478e17164 Remove legacy API for Aphrodite 2024-09-15 08:05:53 +03:00
Cohee
50de678980 Hide beam search for vllm. It never worked. 2024-09-14 16:53:21 +03:00
Cohee
f0d361bc7a Remove unused beam search 2024-09-14 16:41:22 +03:00
Cohee
28837ff883 Hard code include_stop_str_in_output 2024-09-14 16:32:50 +03:00
AlpinDale
1cc935796f fix early_stopping 2024-09-14 12:45:29 +00:00
AlpinDale
fde76069e0 remove beam search 2024-09-14 12:42:21 +00:00
AlpinDale
9c94348491 clean up 2024-09-14 12:38:19 +00:00
AlpinDale
efd477da04 chore: slight refactor of aphrodite samplers 2024-09-13 10:34:06 +00:00
Cohee
7534e137ae Parse Tabby streaming error. 2024-09-08 22:24:03 +03:00
Cohee
42fa3c79d7 Add Tabby model selection 2024-09-08 22:23:25 +03:00
Cohee
b16915cfb9 Remove truncation_length from textgen settings 2024-09-03 14:06:10 +00:00
Cohee
cd8dd5fc8a XTC for ooba 2024-08-31 20:31:34 +03:00
Cohee
ae2d0f04ed Add XTC for koboldcpp 2024-08-31 20:18:51 +03:00
Cohee
696c83f96d [chore] Fix eslint 2024-08-19 21:36:28 +03:00
Cohee
d77363cd7c Merge branch 'staging' into feat/xtc 2024-08-19 21:35:35 +03:00
Vitor
e28257096a added xtc parameter for ooba 2024-08-19 01:32:45 -03:00