42fa3c79d7
Add Tabby model selection
2024-09-08 22:23:25 +03:00
b16915cfb9
Remove truncation_length from textgen settings
2024-09-03 14:06:10 +00:00
ae2d0f04ed
Add XTC for koboldcpp
2024-08-31 20:18:51 +03:00
696c83f96d
[chore] Fix eslint
2024-08-19 21:36:28 +03:00
d77363cd7c
Merge branch 'staging' into feat/xtc
2024-08-19 21:35:35 +03:00
e28257096a
added xtc parameter for ooba
2024-08-19 01:32:45 -03:00
9215dfd0c6
Replace macros in DRY sequence breakers
2024-08-18 13:50:58 +03:00
28a9c45c31
/api-url slash command to get/set server url
2024-08-18 01:05:25 +02:00
8ff4a4a36a
Don't modify legacy URL path for inappropriate API types
2024-08-01 15:01:38 +03:00
e6e8d7726b
Generate random seed for HF endpoint
2024-07-26 12:50:39 +00:00
5f2a73ac9f
Expose "Allow fallback providers" for OpenRouter
2024-07-19 23:34:16 +03:00
b66e589b30
Don't use dynatemp for unsupported backends
2024-07-02 14:17:10 +00:00
b62cbdeebd
Merge branch 'staging' into DarokCx/release
2024-06-28 19:09:12 +03:00
bbb1a6e578
Add huggingface inference as text completion source
2024-06-28 18:17:27 +03:00
29ff0876a7
Added additional headers
2024-06-28 08:20:15 -04:00
bd5592de7b
Added featherless, connect button not working
2024-06-27 09:06:11 -04:00
41ab90bb8e
Support more parameters for Infermatic
2024-06-24 19:16:20 +03:00
a3dbcf3c2a
Fix context and response size not being passed to Ollama
2024-06-24 03:48:34 +03:00
1dd21caa66
Adjust number of VLLM logprobs
2024-06-09 00:59:40 +03:00
ff680f46cc
Add rep_pen_slope control for koboldcpp
2024-06-05 22:05:41 +03:00
4528655bb7
Textgen: Add multiswipe support for TabbyAPI
...
Tabby now supports batching and the "n" parameter for both non-streaming
and streaming. Add this into SillyTavern.
Signed-off-by: kingbri <bdashore3@proton.me>
2024-05-28 00:55:57 -04:00
e8b96fec02
Merge branch 'staging' into new-samplers
2024-05-22 23:26:47 +03:00
75a1ef4304
Add DRY Samplers to ST Staging ( #2211 )
...
* Add files via upload
* Add files via upload
* Delete public/index.html
* Add files via upload
* Delete public/scripts/textgen-settings.js
* Add files via upload
* Delete public/scripts/power-user.js
* Add files via upload
* Delete public/scripts/power-user.js
* Add files via upload
* Update power-user.js
* Update index.html
* Fix control attribution
* Fix app loading
* Put sequence breakers under DRY block
* DRY for DRY
* Update public/index.html
Co-authored-by: Philipp Emanuel Weidmann <pew@worldwidemann.com>
* Merge fix
* Add llamacpp control. Add default value for sequence breakers
* Forgot reset
---------
Co-authored-by: Cohee <18619528+Cohee1207@users.noreply.github.com>
Co-authored-by: Philipp Emanuel Weidmann <pew@worldwidemann.com>
2024-05-22 20:46:52 +03:00
74b6ed97c2
Textgen: Add repetition decay for TabbyAPI
...
Repetition decay softens the drop off for repetition penalty. It's
best paired with rep pen range.
Signed-off-by: kingbri <bdashore3@proton.me>
2024-05-22 00:09:10 -04:00
99d143263d
Textgen: Add skew sampling
...
Adds the option from skew sampling from exllamaV2
Signed-off-by: kingbri <bdashore3@proton.me>
2024-05-21 23:48:33 -04:00
a12df762a0
Textgen: Add speculative_ngram for TabbyAPI
...
Speculative ngram allows for a different method of speculative
decoding. Using a draft model is still preferred.
Signed-off-by: kingbri <bdashore3@proton.me>
2024-05-21 23:37:36 -04:00
ee913be46b
Merge pull request #2266 from sasha0552/vllm-fixes
...
vLLM fixes
2024-05-19 14:23:07 +03:00
c7232ae23c
WIP textgen API custom sampler display
2024-05-19 15:06:29 +09:00
db5e2d95c2
vLLM fixes
...
* Enable seed field for vLLM
* Enable beam search for vLLM
* Set the default length penalty to 1
(There is validation error from vLLM when beam search is disabled and the value is not equal to 1)
2024-05-19 04:34:11 +00:00
4227968dfa
Allow using JSON schema with llamacpp server
2024-05-18 18:50:48 +03:00
c7d75b7789
llamacpp broke
2024-05-12 21:41:07 +03:00
27ccc6b090
Minor stylistic changes
2024-05-11 11:38:22 +03:00
62faddac8d
Textgen: Add banned_strings
...
TabbyAPI supports the ability to ban the presence of strings during
a generation. Add this support in SillyTavern by handling lines
enclosed in quotes as a special case.
Signed-off-by: kingbri <bdashore3@proton.me>
2024-05-11 00:58:29 -04:00
c73bfbd7b0
Safari bruh moment
2024-05-06 21:21:03 +03:00
7063fce2af
Selectable openrouter providers
2024-05-06 19:26:20 +03:00
05db2552b3
Fix Top K disabled state for Infermatic.
...
Also an icon.
2024-05-04 02:37:05 +03:00
7bfd666321
Add llama 3 tokenizer
2024-05-03 23:59:39 +03:00
7b87f44518
Clean-up API-specific settings
2024-05-03 20:02:13 +03:00
2bd239fe81
Initial vLLM support
2024-05-02 22:40:40 +00:00
022c180b62
Lint and clean-up
2024-04-15 00:39:15 +03:00
3e60919289
Specify LLM prompt in case JSON schema is not supported
2024-04-14 17:13:54 +03:00
b8b49f0012
TextgenSettings: Fix JSON schema fallback
...
Did not fall back if the provided string was empty, resulting in
errors
Signed-off-by: kingbri <bdashore3@proton.me>
2024-04-09 22:15:00 -04:00
51b3b8bfaa
Add smooth streaming
2024-04-02 14:56:15 +03:00
04edf32ef0
Do not send dynatemp to backends if disabled
2024-04-02 11:29:49 +03:00
0b76e1d350
Fix schema not loading from presets. Fix ESLint warnings
2024-04-02 11:23:29 +03:00
5210db5679
Format
...
Signed-off-by: kingbri <bdashore3@proton.me>
2024-04-02 01:01:59 -04:00
4f0322351e
Sampling: Add ability to send JSON schemas
...
TabbyAPI supports the ability to send JSON schemas with prompts in
addition to EBNF strings supported by outlines. Add an extra box
for TabbyAPI only.
Signed-off-by: kingbri <bdashore3@proton.me>
2024-04-02 00:59:21 -04:00
a3ec0938c5
KoboldCpp grammar fix
2024-03-29 17:28:28 +02:00
9bd3a526aa
Fix for unique swipes
...
Fix for unique swipes in Aphrodite
2024-03-26 23:57:24 -04:00
8b092adc14
Use mode enum to toggle dynatemp behavior.
2024-03-25 12:25:03 -04:00
Cohee
Vitor
Wolfsblvt
DarokCx
kingbri
kokansei
RossAscends
sasha0552
Alexander Abushady
50h100a