Commit Graph

29 Commits

Author SHA1 Message Date
Cohee
81251b073a Implement downloadable tokenizers
Closes #2574, #2754
2024-09-06 16:28:34 +00:00
Cohee
e707def7dd Add tokenizer for Gemma/Gemini 2024-08-16 00:00:43 +03:00
Cohee
76e2586eaf Don't close providers dropdowns on select 2024-08-06 11:27:38 +03:00
Cohee
e45a445ef9 Init textgen model selects before loading settings 2024-08-06 11:22:13 +03:00
Cohee
8892fdc421 Sort textgen model lists alphabetically 2024-08-01 23:21:34 +03:00
Cohee
417335a19d Display context size for featherless models 2024-08-01 23:17:03 +03:00
Cohee
f7e2d72ac7 Fix eslint 2024-07-07 22:40:03 +03:00
kingbri
0672c8422e Textgen: Add permissions check for TabbyAPI keys
There's no formal permissions checking in ST's UI, so add a temporary
check in the server endpoint before requesting a download.

Signed-off-by: kingbri <bdashore3@proton.me>
2024-07-07 14:40:24 -04:00
kingbri
69077f6a6e Textgen: Add model downloading for TabbyAPI
Tabby has a HuggingFace downloader API endpoint. Add direct support
in SillyTavern by using the same method as ollama, but with the correct
parameters exposed.

Signed-off-by: kingbri <bdashore3@proton.me>
2024-07-07 14:04:04 -04:00
Cohee
cc9eca8427 Apply select2 to model selection 2024-06-28 19:13:46 +03:00
Cohee
b62cbdeebd Merge branch 'staging' into DarokCx/release 2024-06-28 19:09:12 +03:00
DarokCx
bd5592de7b Added featherless, connect button not working 2024-06-27 09:06:11 -04:00
Cohee
473e11c773 New OpenRouter providers 2024-06-22 02:03:39 +03:00
Cohee
71a3e2c91b Don't modify response length when changing mancer model 2024-05-17 00:19:43 +03:00
Cohee
c73bfbd7b0 Safari bruh moment 2024-05-06 21:21:03 +03:00
Cohee
7063fce2af Selectable openrouter providers 2024-05-06 19:26:20 +03:00
Cohee
7bfd666321 Add llama 3 tokenizer 2024-05-03 23:59:39 +03:00
sasha0552
2bd239fe81
Initial vLLM support 2024-05-02 22:40:40 +00:00
RossAscends
75afe29f28 don't force amt_gen to model max on mancer model swap 2024-04-18 11:10:17 +09:00
Cohee
e6fe82760f Change ids on OR prompt cost 2024-03-13 11:19:30 +02:00
Cohee
7ec9996c1f Add prompt cost for OpenRouter under text completion 2024-03-13 02:55:09 +02:00
DreamGenX
bc8d41b530 Implement suggestions 2024-03-07 17:28:38 +01:00
DreamGenX
5c410986a4 Add support for DreamGen API.
API docs: https://dreamgen.com/docs/models/opus/v1
API keys: https://dreamgen.com/account/api-keys

I decided to base this on the text-completion API since it's more
flexible with SillyTavern's prompt formating capabilities.

This also means that custom context and instruct settings are required.

Will add documentation in a followup PR.
2024-03-07 12:25:48 +01:00
Cohee
95c49029f7 Add aphrodite model selector 2024-03-01 23:02:43 +02:00
Cohee
f962ad5c02 Add OpenRouter as a text completion source 2024-02-25 22:47:07 +02:00
NWilson
8075e4cd1e Changes 2024-02-16 09:07:06 -06:00
NWilson
f29f934c6b Progress 2024-01-24 06:59:27 -06:00
Cohee
67dd52c21b #1309 Ollama text completion backend 2023-12-19 16:38:11 +02:00
Cohee
b0d9f14534 Re-add Together as a text completion source 2023-12-17 23:38:03 +02:00