Commit Graph

23 Commits

Author SHA1 Message Date
Cohee f7e2d72ac7 Fix eslint 2024-07-07 22:40:03 +03:00
kingbri 0672c8422e Textgen: Add permissions check for TabbyAPI keys
There's no formal permissions checking in ST's UI, so add a temporary
check in the server endpoint before requesting a download.

Signed-off-by: kingbri <bdashore3@proton.me>
2024-07-07 14:40:24 -04:00
kingbri 69077f6a6e Textgen: Add model downloading for TabbyAPI
Tabby has a HuggingFace downloader API endpoint. Add direct support
in SillyTavern by using the same method as ollama, but with the correct
parameters exposed.

Signed-off-by: kingbri <bdashore3@proton.me>
2024-07-07 14:04:04 -04:00
Cohee cc9eca8427 Apply select2 to model selection 2024-06-28 19:13:46 +03:00
Cohee b62cbdeebd Merge branch 'staging' into DarokCx/release 2024-06-28 19:09:12 +03:00
DarokCx bd5592de7b Added featherless, connect button not working 2024-06-27 09:06:11 -04:00
Cohee 473e11c773 New OpenRouter providers 2024-06-22 02:03:39 +03:00
Cohee 71a3e2c91b Don't modify response length when changing mancer model 2024-05-17 00:19:43 +03:00
Cohee c73bfbd7b0 Safari bruh moment 2024-05-06 21:21:03 +03:00
Cohee 7063fce2af Selectable openrouter providers 2024-05-06 19:26:20 +03:00
Cohee 7bfd666321 Add llama 3 tokenizer 2024-05-03 23:59:39 +03:00
sasha0552 2bd239fe81
Initial vLLM support 2024-05-02 22:40:40 +00:00
RossAscends 75afe29f28 don't force amt_gen to model max on mancer model swap 2024-04-18 11:10:17 +09:00
Cohee e6fe82760f Change ids on OR prompt cost 2024-03-13 11:19:30 +02:00
Cohee 7ec9996c1f Add prompt cost for OpenRouter under text completion 2024-03-13 02:55:09 +02:00
DreamGenX bc8d41b530 Implement suggestions 2024-03-07 17:28:38 +01:00
DreamGenX 5c410986a4 Add support for DreamGen API.
API docs: https://dreamgen.com/docs/models/opus/v1
API keys: https://dreamgen.com/account/api-keys

I decided to base this on the text-completion API since it's more
flexible with SillyTavern's prompt formating capabilities.

This also means that custom context and instruct settings are required.

Will add documentation in a followup PR.
2024-03-07 12:25:48 +01:00
Cohee 95c49029f7 Add aphrodite model selector 2024-03-01 23:02:43 +02:00
Cohee f962ad5c02 Add OpenRouter as a text completion source 2024-02-25 22:47:07 +02:00
NWilson 8075e4cd1e Changes 2024-02-16 09:07:06 -06:00
NWilson f29f934c6b Progress 2024-01-24 06:59:27 -06:00
Cohee 67dd52c21b #1309 Ollama text completion backend 2023-12-19 16:38:11 +02:00
Cohee b0d9f14534 Re-add Together as a text completion source 2023-12-17 23:38:03 +02:00