f31b996cb5
Text Generation: Add TabbyAPI support
...
TabbyAPI is an exllamav2 only API server that aims to provide a simple
experience for loading and chatting with exl2 models.
SillyTavern currently doesn't have the ability to load and unload models,
so only add the OAI compatible completion endpoints.
The repository can be found here:
https://github.com/theroyallab/tabbyAPI
Signed-off-by: kingbri <bdashore3@proton.me>
2023-11-17 00:37:39 -05:00
3fb26d3927
Add lazy loading of sentencepiece tokenizers
2023-11-15 19:39:55 +02:00
5b5e42361a
Fix chat backups saving with incorrect file extension
2023-11-15 01:06:27 +02:00
5fe8f70eb1
#1345 Add API endpoint for web search interaction
2023-11-14 00:16:41 +02:00
7afe9e6481
#1343 Add status check bypass
2023-11-12 13:23:46 +02:00
4c0b3fb7ae
Add null checks for OR pricing
2023-11-12 13:07:57 +02:00
abe4bb6d54
Add error handling for empty Palm response
2023-11-10 15:55:49 +02:00
81fe9aa699
Fix updated tokenization via ooba API
2023-11-09 19:39:08 +02:00
3780321ae6
Fix ooba model name displaying as turbo
2023-11-09 19:27:19 +02:00
0e89bf90bc
Use correct tokenizers for logit bias for Mistral and Llama models over OpenRouter
2023-11-09 01:03:54 +02:00
76b8880972
Normalize response statuses
2023-11-08 23:20:55 +02:00
480099ee97
Mancer will work in legacy API mode. Remove Soft Prompt mentions.
2023-11-08 18:16:47 +02:00
4f1dbaa34b
Remove /v1 from the ooba API URLs
2023-11-08 17:09:33 +02:00
740f6548a2
Increase timeouts of OAI out of quota requests
2023-11-08 12:07:14 +02:00
e76c18c104
Legacy ooba API compatibility shim
2023-11-08 10:13:28 +02:00
865256f5c0
Fix ooba tokenization via API. Fix requiring streaming URL to generate
2023-11-08 03:38:04 +02:00
b2629d9718
Refactor status checks and indicators.
2023-11-08 02:52:03 +02:00
00a1eaab28
Add timeout for status check
2023-11-08 01:47:31 +02:00
2c7b954a8d
#1328 New API schema for ooba / mancer / aphrodite
2023-11-08 00:17:13 +02:00
2d2ff5230c
Merge pull request #1318 from artisticMink/feature/bulk-edit-enhanced
...
Feature/bulk edit enhanced
2023-11-07 20:47:06 +02:00
1896732f17
Add DALL-E to OpenAI plugin
2023-11-06 21:47:00 +02:00
c584da2ea9
Accept both v1 and v2 spec for editcharacterattributes endpoint
2023-11-06 16:13:34 +01:00
42d838a0b3
Refactor TavernCardValidator error property
2023-11-06 16:13:34 +01:00
6eb6527d11
Prototyping
2023-11-06 16:13:34 +01:00
f10833a516
Add prompt format override for OpenRouter
2023-11-03 00:34:22 +02:00
75c6e74d41
support for min P on Kobold API
2023-11-02 14:53:57 +09:00
922007ea25
#1294 Fix selective logic for embedded lorebooks
2023-10-28 12:28:03 +03:00
24f406917d
Add seed to Kobold APi
2023-10-26 21:22:00 +03:00
51d2c9feba
Add UI option for group gen strategy
2023-10-25 22:39:31 +03:00
5dbe2ebf29
Add chat file backups
2023-10-24 22:09:55 +03:00
18fa925855
Use named constant
2023-10-21 23:33:17 +03:00
ca73a3a7b7
Merge branch 'release' into staging
2023-10-21 15:06:19 +03:00
008fcece04
Rewrite to sync readdir, add try-catch, filter out invalid files
2023-10-21 15:04:36 +03:00
1d38109dcf
Use JSON instead of json5
2023-10-21 18:56:51 +08:00
6f0f420063
Promisify getallchatsofcharacter
2023-10-21 18:55:52 +08:00
b167eb9e22
Add raw token ids support to OAI logit bias. Fix token counting for turbo models
2023-10-19 13:37:08 +03:00
6a1b230c7e
#1226 Add chat-bound lorebooks
2023-10-16 23:03:42 +03:00
8a3547ecd0
#1248 Fix a server crash on unexpected models response
2023-10-16 20:25:51 +03:00
89d7a05ea7
Missed a spot
2023-10-14 20:08:45 -10:00
a9ebd2f80e
Make v2 spec read logspam slightly actionable
...
The existing logspam doesn't even tell the user what char is failing, which means it's
just going to emit every startup, forever, grinding at the poor user's soul, never
letting them know *which* of their 352 cards is causing the spam... day after day after
day. Until one day, the poor beleaguered user will emit the world's ugliest PR to at
least find the broken card in an attempt kill it.
Ask me how I know.
2023-10-14 17:41:23 -10:00
6e78ec11fb
Check for errors on the `stream_end` event
2023-10-10 18:04:28 -04:00
15c81749b8
Filter out invalid/broken characters
2023-10-09 19:17:49 +03:00
0873d3eaf9
Filter out invalid/broken characters
2023-10-09 19:09:33 +03:00
d265179f46
Don't crash ST server on invalid streaming URL
2023-10-08 23:42:28 +03:00
f8b5fe8b1e
Add Character note to char.card embeds
2023-10-04 22:13:56 +03:00
bb47712696
Split oobabooga/mancer sources. Add aphrodite support
2023-09-28 19:10:00 +03:00
01f14b461f
Fix embedded lorebook depths
2023-09-25 20:11:16 +03:00
a081f78bd8
(WIP) PaLM API
2023-09-23 20:48:56 +03:00
cd1a8c9224
Quick and dirty stat re-creator button
2023-09-21 17:34:09 -04:00
ad9382a98c
Custom --grammar support [for koboldcpp] ( #1161 )
...
* Basic kobold grammar implementation
This is probably jank as all hell, I don't write js, but I think I got it to work.
* No value by default
* Visual cleanup
+ reworded it a bit
* Conditionally enable Grammar based on version flag. Fix layout
---------
Co-authored-by: Cohee <18619528+Cohee1207@users.noreply.github.com>
2023-09-21 15:21:59 +03:00
e3f760a9dd
Add assistant postfix to converted ChatML => text completion prompts.
2023-09-20 21:50:14 +03:00
11e7ca76e1
Use simpleGit to get app version
2023-09-17 14:27:41 +03:00
bfdd071001
Move tokenizer endpoint and functions to separate file
2023-09-16 18:48:06 +03:00
ab9aa28fe4
Move missed endpoints
2023-09-16 18:03:31 +03:00
61995bb33f
Move preset management into a separate file
2023-09-16 17:36:54 +03:00
38b63b07f5
Extract sprite and custom content endpoints to a separate files. Update constants references
2023-09-16 17:28:28 +03:00
4e1630c17d
Extract endpoints for secrets and assets to separate files
2023-09-16 16:39:07 +03:00
6e562bd1ff
Extract server endpoints for thumbnails and extensions into separate files
2023-09-16 16:16:48 +03:00
6dd09858d4
Don't remove names from the past chat. Fix non-streaming auto-continue.
...
We took fair criticism from the NovelAI dev.
2023-09-15 23:32:01 +03:00
eaca6ddaf0
Don't try to resolve unknown tiktoken models
2023-09-15 19:31:17 +03:00
599904d589
Move NovelAI endpoints to separate file
2023-09-15 17:54:13 +03:00
0f1a0963fd
Merge branch 'release' into staging
2023-09-15 15:06:13 +03:00
2b3055a84a
Webp cards format is no longer supported
2023-09-15 14:56:15 +03:00
0cc048cb64
Refactor transformers.js usage
2023-09-14 23:12:33 +03:00
9fb4b3425e
Costume subfolders
2023-09-14 19:12:54 +03:00
52891898d2
Pass max length to Kobold GUI settings
2023-09-14 18:20:12 +03:00
ece34dc337
Move default files creation to post-install
2023-09-14 14:21:38 +03:00
66ec17620f
Move Horde and SD endpoints into separate files
2023-09-12 20:45:36 +03:00
f149fc9aaa
Endpoint for local captioning pipeline
2023-09-11 04:47:14 +03:00
74d627f674
Set default DNS resolution order to IPv4 first
2023-09-10 19:03:18 +03:00
599261dc31
Set default DNS resolution order to IPv4 first
2023-09-10 19:02:58 +03:00
4fdc533bd7
Change net workaround for node 20
2023-09-10 18:23:50 +03:00
d17ac770e6
Change net workaround for node 20
2023-09-10 18:22:39 +03:00
ec23356c99
Move translation endpoints into a separate file
2023-09-10 16:41:36 +03:00
98cc969d18
Merge branch 'staging' into vectors
2023-09-10 16:06:15 +03:00
d81c94de0b
Fix sort by date
2023-09-10 14:30:29 +03:00
e2e32da4e6
Unrestrict console logs display limit
2023-09-10 04:12:14 +03:00
0480acebcd
#1059 Mancer model selector
2023-09-10 04:08:32 +03:00
b605b940eb
Replace transformers.js with patched version
2023-09-09 16:29:11 +03:00
967a084aad
(WIP) Local emotion classification pipeline
2023-09-09 15:14:16 +03:00
42fd317188
Merge branch 'staging' into vectors
2023-09-08 16:41:26 +03:00
a5acc7872d
Add OpenAI vector source.
2023-09-08 13:57:27 +03:00
3abee9e37a
Merge pull request #1115 from SillyTavern/release
...
Release
2023-09-08 12:48:37 +03:00
a96aad6073
Make API tokenization work again for ooba
2023-09-08 18:31:30 +09:00
b5a6257352
Forgot that groups exist
2023-09-08 10:51:59 +03:00
8c00f38a1f
Add local vectors storage
2023-09-07 21:53:47 +03:00
e681f1f36f
#1069 Fix sort by date for v2 cards
2023-09-06 20:59:59 +03:00
ded1e3a859
Add NAI Diffusion upscaling. Add Anlas guard and view Anlas button
2023-09-04 18:00:15 +03:00
f69aa07ec1
Fix background URI encoding
2023-09-04 02:51:39 +03:00
3e1815f599
Fix [BUG] Card sorting is broken #1069
2023-09-03 18:52:04 +03:00
e8545db9a5
Fix the last of type errors
2023-09-03 18:37:52 +03:00
a26e8ef455
#1084 Fix dupe char suffix
2023-09-03 15:18:23 +03:00
ce2c2b0dac
Add AUTO1111 upscaling controls
2023-09-03 14:56:02 +03:00
e4e02c69f3
Fix post-crop image resize with "Never resize avatars" enabled
2023-09-03 01:39:28 +03:00
ef69dcd502
Add auth support for AUTO1111
2023-09-03 01:19:31 +03:00
e3e6fa2218
Connect to AUTO111 without Extras. Add NAI Diffusion.
2023-09-03 00:41:26 +03:00
6c097560ca
goodbye axios ( #1073 )
...
* goodbye axios
* Rewrite error handling for OpenAI
* Increase instruct sequence length limit
* Buttons markup
---------
Co-authored-by: Cohee <18619528+Cohee1207@users.noreply.github.com>
2023-09-01 19:00:32 +03:00
7a325f03ea
Fix disable thumbnails
2023-09-01 16:20:31 +03:00
02f9aded4b
Merge branch 'release' into staging
2023-09-01 15:53:22 +03:00
52ae038297
Add error handling to AI21 tokenization
2023-09-01 15:44:41 +03:00
83ff2e6edc
Merge pull request #1066 from bdashore3/staging
...
Allow additional headers to be passed to local backends
2023-09-01 14:52:32 +03:00
6a98701e61
Fix unban EOS for Kobold
...
565ab8a38f
2023-09-01 01:58:32 +03:00
5cbd5c8210
get rid of node-rest-client and fix types ( #1072 )
...
* get rid of node-rest-client and fix types
* remove from package manager
* postAsync is used above its def, need hoisting
* handle client agent undefined, fixes type error
* handle invalid / missing query.name for sanitize
* more type guards
* Make code formatter happy
---------
Co-authored-by: Cohee <18619528+Cohee1207@users.noreply.github.com>
2023-09-01 01:30:33 +03:00
e9de47615a
#1047 Unban EOS token and mirostat for Kobold
2023-09-01 01:04:58 +03:00
bc1d745209
Rewrite getstatus_openai using fetch
2023-08-31 22:46:13 +03:00
deeedad19e
Make jsdoc/type-checker happy Pt 3 ( #1070 )
...
* png-chunks-extract.extract has no create_date
* `new Buffer.from` is not a thing
* handle failed character read
* stop lying about your return value
* what we get for mixing booleans and strings
* localeCompare makes more sense and fixes types
* uhh wtf, there is no callback in readFileSync
* no subtracting Dates, only Numbers (timestamps)
* handle if no file in request
* changing types makes typechecker mad
* handle false or undefined character read
* default param does not exist
* can't have same property assigned twice
* json5.parse expects a string, not buffer
* handle invalid thumbnail type
* handle invalid thumbnail type case
* ignore bad axios typing
* fix ambiguous typing
* types is incorrect? no .destroy(). use type guard
* include intended error handling of refactor
* Make API urls const
---------
Co-authored-by: Cohee <18619528+Cohee1207@users.noreply.github.com>
2023-08-31 19:44:58 +03:00
c19eb3146f
Force set create date string
2023-08-31 19:30:27 +03:00
4e553cf6ab
Server: Allow appending of additional headers for local backends
...
This is a useful feature for those who want to utilize APIs with
proxy middleware for adding extra features or security. For cloud
API safety and abiding by rate limits, this feature only applies to
local backends such as ooba or kobold.
Signed-off-by: kingbri <bdashore3@proton.me>
2023-08-31 00:15:07 -04:00
218cfb43d8
Fix gallery files caching, filter by mime type. Use fetch instead of Jquery Ajax
2023-08-31 00:55:17 +03:00
194278d171
Merge branch 'staging' into feature/exorcism
2023-08-31 00:42:34 +03:00
7cb896ddd7
Fix first run initialization
2023-08-31 00:40:03 +03:00
7f99ae5705
Revert unnecessary string cast
2023-08-31 00:21:29 +03:00
326c7d8841
input not an arr, it is an arr or string or other
2023-08-30 13:28:08 -07:00
9dfe42a7c3
convert to async and fix types
2023-08-30 13:28:08 -07:00
2e3ddd16d5
fix ambiguous args for typechecker
2023-08-30 13:28:08 -07:00
77c9744878
make more readable & make types happy
2023-08-30 13:28:08 -07:00
49aff85472
handle bad read of raw data
2023-08-30 13:28:08 -07:00
c1b76b5f48
resolve can only return one thing at a time
2023-08-30 13:28:08 -07:00
f7576750fc
handle undefined X-Streaming-URL
2023-08-30 13:28:08 -07:00
691e9ee754
this default param does not exist
2023-08-30 13:28:08 -07:00
ab9594fe62
handle missing user agent case
2023-08-30 13:28:08 -07:00
8211e67ed7
generateToken requires req to set cookie
2023-08-30 13:28:08 -07:00
aa901883d2
node v18 type-checker hates this, ignore it
2023-08-30 13:28:08 -07:00
cd8027aeea
fixes 7 errs. see yargs typescript docs. test plz
2023-08-30 13:28:08 -07:00
3feeaaa09f
listen requires a number, `URL` port is string wtf
2023-08-30 13:28:08 -07:00
113ea1d0ec
JSON.parse wants a string
2023-08-30 13:28:08 -07:00
86c0974a6e
More image support
2023-08-30 15:33:39 -04:00
220d19d3ec
Remove useless assignments
2023-08-30 22:09:09 +03:00
f5e52eab05
Specify read encoding
2023-08-30 22:04:11 +03:00
ce46e1a4ca
Replace restClient in getstatus_novelai
2023-08-30 21:58:46 +03:00
a757532c3e
Fix local fetch import for Kobold
2023-08-30 21:46:09 +03:00
02f7c9ab64
Merge branch 'staging' into cleanup-imports
2023-08-30 21:19:14 +03:00
27b6fe1f76
Fix sendFile usage
2023-08-30 21:14:53 +03:00
52dbb916c0
Specify file read encoding where possible
2023-08-30 20:57:19 +03:00
938e244987
Change file buffer read handling
2023-08-30 20:55:00 +03:00
8b38015fab
stop polluting my global namespace
2023-08-30 10:28:58 -07:00
271a429a62
default param value does not exist
2023-08-30 10:28:58 -07:00
f3f9efb163
check the docs, there is no such option sirs
2023-08-30 10:28:58 -07:00
398544407d
type checker no trust functions as type guards
2023-08-30 10:28:58 -07:00
b648d9bd87
JSON.parse wants a string
2023-08-30 10:28:58 -07:00
79e6d4c297
outdated local ai_horde library, bad
2023-08-30 10:28:58 -07:00
94c6b453c0
workaround: pkg does not exist on type Process
2023-08-30 10:28:58 -07:00
11cef1b234
type checker wants a string
2023-08-30 10:28:58 -07:00
6ca678e137
sanitize only accepts strings
2023-08-30 10:28:58 -07:00
e1df933368
plz no pollute global namespace
2023-08-30 10:28:58 -07:00
b91bc21d60
fixes readableStream fuckery, needs testing
2023-08-30 10:28:58 -07:00
baac38f888
types demands we handle null case
2023-08-30 10:28:58 -07:00
3422b3e963
inline function immediately called lolwtf
2023-08-30 10:28:58 -07:00
4e78c3ec79
should be a string according to types
2023-08-30 10:28:58 -07:00
2928c79446
simple-git needs to get their shit together
2023-08-30 10:28:58 -07:00
20f807c5c9
async functions return promises silly
2023-08-30 10:28:58 -07:00
37e20f6fc5
type-guard vs possible null
2023-08-30 10:28:58 -07:00
6bd77bac7a
checker thinks this could be undefined, handle it
2023-08-30 10:28:57 -07:00
c703b0b25e
'Buffer' is not assignable to param 'string'
2023-08-30 10:28:57 -07:00
274b2e5009
fix ambiguous typing
2023-08-30 10:28:57 -07:00
165d4b3b75
Merge branch 'staging' of https://github.com/city-unit/SillyTavern into feature/exorcism
2023-08-30 00:12:00 -04:00
403546e514
finish moving and organizing require statements
2023-08-29 14:34:41 -07:00
7bf72beed7
move AIHorde import to top
2023-08-29 14:29:02 -07:00
d07779e5da
refactor ambiguous "Client" from node-rest-client
2023-08-29 14:28:13 -07:00
26e008e907
move and organize more imports
2023-08-29 14:26:59 -07:00
9087736835
move and organize additional imports
2023-08-29 14:23:53 -07:00
c0b1ea5f4c
grouping native node imports
2023-08-29 14:20:37 -07:00
fc59b20f36
cli/fs related library import grouping
2023-08-29 14:16:39 -07:00
918aba3eb6
group image processing imports at top
2023-08-29 14:12:47 -07:00
288378919a
move express imports to top
2023-08-29 14:10:40 -07:00
8d5eb062e6
move fs and path imports to top
2023-08-29 14:06:37 -07:00
2bd645e271
move child_process import to top
2023-08-29 14:05:18 -07:00
01ff9604bd
Merge pull request #1043 from RealBeepMcJeep/patch-1
...
remove unused symbols
2023-08-29 23:37:46 +03:00
9dc908c9aa
Merge branch 'staging' of http://github.com/cohee1207/SillyTavern into staging
2023-08-29 23:28:53 +03:00
8d2c84c6ef
Limit max backups to settings only
2023-08-29 23:28:44 +03:00
e820245fcf
importing process unneeded, native to node runtime
...
process is native to node runtime, no need to import
2023-08-29 10:56:24 -07:00
3d8761f077
remove unused symbols
...
these do nothing
2023-08-29 10:00:31 -07:00
f1b91620b6
Merge pull request #1021 from ouoertheo/ouoertheo/tts-ui-voicemap
...
TTS Voice map UI and Coqui UI improvements
2023-08-28 23:57:22 +03:00
9ac2281a8f
Remove spammy server log
2023-08-28 23:56:26 +03:00
39eae80f6e
Merge branch 'staging' of https://github.com/city-unit/SillyTavern into feature/exorcism
2023-08-27 12:47:05 -04:00
9660aaa2c2
Add NovelAI hypebot plugin
2023-08-27 18:27:34 +03:00
109ea4008b
Improve Horde request error detection
2023-08-27 13:31:14 +03:00
8cb194da0f
Fix sending empty array as OAI stop strings
2023-08-27 13:17:20 +03:00
3737f58072
Merge branch 'staging' of https://github.com/city-unit/SillyTavern into feature/exorcism
2023-08-26 20:56:38 -04:00
4998c3acc8
Merge branch 'release' into staging
2023-08-26 22:07:06 +03:00
3b7ca5e379
Add fallback option for OpenRouter
2023-08-26 21:59:56 +03:00
b8531ee75c
#1022 Rewrite getstatus endpoint
2023-08-26 21:56:41 +03:00
de905875c4
LibreTranslate
2023-08-26 20:47:25 +03:00
6ab1435f49
LibreTranslate
2023-08-26 19:53:57 +03:00
464644e8a5
Fix console log string
2023-08-26 16:05:42 +03:00
4d6d82ffcc
Merge pull request #1023 from StefanDanielSchwarz/Context-Template-Preset-Manager
...
context template preset manager
2023-08-26 16:04:35 +03:00
7e506db105
Server fix for context template manager
2023-08-26 14:38:30 +03:00
4fd0a055e2
Notify about listen mode connections
2023-08-26 14:17:57 +03:00
42e6da4a36
Add support of stop strings to OpenAI / Claude
2023-08-26 00:12:11 +03:00
74a6e79df6
Added delete asset api route, factorise asset filename sanitizer to use in both asset download/delete. Added delete function to asset UI download button.
2023-08-25 00:45:15 +02:00
47a35076db
Merge branch 'staging' of https://github.com/Tony-sama/SillyTavern into staging
2023-08-24 22:18:01 +02:00
1014d592f7
Added a refresh assets button to audio UI to detect audio asset again. Usefull after download an asset or putting a file manually.
2023-08-24 22:17:54 +02:00
48924d3696
Improve asset downloader
2023-08-24 22:47:07 +03:00
3b6978010f
Merge branch 'SillyTavern:staging' into staging
2023-08-24 21:05:12 +02:00
cd24de3c2e
Reformat code.
2023-08-24 21:59:26 +03:00
ab52af4fb5
Add support for Koboldcpp tokenization endpoint
2023-08-24 20:19:57 +03:00
43e70c9df1
Merge branch 'SillyTavern:staging' into staging
2023-08-24 15:18:02 +02:00
1d1109e43b
Set generate_until_sentence for NovelAI
...
* Set generate_until_sentence true for NovelAI
* Add a Story String file for NovelAI with persona before character
which works better
* Remove hardcoded dinkus for chat_start since it is in the Story String
2023-08-23 18:04:56 -07:00
46964b1b99
Add temp folder into assets, file are download into this temp file and moved only when complete. Allow to handle fail download.
2023-08-24 02:34:06 +02:00
4aa31fcba9
Add fallback option for OpenRouter
2023-08-24 03:21:17 +03:00
kingbri
Cohee
artisticMink
RossAscends
Xrystal
majick
50h100a
city-unit
kalomaze
ThisIsPIRI
rbmj
RealBeepMcJeep
Bahamut
Tony Ribeiro
Tony Ribeiro
Mike Weldon