769cc0a78f
Rename settings API endpoints
2023-12-14 16:47:03 -05:00
f93e40b1d3
Merge pull request #1533 from kingbased/gemini
...
Better Google Makersuite/AI adapter + Gemini Pro & Vision Support & tokenizers
2023-12-14 22:42:30 +02:00
635830049c
Replace makersuite icon to appropriate. Leave palm for historical purposes
2023-12-14 22:40:04 +02:00
6406f76c7d
Compress too large images for Google captions
2023-12-14 22:28:22 +02:00
cde9903fcb
Fix Bison models
2023-12-14 22:18:34 +02:00
eec28469f8
Fix server crash if multimodal prompt contains no image
2023-12-14 21:21:37 +02:00
b5b85724c7
add slash command to update existing QR preset
2023-12-14 19:08:27 +00:00
2045e414d1
lint: format fix
2023-12-14 20:57:43 +02:00
0519629b70
fix autocomplete help text
2023-12-14 18:54:42 +00:00
dbf28fce47
cleanup autocomplete help text
2023-12-14 18:52:23 +00:00
5e3584d5ed
add slash command to create QR preset
2023-12-14 18:51:55 +00:00
bb8b8f9386
Fix sending PNG/WEBP to Google captioning
2023-12-14 20:36:31 +02:00
90ec6b9159
add slash commands for context menus
2023-12-14 18:25:19 +00:00
3e44e4240c
handle escapes for pipes and curcly brackets
2023-12-14 18:09:33 +00:00
a6bb754567
Fix API key access
2023-12-14 19:56:43 +02:00
6bb894286e
Migrate palm source to makersuite
2023-12-14 19:54:31 +02:00
68bb616be3
Merge branch 'staging' into cleanup-sampler-order
2023-12-14 18:32:30 +02:00
5e61ff8d05
fix help string
2023-12-14 16:11:03 +00:00
5071b9a369
webstorm moment
2023-12-15 02:01:42 +10:00
372ef2172e
add slash commands to crud QRs
2023-12-14 16:00:38 +00:00
60880cfd4d
merge
2023-12-15 01:39:12 +10:00
698850b514
Merge remote-tracking branch 'fork/staging' into gemini
...
# Conflicts:
# server.js
# src/endpoints/prompt-converters.js
# src/endpoints/tokenizers.js
2023-12-15 01:35:17 +10:00
d5bcd96eef
message inlining vision support
2023-12-15 01:28:54 +10:00
00687a9379
Merge branch 'staging' into separate-altscale-endpoints
2023-12-14 17:12:19 +02:00
b524870544
Fix AI21 icon styles
2023-12-14 16:56:39 +02:00
178b07f414
cleaned up a little
2023-12-14 23:18:56 +10:00
0b7c1a98cd
added google vision caption support
2023-12-14 22:37:53 +10:00
ca87f29771
added streaming for google models
2023-12-14 21:03:41 +10:00
0f25d51a53
Send Kobold sampler order as an array
2023-12-14 02:03:36 -05:00
3e82a7d439
tokenizer changes and fixes. + a toggle
2023-12-14 16:31:08 +10:00
e26159c00d
refactor and rework palm request to work with the 'content' format and added an endpoint for googles tokenizer
2023-12-14 15:49:50 +10:00
be396991de
finish implementing ui changes for google models
2023-12-14 11:53:26 +10:00
69e24c9686
change palm naming in UI
2023-12-14 11:14:41 +10:00
22e048b5af
Rename generate_altscale endpoint
2023-12-13 18:53:46 -05:00
92bd766bcb
Rename chat completions endpoints
...
OpenAI calls this the "Chat Completions API", in contrast to their
previous "Text Completions API", so that's what I'm naming it; both
because other services besides OpenAI implement it, and to avoid
confusion with the existing /api/openai route used for OpenAI extras.
2023-12-13 18:52:08 -05:00
0cd92f13b4
Merge branch 'staging' into separate-kobold-endpoints
2023-12-14 01:33:36 +02:00
cebd6e9e0f
Add API token ids from KoboldCpp
2023-12-14 01:28:18 +02:00
b957e3b875
Merge pull request #1518 from valadaptive/separate-ooba-endpoints
...
Move Ooba/textgenerationwebui endpoints into their own module
2023-12-14 01:27:05 +02:00
274605a07c
Rename Kobold-related endpoints
2023-12-12 16:42:12 -05:00
5b3c96df50
Rename /textgenerationwebui endpoint
...
I'd like to migrate over to using "textgen" to mean text-generation APIs
in general, so I've renamed the /textgenerationwebui/* endpoints to
/backends/text-completions/*.
2023-12-12 16:40:14 -05:00
7732865e4c
Another explanatory comment
2023-12-12 16:36:47 -05:00
87cbe361fc
Cache stopping strings rather than skipping them
2023-12-12 16:32:54 -05:00
3d7706e6b3
#1524 Skip stop strings clean-up during streaming
2023-12-12 23:09:39 +02:00
83f2c1a8ed
#1524 Add FPS limiter to streamed rendering
2023-12-12 22:11:23 +02:00
9160de7714
Run macros on impersonation prompt
2023-12-12 19:24:32 +02:00
9176f46caf
Add /preset command
2023-12-12 19:14:17 +02:00
a9a05b17b9
Merge pull request #1517 from LenAnderson/firstIncludedMessageId
...
Add macro for first included message in context
2023-12-12 01:24:57 +02:00
07fecacce2
Add to macro help
2023-12-12 01:24:21 +02:00
f1ed60953a
Merge pull request #1516 from LenAnderson/slash-command-for-getTokenCount
...
Add /tokens slash command to call getTokenCount
2023-12-12 01:19:24 +02:00
299749a4e7
Add prerequisites for websearch extension
2023-12-12 01:08:47 +02:00
2bdd3672d4
add macro for first included message in context
2023-12-11 23:06:21 +00:00
69f90a0b30
add /tokens slash command to call getTokenCount
2023-12-11 22:51:07 +00:00
1b11ddc26a
Add vector storage to WI scanning
2023-12-11 22:47:26 +02:00
afe3e824b1
Unblock left swipe on swipeId overflow.
2023-12-11 21:16:09 +02:00
e713021737
Merge pull request #1511 from valadaptive/more-kobold-cleanups
...
More Kobold cleanups
2023-12-11 20:59:49 +02:00
05ab147209
Fix swipes getting stuck when no Horde models selected
2023-12-11 20:46:34 +02:00
27782b2f83
Fix united version comparison
2023-12-11 20:44:29 +02:00
7482a75bbd
Merge pull request #1493 from valadaptive/generate-cleanups
...
Clean up Generate(), part 1
2023-12-11 20:21:32 +02:00
d38a4dc6c1
Fix abort group generation
2023-12-11 20:03:31 +02:00
0302686a96
Return from Generate if calling circuit breaker
2023-12-11 19:07:33 +02:00
e96fb0c1b5
Fix group wrapper not resolving to a valid text
2023-12-11 19:00:42 +02:00
0fcf8fd491
Typing indicator fixed
2023-12-11 18:23:00 +02:00
c48e447c42
Add rows and button text to import window
2023-12-11 16:23:47 +02:00
17105568f4
Reduce hard coded anim. durations
2023-12-11 16:23:21 +02:00
e7c2975ab0
Fix adv.defs overlap with past chats. Close CFG with Escape
2023-12-11 15:39:58 +02:00
c6bd3ef255
Fix /sys continue in groups
2023-12-11 15:08:20 +02:00
42d4ffe5e8
Remove Kobold "canUse(...)" functions
...
Replace them all with a versionCompare helper function which we can call
directly with the minimum version constants.
2023-12-10 20:39:21 -05:00
d33cb0d8d1
Clarify getstatus API
...
Instead of "version" and "koboldVersion", have "koboldUnitedVersion" and
"koboldCppVersion", the latter of which is null if we're not connected
to KoboldCpp.
2023-12-10 20:34:11 -05:00
1fbf4394c8
Separate Kobold Horde status function
2023-12-10 20:16:07 -05:00
3ab1962b84
Improve circuit breaker
...
We now track the loop counter as a parameter of Generate that we
decrement with every recursive call, rather than a global variable,
and it *should* now work with quiet prompt generation.
2023-12-10 18:46:28 -05:00
3d7c901464
Remove looping backoff behavior
2023-12-10 18:35:46 -05:00
23e6a10cb5
Unsqueeze advanced defs rows
2023-12-11 01:33:56 +02:00
315d981804
Reject generation on circuit breaker error
2023-12-10 18:13:34 -05:00
7450112e9b
Unbust user continue in group chats
2023-12-11 00:02:49 +02:00
e8742a3e9d
Merge branch 'release' into staging
2023-12-10 23:28:10 +02:00
2e6ab8be46
Add Object.hasOwn polyfill
2023-12-10 23:28:00 +02:00
05b08f1ce2
Don't await delay promise
2023-12-10 21:51:16 +02:00
2e50efc35c
Limit waiting for TTS to init to 1 second on chat change
2023-12-10 21:50:52 +02:00
ae9445e500
Reject on data.error
2023-12-10 13:56:31 -05:00
5fd466b53f
Fix generateQuietPrompt
2023-12-10 13:54:39 -05:00
420d186823
Add reduced motion toggle
2023-12-10 20:02:25 +02:00
33f969f097
Have Generate() return a promise
...
Generate(), being async, now returns a promise-within-a-promise.
If called with `let p = await Generate(...)`, it'll wait for generation
to *start*. If you then `await p`, you'll wait for generation to
*finish*. This makes it much easier to tell exactly when generation's
done. generateGroupWrapper has been similarly modified.
2023-12-10 12:30:10 -05:00
13e016f3e5
Merge pull request #1508 from LenAnderson/tts-skip-codeblocks-option
...
add TTS option to skip codeblock narration
2023-12-10 19:28:16 +02:00
03884b29ad
Always call resolve in Generate()
...
This lets us get rid of the janky hack in group-chats to tell when a
message is done generating.
2023-12-10 12:26:30 -05:00
f5d2e50f5e
Remove isGenerationAborted
...
Just check the AbortSignal.
2023-12-10 12:24:18 -05:00
f8a903e1fd
#1506 Fix big markdown images
2023-12-10 18:45:55 +02:00
dbd52a7994
Merge pull request #1482 from valadaptive/sse-stream
...
Refactor server-sent events parsing
2023-12-10 18:32:19 +02:00
bf88829b03
add option to skip codeblock narration
2023-12-10 16:32:10 +00:00
af89cfa870
Code clean-up
2023-12-10 16:48:25 +02:00
5054de247b
Merge branch 'staging' into qr-editor-tab-support
2023-12-10 16:36:28 +02:00
9acef0fae6
Horde doesn't support API tokenizers
2023-12-10 16:21:06 +02:00
f54bf99006
Fix token ids not displaying in "API_CURRENT" mode for TextGen
2023-12-10 16:09:00 +02:00
6957d9e7cf
Fix display names of Best match tokenizers
2023-12-10 16:03:25 +02:00
6e5eea5dba
Unbreak previously selected API tokenizer in dropdown
2023-12-10 15:56:38 +02:00
d5140142fb
Merge branch 'staging' into tokenizers-cleanup
2023-12-10 15:51:15 +02:00
e0d0e1dd66
Merge pull request #1502 from valadaptive/status-cleanup
...
Clean up getStatus code
2023-12-10 15:49:37 +02:00
6be1c6ff10
Merge pull request #1504 from valadaptive/store-compiled-templates
...
Cache compiled Handlebars templates
2023-12-10 15:32:52 +02:00
5f1683f43a
More input padding and stricter sanitation
2023-12-10 15:07:39 +02:00
0201a0260c
Default event type to 'message' if it's empty
...
Added to the upstream test suite. Matches the spec.
2023-12-10 04:45:10 -05:00
55976e61a3
Fix tokenizer override
...
I searched for all users of tokenizers.API, but missed that the menu
converts the numerical select values directly to enum values. I've used
the special tokenizer value 98 to represent "the tokenizer API for
whichever backend we're currently using".
2023-12-09 23:57:21 -05:00
valadaptive
Cohee
LenAnderson
based