Cohee
edd737e8bd
#371 Add llama.cpp inference server support
2023-12-18 22:38:28 +02:00
Cohee
b0d9f14534
Re-add Together as a text completion source
2023-12-17 23:38:03 +02:00
Cohee
180061337e
Merge branch 'staging' into anachronous/release
2023-12-17 21:35:49 +02:00
LenAnderson
fb25a90532
add GENERATION_STARTED event
2023-12-17 17:45:23 +00:00
anachronos
1e88c8922a
Merge branch 'staging' into release
2023-12-17 10:38:04 +01:00
Fayiron
9f2d32524c
Add TogetherAI as a chat completion source, basic
2023-12-16 14:39:30 +01:00
based
583f786d74
finish mistral frontend integration + apikey status check
2023-12-16 07:15:57 +10:00
Cohee
ef17702f6a
Merge branch 'staging' into bg-load-improvements
2023-12-15 17:02:10 +02:00
Cohee
6c16b94f9d
Merge pull request #1540 from valadaptive/refactor-device-check
...
Refactor mobile device check
2023-12-15 17:01:32 +02:00
valadaptive
0ee19d2ede
Set background client-side
2023-12-15 05:45:21 -05:00
valadaptive
7897206cf8
Add a pre-loading screen cover
...
This matches the loader color and exists to prevent a flash of unstyled
content when the page first loads and JS has not yet run.
2023-12-15 05:34:33 -05:00
valadaptive
fbdfa05f81
Replace usage of getDeviceInfo with isMobile
...
We were using getDeviceInfo to check whether we were on a desktop or a
mobile device. This can be done more simply with isMobile, which means
we can stop exporting getDeviceInfo.
2023-12-14 18:37:54 -05:00
valadaptive
769cc0a78f
Rename settings API endpoints
2023-12-14 16:47:03 -05:00
Cohee
cde9903fcb
Fix Bison models
2023-12-14 22:18:34 +02:00
based
ca87f29771
added streaming for google models
2023-12-14 21:03:41 +10:00
based
be396991de
finish implementing ui changes for google models
2023-12-14 11:53:26 +10:00
based
69e24c9686
change palm naming in UI
2023-12-14 11:14:41 +10:00
Cohee
0cd92f13b4
Merge branch 'staging' into separate-kobold-endpoints
2023-12-14 01:33:36 +02:00
Cohee
b957e3b875
Merge pull request #1518 from valadaptive/separate-ooba-endpoints
...
Move Ooba/textgenerationwebui endpoints into their own module
2023-12-14 01:27:05 +02:00
valadaptive
274605a07c
Rename Kobold-related endpoints
2023-12-12 16:42:12 -05:00
valadaptive
5b3c96df50
Rename /textgenerationwebui endpoint
...
I'd like to migrate over to using "textgen" to mean text-generation APIs
in general, so I've renamed the /textgenerationwebui/* endpoints to
/backends/text-completions/*.
2023-12-12 16:40:14 -05:00
valadaptive
7732865e4c
Another explanatory comment
2023-12-12 16:36:47 -05:00
valadaptive
87cbe361fc
Cache stopping strings rather than skipping them
2023-12-12 16:32:54 -05:00
Cohee
3d7706e6b3
#1524 Skip stop strings clean-up during streaming
2023-12-12 23:09:39 +02:00
Cohee
83f2c1a8ed
#1524 Add FPS limiter to streamed rendering
2023-12-12 22:11:23 +02:00
Cohee
9176f46caf
Add /preset command
2023-12-12 19:14:17 +02:00
Cohee
a9a05b17b9
Merge pull request #1517 from LenAnderson/firstIncludedMessageId
...
Add macro for first included message in context
2023-12-12 01:24:57 +02:00
Cohee
299749a4e7
Add prerequisites for websearch extension
2023-12-12 01:08:47 +02:00
LenAnderson
2bdd3672d4
add macro for first included message in context
2023-12-11 23:06:21 +00:00
Cohee
1b11ddc26a
Add vector storage to WI scanning
2023-12-11 22:47:26 +02:00
Cohee
afe3e824b1
Unblock left swipe on swipeId overflow.
2023-12-11 21:16:09 +02:00
Cohee
e713021737
Merge pull request #1511 from valadaptive/more-kobold-cleanups
...
More Kobold cleanups
2023-12-11 20:59:49 +02:00
Cohee
05ab147209
Fix swipes getting stuck when no Horde models selected
2023-12-11 20:46:34 +02:00
Cohee
7482a75bbd
Merge pull request #1493 from valadaptive/generate-cleanups
...
Clean up Generate(), part 1
2023-12-11 20:21:32 +02:00
Cohee
0302686a96
Return from Generate if calling circuit breaker
2023-12-11 19:07:33 +02:00
Cohee
c48e447c42
Add rows and button text to import window
2023-12-11 16:23:47 +02:00
valadaptive
d33cb0d8d1
Clarify getstatus API
...
Instead of "version" and "koboldVersion", have "koboldUnitedVersion" and
"koboldCppVersion", the latter of which is null if we're not connected
to KoboldCpp.
2023-12-10 20:34:11 -05:00
valadaptive
1fbf4394c8
Separate Kobold Horde status function
2023-12-10 20:16:07 -05:00
valadaptive
3ab1962b84
Improve circuit breaker
...
We now track the loop counter as a parameter of Generate that we
decrement with every recursive call, rather than a global variable,
and it *should* now work with quiet prompt generation.
2023-12-10 18:46:28 -05:00
valadaptive
3d7c901464
Remove looping backoff behavior
2023-12-10 18:35:46 -05:00
valadaptive
315d981804
Reject generation on circuit breaker error
2023-12-10 18:13:34 -05:00
valadaptive
ae9445e500
Reject on data.error
2023-12-10 13:56:31 -05:00
valadaptive
5fd466b53f
Fix generateQuietPrompt
2023-12-10 13:54:39 -05:00
Cohee
420d186823
Add reduced motion toggle
2023-12-10 20:02:25 +02:00
valadaptive
33f969f097
Have Generate() return a promise
...
Generate(), being async, now returns a promise-within-a-promise.
If called with `let p = await Generate(...)`, it'll wait for generation
to *start*. If you then `await p`, you'll wait for generation to
*finish*. This makes it much easier to tell exactly when generation's
done. generateGroupWrapper has been similarly modified.
2023-12-10 12:30:10 -05:00
valadaptive
03884b29ad
Always call resolve in Generate()
...
This lets us get rid of the janky hack in group-chats to tell when a
message is done generating.
2023-12-10 12:26:30 -05:00
Cohee
dbd52a7994
Merge pull request #1482 from valadaptive/sse-stream
...
Refactor server-sent events parsing
2023-12-10 18:32:19 +02:00
Cohee
d5140142fb
Merge branch 'staging' into tokenizers-cleanup
2023-12-10 15:51:15 +02:00
Cohee
e0d0e1dd66
Merge pull request #1502 from valadaptive/status-cleanup
...
Clean up getStatus code
2023-12-10 15:49:37 +02:00
Cohee
6be1c6ff10
Merge pull request #1504 from valadaptive/store-compiled-templates
...
Cache compiled Handlebars templates
2023-12-10 15:32:52 +02:00
