95c49029f7
Add aphrodite model selector
2024-03-01 23:02:43 +02:00
76669ff8bb
add max_tokens_second
2024-02-29 00:55:25 +01:00
f962ad5c02
Add OpenRouter as a text completion source
2024-02-25 22:47:07 +02:00
fc289126fa
Add event type for text completion generation request settings ready
2024-02-24 21:45:33 +02:00
d140b8d5be
Parse non-streaming tabby logprobs
2024-02-24 20:10:53 +02:00
8848818d67
Fix dynatemp neutralization
2024-02-24 15:32:12 +02:00
299bd9d563
Merge branch 'staging' into llamacpp-sampler-order
2024-02-24 15:10:58 +02:00
13aebc623a
Merge pull request #1854 from deciare/llamacpp-probs
...
Request and display token probabilities from llama.cpp backend
2024-02-24 15:06:28 +02:00
9287ff18de
Fix for non-streaming
2024-02-24 14:50:06 +02:00
9eba076ae4
Sampler order for llama.cpp server backend
2024-02-23 23:01:04 -05:00
936fbac6c5
Merge remote-tracking branch 'origin/staging' into llamacpp-probs
2024-02-23 17:45:54 -05:00
344b9eedbc
Request token probabilities from llama.cpp backend
...
llama.cpp server token probabilities are given as values ranging from
0 to 1 instead of as logarithms.
2024-02-23 14:01:46 -05:00
f569424f3e
Merge branch 'staging' into InfermaticAI
2024-02-22 08:32:10 -06:00
0ccdfe4bb7
Fix duped line
2024-02-22 02:45:35 +02:00
0c1cf9ff2e
Send sampler priority as array
2024-02-21 00:53:54 +02:00
32ee58e5e6
fix kcpp order reset
2024-02-19 18:12:56 -06:00
b5887960b6
Merge branch 'release' into InfermaticAI
2024-02-16 08:53:04 -06:00
9fed7ed742
Make the neutralize option turn off quad sampling
2024-02-10 17:57:00 -06:00
70deb11d27
implement jank js + drag n drop sampler priority
2024-02-10 16:32:46 -06:00
818029288e
Remove sending it if it's Aphrodite or TabbyAPI
2024-02-10 15:22:24 -06:00
2065f95edc
Sampler priority support
2024-02-10 14:57:41 -06:00
d8d4732614
Add koboldcpp param aliases
2024-02-09 15:32:40 +02:00
530455979f
Textgen: Add tabby to logprobs
...
Tabby now supports logprob returns. Add support to the backend gate.
Signed-off-by: kingbri <bdashore3@proton.me>
2024-02-08 20:59:54 -05:00
f372b2ac16
Textgen: Fix dynatemp defaults
...
The default min and max temp values should be 1
Signed-off-by: kingbri <bdashore3@proton.me>
2024-02-08 20:57:40 -05:00
f1cadfde2b
Fix llamacpp server
2024-02-04 17:41:46 +02:00
3e34123b31
Textgen: Fix sampling param requests
...
1. TabbyAPI was not being included in temperature_last
2. DynaTemp parameters were still being sent even though the checkbox
was off. Cleanup the parameters if dynatemp is off for backends that
don't take in a dynatemp boolean.
Signed-off-by: kingbri <bdashore3@proton.me>
2024-02-04 01:44:07 -05:00
6d0d92aaff
Add grammar and dynatemp for aphrodite
2024-02-02 20:06:46 +02:00
da68d35ca5
Remove Noisy Sampling
...
Leaves DynaTemp Exponent and Quadratic Sampling.
2024-01-30 21:50:50 -05:00
92aae0da04
Enter the Kalo Zone
2024-01-28 15:14:21 -05:00
8af3939f09
fix: logprobs for Aphrodite
...
Since Aphrodite follows the same logprobs style as ooba, we can enable it easily.
2024-01-26 07:15:39 +00:00
60044c18a4
Implement Token Probabilities UI using logprobs
2024-01-25 18:34:46 -06:00
f29f934c6b
Progress
2024-01-24 06:59:27 -06:00
570d5a30bd
[skip ci] Lint fix
2024-01-20 20:40:40 +02:00
5cb4dbc280
Trim TG types after split
2024-01-15 20:45:21 +02:00
22e605168b
Properly reset seed with neutralize samplers
2024-01-15 20:44:07 +02:00
c6487fa9cb
make sampler nuke button work with zensliders
2024-01-14 18:33:40 +09:00
80b39bdac1
add neutralize samplers button for text completion slider panel
2024-01-14 18:07:43 +09:00
44bd57f763
filter ooba-only samplers out of non-ooba text completion slider panels
2024-01-14 17:26:22 +09:00
1367642eb4
Fix maxTokens reference for n_predict alias
2024-01-12 12:20:03 +02:00
8659bd57b7
Add koboldcpp rep pen aliases
2024-01-12 12:12:53 +02:00
ec63cd8b6d
Dynatemp Range
...
Kobold Dynatemp range set when deactivated, now will work properly
2024-01-09 00:54:20 -05:00
5ad980cf99
Fix for realzies
2024-01-09 00:02:53 -05:00
04a5d8390d
Dynatemp UI v3.1
...
fixes for html positioning as well as api settings.
2024-01-08 23:58:06 -05:00
b334acec23
DynaTemp UI v3
...
Backend bros won't play along now we gotta make them hold hands.
2024-01-08 22:20:27 -05:00
2bea90a264
Merge pull request #1633 from AAbushady/new-dynatemp-ui
...
DynaTemp UI v2
2024-01-06 00:33:25 +02:00
224dcc83a1
Update DynaTemp Sliders
...
More inline with changes made that will be implemented in KCPP main.
2024-01-05 14:36:39 -05:00
5f93c30a96
#1627 Bypass status check and custom model for textgen type
2024-01-05 19:15:07 +02:00
86d715cc16
Improve tokenizer detection
2024-01-05 16:17:06 +02:00
d66be24518
DynaTemp UI v2
...
With DynaTemp moving into main KCPP now ST can have DynaTemp too!
2024-01-05 02:08:44 -05:00
47cb017a45
#1589 Add 'cache_prompt' for l.cpp
2023-12-25 02:42:03 +02:00
Cohee
gabriel dhimoila
Deciare
NWilson
kalomaze
kingbri
Alexander Abushady
AlpinDale
khanon
RossAscends
Alexander Abushady