225 Commits

Author	SHA1	Message	Date
Cohee	cd0b834291	Implement "except" mode for type-specific controls in settings	2024-12-13 20:58:16 +02:00
Cohee	3167019faf	Add generic text completion API type (100% OAI compatible)	2024-12-13 01:12:10 +02:00
Cohee	cc73a45d1f	Make lint happy	2024-12-09 17:32:23 +02:00
AlpinDale	bcbfcb87b5	aphrodite: send an empty sampler priority list if using the default order	2024-12-09 14:05:33 +00:00
Cohee	323b9407df	Small cosmetic fixes	2024-12-09 15:26:57 +02:00
Cohee	3ed5d892f7	Fix bugs with the settings	2024-12-09 15:13:19 +02:00
AlpinDale	add108b821	fix the JS issue where both ooba and aphro were using the same container ID	2024-12-07 12:36:10 +00:00
AlpinDale	a1115ab4ff	Merge remote-tracking branch 'alpin/staging' into sampler_order	2024-12-07 12:27:55 +00:00
Cohee	77841dbc21	Add types for SillyTavern.getContext	2024-12-06 16:41:26 +02:00
Cohee	2ef095c273	Merge branch 'release' into staging	2024-12-04 01:35:50 +02:00
Cohee	e6be28acea	llama.cpp: Don't send empty DRY sequence breakers ... Fixes #3048	2024-12-04 01:32:27 +02:00
Cohee	7ce2841588	Add trim_stop to koboldcpp requests ... Fixes #3143	2024-12-03 14:49:20 +00:00
AlpinDale	80c8e83f09	use strings instead of IDs	2024-12-03 01:46:51 +00:00
AlpinDale	e664806990	add DRY, skew, and no repeat ngram penalty	2024-11-25 22:28:58 +00:00
Cohee	fdd798e2da	Merge branch 'staging' into top-nsigma	2024-11-25 00:08:38 +02:00
ceruleandeep	0383ea52e9	Linting and commenting ... Linting and commenting Linting and commenting Linting and commenting Linting and commenting	2024-11-22 11:55:27 +11:00
AlpinDale	ec4cff72fe	feat: add top nsigma sampler support	2024-11-19 23:05:23 +00:00
Beinsezii	c599f46269	Remove best_of for VLLM ... It defaults to `n` anyways, and for some reason it was being incorrectly received on 0.6.4.post1	2024-11-16 02:05:35 -08:00
Cohee	07feccbe35	koboldcpp: parse logprobs	2024-11-01 11:38:31 +02:00
Cohee	00f0f755fc	Support comma-separated list of llama.cpp sequence breakers #3026	2024-10-28 11:44:26 +00:00
Cohee	542f77aeb8	Safe sequence breakers parse	2024-10-28 11:39:59 +00:00
Beinsezii	ace2902cb8	llama.cpp Enable dry w/ array convert ... The new PR that was merged needs an array instead of a str https://github.com/ggerganov/llama.cpp/pull/9702	2024-10-26 16:07:07 -07:00
Cohee	725cfdebca	Merge pull request #2993 from theo77186/llamacpp_xtc ... Enable XTC support for llama.cpp	2024-10-16 20:52:06 +03:00
Cohee	276316ae62	Auto-add missing samplers for llama.cpp	2024-10-16 20:51:32 +03:00
theo77186	37f3a24ac6	Enable XTC support for llama.cpp	2024-10-16 18:30:46 +02:00
Cohee	24884b3206	TextGenWebUI: remove legacy API mode	2024-10-15 00:32:56 +03:00
Cohee	80f9d90918	Merge branch 'staging' into featherless-models	2024-10-09 21:51:59 +03:00
Cohee	151a77cd36	Initialize page on load	2024-10-09 21:51:31 +03:00
Cohee	3335dbf1a7	Add empty tool calls to streaming processors	2024-10-02 01:59:53 +03:00
Cohee	ac1bc95551	Xtra Type Cafety	2024-09-28 13:59:03 +03:00
Cohee	b1bb41313f	Insert missing ooba samplers	2024-09-28 13:56:57 +03:00
Cohee	8bd1c88d15	Enable XTC	2024-09-28 13:52:55 +03:00
Cohee	e59dacc27f	Merge branch 'staging' into xtc-ooba	2024-09-28 13:49:49 +03:00
Cohee	aaf8fa13e5	Remove condition	2024-09-21 13:18:52 +03:00
AlpinDale	a5fea35f12	chore: update aphrodite samplers	2024-09-21 08:18:06 +00:00
Cohee	0207794a2b	Fix Qwen and Command tokenizers not used for logit bias	2024-09-17 13:01:19 +00:00
Alexander Abushady	eb6097b1e8	Fixed Aphrodite Seed ... Aphrodite's seed value needs to be undefined to be random.	2024-09-16 08:21:56 -04:00
Cohee	2478e17164	Remove legacy API for Aphrodite	2024-09-15 08:05:53 +03:00
Cohee	50de678980	Hide beam search for vllm. It never worked.	2024-09-14 16:53:21 +03:00
Cohee	f0d361bc7a	Remove unused beam search	2024-09-14 16:41:22 +03:00
Cohee	28837ff883	Hard code include_stop_str_in_output	2024-09-14 16:32:50 +03:00
AlpinDale	1cc935796f	fix early_stopping	2024-09-14 12:45:29 +00:00
AlpinDale	fde76069e0	remove beam search	2024-09-14 12:42:21 +00:00
AlpinDale	9c94348491	clean up	2024-09-14 12:38:19 +00:00
AlpinDale	efd477da04	chore: slight refactor of aphrodite samplers	2024-09-13 10:34:06 +00:00
Cohee	7534e137ae	Parse Tabby streaming error.	2024-09-08 22:24:03 +03:00
Cohee	42fa3c79d7	Add Tabby model selection	2024-09-08 22:23:25 +03:00
Cohee	b16915cfb9	Remove truncation_length from textgen settings	2024-09-03 14:06:10 +00:00
Cohee	cd8dd5fc8a	XTC for ooba	2024-08-31 20:31:34 +03:00
Cohee	ae2d0f04ed	Add XTC for koboldcpp	2024-08-31 20:18:51 +03:00