valadaptive
7486ab3886
Separate textgen and Kobold tokenization APIs ...
They function differently and have different logic and API parameters,
so it makes sense to count them as two different APIs. Kobold's API
doesn't return tokens, so it can only be used to count them.
There's still a lot of duplicate code which I will clean up in the
following commits.
2023-12-09 20:24:56 -05:00
2023-12-09 17:20:15 +00:00
2023-12-07 02:35:24 +02:00
2023-12-02 22:06:57 +02:00
2023-12-07 15:17:19 -05:00
2023-12-06 19:59:58 -05:00
2023-12-04 12:32:41 -05:00
2023-12-09 16:09:10 +02:00
2023-12-02 22:06:57 +02:00
2023-12-09 16:01:43 +02:00
2023-12-02 22:06:57 +02:00
2023-12-02 21:56:16 +02:00
2023-12-02 21:11:06 +02:00
2023-12-06 19:59:58 -05:00
2023-12-02 22:06:57 +02:00
2023-12-02 13:04:51 -05:00
2023-12-02 21:11:06 +02:00
2023-12-03 20:40:09 +02:00
2023-12-03 14:23:20 +02:00
2023-12-03 14:56:01 -05:00
2023-12-03 20:56:25 +02:00
2023-12-07 17:42:06 +02:00
2023-12-02 22:06:57 +02:00
2023-12-07 11:52:10 +09:00
2023-12-03 14:56:01 -05:00
2023-12-07 01:27:55 +02:00
2023-12-04 11:00:22 +02:00
2023-12-04 10:14:51 -05:00
2023-12-02 13:04:51 -05:00
2023-12-02 13:04:51 -05:00
2023-12-02 22:06:57 +02:00
2023-12-08 00:40:14 +02:00
2023-12-07 13:00:34 -05:00
2023-12-03 14:23:20 +02:00
2023-12-03 23:24:39 +02:00
2023-12-09 20:24:56 -05:00
2023-12-06 17:22:37 -05:00
2023-12-08 00:33:27 +02:00
2023-12-07 20:06:06 +02:00
7486ab3886