rixty
/
SillyTavern
mirror of https://github.com/SillyTavern/SillyTavern.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
SillyTavern/src/tokenizers
History
Cohee e707def7dd Add tokenizer for Gemma/Gemini 2024-08-16 00:00:43 +03:00
..
claude.json Lazy initialization of Claude tokenizer. Add JSDoc for tokenizer handlers 2024-04-26 15:17:02 +03:00
gemma.model Add tokenizer for Gemma/Gemini 2024-08-16 00:00:43 +03:00
llama.model Lazy initialization of Claude tokenizer. Add JSDoc for tokenizer handlers 2024-04-26 15:17:02 +03:00
llama3.json Add llama 3 tokenizer 2024-05-03 23:59:39 +03:00
mistral.model Lazy initialization of Claude tokenizer. Add JSDoc for tokenizer handlers 2024-04-26 15:17:02 +03:00
nerdstash.model Lazy initialization of Claude tokenizer. Add JSDoc for tokenizer handlers 2024-04-26 15:17:02 +03:00
nerdstash_v2.model Lazy initialization of Claude tokenizer. Add JSDoc for tokenizer handlers 2024-04-26 15:17:02 +03:00
yi.model Lazy initialization of Claude tokenizer. Add JSDoc for tokenizer handlers 2024-04-26 15:17:02 +03:00