Commit Graph

2 Commits

Author SHA1 Message Date
5bea179f3b Update GPT tokenizer
Fixes being unable to tokenize words like constructor/toString/etc
2023-02-23 15:07:05 +02:00
a417031af4 main 2022-12-22 07:22:29 +04:00