rixty/KoboldAI-Client
1
1
Fork 0
mirror of https://github.com/KoboldAI/KoboldAI-Client.git synced 2025-06-05 21:59:24 +02:00
Code Issues Projects Releases Wiki Activity
Files
fc7a07a62354b2fe59fda9d990a414d481541115
KoboldAI-Client/modeling/inference_models/koboldcpp/examples/lookahead
History
Henk 5eb5588d8a Koboldcpp
2023-12-16 23:00:05 +01:00
..
CMakeLists.txt
Koboldcpp
2023-12-16 23:00:05 +01:00
lookahead.cpp
Koboldcpp
2023-12-16 23:00:05 +01:00
README.md
Koboldcpp
2023-12-16 23:00:05 +01:00

README.md

llama.cpp/examples/lookahead

Demonstration of lookahead decoding technique:

https://lmsys.org/blog/2023-11-21-lookahead-decoding/

More info: https://github.com/ggerganov/llama.cpp/pull/4207