rixty/KoboldAI-Client
1
1
Fork 0
mirror of https://github.com/KoboldAI/KoboldAI-Client.git synced 2025-06-05 21:59:24 +02:00
Code Issues Projects Releases Wiki Activity
Files
fc7a07a62354b2fe59fda9d990a414d481541115
KoboldAI-Client/modeling/inference_models/koboldcpp/examples/parallel
History
Henk 5eb5588d8a Koboldcpp
2023-12-16 23:00:05 +01:00
..
CMakeLists.txt
Koboldcpp
2023-12-16 23:00:05 +01:00
parallel.cpp
Koboldcpp
2023-12-16 23:00:05 +01:00
README.md
Koboldcpp
2023-12-16 23:00:05 +01:00

README.md

llama.cpp/example/parallel

Simplified simulation of serving incoming requests in parallel