rixty/KoboldAI-Client
1
1
Fork 0
mirror of https://github.com/KoboldAI/KoboldAI-Client.git synced 2025-06-05 21:59:24 +02:00
Code Issues Projects Releases Wiki Activity
Files
fc7a07a62354b2fe59fda9d990a414d481541115
KoboldAI-Client/modeling/inference_models/koboldcpp/examples/batched.swift
History
Henk 5eb5588d8a Koboldcpp
2023-12-16 23:00:05 +01:00
..
Sources
Koboldcpp
2023-12-16 23:00:05 +01:00
Makefile
Koboldcpp
2023-12-16 23:00:05 +01:00
Package.swift
Koboldcpp
2023-12-16 23:00:05 +01:00
README.md
Koboldcpp
2023-12-16 23:00:05 +01:00

README.md

This is a swift clone of examples/batched.

$ make $ ./batched_swift MODEL_PATH [PROMPT] [PARALLEL]