llamacpp_tools 0.2.0
llamacpp_tools: ^0.2.0 copied to clipboard
Tools to manage llama.cpp local setup (detecting, downloading or building, running).
Changelog #
0.2.0 #
Breaking changes:
- Github methods are moved into the
LlamacppGithub
class and renamed. - Docker-builder methods are moved into the
LlamacppDocker
class and renamed.
0.1.2 #
- Improved CUDA build (copying runtime libraries).
- Small improvements in
LlamacppDir
and the server process.
0.1.1 #
- Added support for running the
llama-server
process.
0.1.0 #
- Inital release with downloading from GitHub and building CUDA-support with docker.