llamacpp_tools library
Classes
- Benchmark
- A benchmark run for the given configuration.
- LlamacppDir
- Represents a detected llama.cpp directory with its root path.
- LlamacppDocker
- LlamacppGithub
- Utility class for methods using or accessing the llama.cpp GitHub page.
- LlamaserverConfig
- Configuration for a llama.cpp server process.
- LlamaserverContext
- Gives access to a llama-server process with base URL and RPC client.
- LlamaserverProcess
- Manages a llama.cpp server process lifecycle.
- LlamaserverSpec
-
Specifies a llama-server process for
ProcessSwitcher. - LlamaserverSpecRegistry
- ModelDetectionResult
- Complete model detection result
- ModelDetector
- Class for model detection operations
- ModelFileInfo
- Model file metadata