llamacpp_rpc_client 0.2.0 copy "llamacpp_rpc_client: ^0.2.0" to clipboard
llamacpp_rpc_client: ^0.2.0 copied to clipboard

Published 4 months ago • verified publisheragilord.com
SDKDartFlutter
PlatformAndroidiOSLinuxmacOSwebWindows
→

Metadata

HTTP client bindings to call the llama.cpp RPC server

More...

Changelog #

0.2.0 #

  • LlamacppRpcClient also takes headers that will be sent with each request.
  • generationSettings returns the full Map of applied settings, GenerationSettings may be created from it.
  • Updated CompletionImageData to store bytes while constructing.
  • Support /health endpoint.
  • Support /props endpoint. Note: property classes are mostly auto-generated, may be subject to breaking changes.
  • LlamacppRpcBatchClient (experimental) batch request processing.

0.1.0 #

  • Initial version.

← Metadata

1
likes
160
points
18
downloads

Publisher

verified publisheragilord.com

Weekly Downloads

Metadata

HTTP client bindings to call the llama.cpp RPC server

Repository (GitHub)
View/report issues

Topics

#llamacpp #llama-cpp #rpc #llm #client

Documentation

API reference

License

BSD-3-Clause (license)

Dependencies

args, executor, http, json_annotation

More

Packages that depend on llamacpp_rpc_client

Back