flutter_local_llm 1.0.0 copy "flutter_local_llm: ^1.0.0" to clipboard
flutter_local_llm: ^1.0.0 copied to clipboard

High-performance, production-grade Flutter plugin for on-device local LLM inference using llama.cpp via Dart FFI and Native Assets.

Use this package as a library

Depend on it

Run this command:

With Flutter:

 $ flutter pub add flutter_local_llm

This will add a line like this to your package's pubspec.yaml (and run an implicit flutter pub get):

dependencies:
  flutter_local_llm: ^1.0.0

Alternatively, your editor might support flutter pub get. Check the docs for your editor to learn more.

Import it

Now in your Dart code, you can use:

import 'package:flutter_local_llm/flutter_local_llm.dart';
1
likes
160
points
150
downloads

Documentation

API reference

Publisher

verified publishertherohitsoni.in

Weekly Downloads

High-performance, production-grade Flutter plugin for on-device local LLM inference using llama.cpp via Dart FFI and Native Assets.

Repository (GitHub)
View/report issues

Topics

#llm #llama-cpp #on-device #ai #ffi

License

MIT (license)

Dependencies

crypto, ffi, flutter, http, meta, path, path_provider

More

Packages that depend on flutter_local_llm

Packages that implement flutter_local_llm