llama_context_params class final

Inheritance
Implemented types
Available extensions

Constructors

llama_context_params()

Properties

abort_callback ↔ ggml_abort_callback
getter/setter pair
abort_callback_data ↔ Pointer<Void>
getter/setter pair
address → Pointer<T>

Available on T, provided by the StructAddress extension

The memory address of the underlying data.
no setter
attention_type → llama_attention_type
no setter
attention_typeAsInt ↔ int
getter/setter pair
cb_eval ↔ ggml_backend_sched_eval_callback
getter/setter pair
cb_eval_user_data ↔ Pointer<Void>
getter/setter pair
defrag_thold ↔ double
getter/setter pair
embeddings ↔ bool
getter/setter pair
flash_attn_type → llama_flash_attn_type
no setter
flash_attn_typeAsInt ↔ int
getter/setter pair
hashCode → int
The hash code for this object.
no setterinherited
kv_unified ↔ bool
getter/setter pair
n_batch ↔ int
getter/setter pair
n_ctx ↔ int
getter/setter pair
n_seq_max ↔ int
getter/setter pair
n_threads ↔ int
getter/setter pair
n_threads_batch ↔ int
getter/setter pair
n_ubatch ↔ int
getter/setter pair
no_perf ↔ bool
getter/setter pair
offload_kqv ↔ bool
getter/setter pair
op_offload ↔ bool
getter/setter pair
pooling_type → llama_pooling_type
no setter
pooling_typeAsInt ↔ int
getter/setter pair
rope_freq_base ↔ double
getter/setter pair
rope_freq_scale ↔ double
getter/setter pair
rope_scaling_type → llama_rope_scaling_type
no setter
rope_scaling_typeAsInt ↔ int
getter/setter pair
runtimeType → Type
A representation of the runtime type of the object.
no setterinherited
swa_full ↔ bool
getter/setter pair
type_k → ggml_type
no setter
type_kAsInt ↔ int
getter/setter pair
type_v → ggml_type
no setter
type_vAsInt ↔ int
getter/setter pair
yarn_attn_factor ↔ double
getter/setter pair
yarn_beta_fast ↔ double
getter/setter pair
yarn_beta_slow ↔ double
getter/setter pair
yarn_ext_factor ↔ double
getter/setter pair
yarn_orig_ctx ↔ int
getter/setter pair

Methods

noSuchMethod(Invocation invocation) → dynamic
Invoked when a nonexistent method or property is accessed.
inherited
toString() → String
A string representation of this object.
inherited

Operators

operator ==(Object other) → bool
The equality operator.
inherited