SpeculativeDecodingSpec class final

Configuration for Speculative Decoding.

Inheritance
  • Object
  • ProtoMessage
  • SpeculativeDecodingSpec

Constructors

SpeculativeDecodingSpec({SpeculativeDecodingSpec_DraftModelSpeculation? draftModelSpeculation, SpeculativeDecodingSpec_NgramSpeculation? ngramSpeculation, int speculativeTokenCount = 0})
SpeculativeDecodingSpec.fromJson(Object? j)
factory

Properties

draftModelSpeculation → SpeculativeDecodingSpec_DraftModelSpeculation?
draft model speculation.
final
hashCode → int
The hash code for this object.
no setterinherited
ngramSpeculation → SpeculativeDecodingSpec_NgramSpeculation?
N-Gram speculation.
final
qualifiedName → String
The fully qualified name of this message, i.e., google.protobuf.Duration or google.rpc.ErrorInfo.
finalinherited
runtimeType → Type
A representation of the runtime type of the object.
no setterinherited
speculativeTokenCount → int
The number of speculative tokens to generate at each step.
final

Methods

noSuchMethod(Invocation invocation) → dynamic
Invoked when a nonexistent method or property is accessed.
inherited
toJson() → Object
override
toString() → String
A string representation of this object.
override

Operators

operator ==(Object other) → bool
The equality operator.
inherited

Constants

fullyQualifiedName → const String