speculativeDecodingSpec property

SpeculativeDecodingSpec? speculativeDecodingSpec
final

Optional. Spec for configuring speculative decoding.

Implementation

final SpeculativeDecodingSpec? speculativeDecodingSpec;