ngramSpeculation property

SpeculativeDecodingSpec_NgramSpeculation? ngramSpeculation
final

N-Gram speculation.

Implementation

final SpeculativeDecodingSpec_NgramSpeculation? ngramSpeculation;