speculativeTokenCount property

int speculativeTokenCount
final

The number of speculative tokens to generate at each step.

Implementation

final int speculativeTokenCount;