ngramSize property

int ngramSize
final

The number of last N input tokens used as ngram to search/match against the previous prompt sequence. This is equal to the N in N-Gram. The default value is 3 if not specified.

Implementation

final int ngramSize;