topK property

int get topK

Top K number of tokens to be sampled from for each decoding step.

Implementation

int get topK;