topP property

double? topP
final

Optional. For Nucleus sampling.

Nucleus sampling considers the smallest set of tokens whose probability sum is at least top_p.

This value specifies default to be the one used by the base model while creating the model.

Implementation

final double? topP;