tokensInfo property

List<TokensInfo> tokensInfo
final

Lists of tokens info from the input. A ComputeTokensRequest could have multiple instances with a prompt in each instance. We also need to return lists of tokens info for the request with multiple instances.

Implementation

final List<TokensInfo> tokensInfo;