core/chat library
Classes
- InferenceChat
- StopTokenFilter
-
Filters stop tokens from a model response stream: detects
<end_of_turn>and terminates the stream there, buffering partial tag matches.
Constants
- defaultMaxFunctionBufferLength → const int
- Default maximum length for function call buffer before flushing as text. Must accommodate verbose formats (DeepSeek tags, parallel calls).