BidiGenerateContentRealtimeInput class final

User input that is sent in real time.

The different modalities (audio, video and text) are handled as concurrent streams. The ordering across these streams is not guaranteed.

This is different from BidiGenerateContentClientContent in a few ways:

  • Can be sent continuously without interruption to model generation.
  • If there is a need to mix data interleaved across the BidiGenerateContentClientContent and the BidiGenerateContentRealtimeInput, the server attempts to optimize for best response, but there are no guarantees.
  • End of turn is not explicitly specified, but is rather derived from user activity (for example, end of speech).
  • Even before the end of turn, the data is processed incrementally to optimize for a fast start of the response from the model.
Inheritance
  • Object
  • ProtoMessage
  • BidiGenerateContentRealtimeInput

Constructors

BidiGenerateContentRealtimeInput({List<Blob> mediaChunks = const [], Blob? audio, bool? audioStreamEnd, Blob? video, String? text, BidiGenerateContentRealtimeInput_ActivityStart? activityStart, BidiGenerateContentRealtimeInput_ActivityEnd? activityEnd})
BidiGenerateContentRealtimeInput.fromJson(Object? j)
factory

Properties

activityEnd BidiGenerateContentRealtimeInput_ActivityEnd?
Optional. Marks the end of user activity. This can only be sent if automatic (i.e. server-side) activity detection is disabled.
final
activityStart BidiGenerateContentRealtimeInput_ActivityStart?
Optional. Marks the start of user activity. This can only be sent if automatic (i.e. server-side) activity detection is disabled.
final
audio Blob?
Optional. These form the realtime audio input stream.
final
audioStreamEnd bool?
Optional. Indicates that the audio stream has ended, e.g. because the microphone was turned off.
final
hashCode int
The hash code for this object.
no setterinherited
mediaChunks List<Blob>
Optional. Inlined bytes data for media input. Multiple media_chunks are not supported, all but the first will be ignored.
final
qualifiedName String
The fully qualified name of this message, i.e., google.protobuf.Duration or google.rpc.ErrorInfo.
finalinherited
runtimeType Type
A representation of the runtime type of the object.
no setterinherited
text String?
Optional. These form the realtime text input stream.
final
video Blob?
Optional. These form the realtime video input stream.
final

Methods

noSuchMethod(Invocation invocation) → dynamic
Invoked when a nonexistent method or property is accessed.
inherited
toJson() Object
override
toString() String
A string representation of this object.
override

Operators

operator ==(Object other) bool
The equality operator.
inherited

Constants

fullyQualifiedName → const String