The base class for a live model connection.

Constructors

Methods

  • Sends the conversation history to the model.

    You call this method right after setting up the model connection. The model will respond if the last content is from user, otherwise it will wait for new user input before responding.

    Parameters

    • history: Content[]

      The conversation history to send to the model.

    Returns Promise<void>

  • Sends a user content to the model.

    The model will respond immediately upon receiving the content. If you send function responses, all parts in the content should be function responses.

    Parameters

    • content: Content

      The content to send to the model.

    Returns Promise<void>

  • Sends a chunk of audio or a frame of video to the model in realtime.

    The model may not respond immediately upon receiving the blob. It will do voice activity detection and decide when to respond.

    Parameters

    • blob: Blob_2

      The blob to send to the model.

    Returns Promise<void>