Skip to main content

​
Overview

The GoogleRTVIObserver extends the base RTVIObserver type, to add support for the bot-llm-search-response message type and providing clients with the search results from the GoogleLLMService. See this section on Search Grounding for more details.

API Reference

Complete API documentation and method details

Gemini Docs

Official Google Gemini API documentation and features

Example Code

Working example using Google’s search grounding to ask about current events

​
Installation

To use GoogleRTVIObserver, install the required dependencies: 
pip install "pipecat-ai[google]"
You’ll also need to follow setup instructions for the Google LLM Service to ensure the GoogleLLMService is properly configured.

​
Frame Translation

The observer maps the LLMSearchResponseFrame to the RTVIBotLLMSearchResponseMessage. Check out the RTVI Standard Reference for details on the message format.

​
Usage Example

To use GoogleRTVIObserver, pass a GoogleRTVIProcessor to your PipelineTask. This automatically creates and attaches the Google-specific observer: 
from pipecat.services.google.rtvi import GoogleRTVIProcessor

pipeline = Pipeline([
    transport.input(),
    stt,
    # Other processors...
])

task = PipelineTask(
    pipeline,
    rtvi_processor=GoogleRTVIProcessor(),
)