The GeminiLiveWebsocketTransport class extends the RealTimeWebsocketTransport to implement a fully functional RTVI Transport. It provides a framework for implementing real-time communication directly with the Gemini Multimodal Live service. RealTimeWebsocketTransport handles media device management, audio/video streams, and state management for the connection.
Transports of this type are designed primarily for development and testing
purposes. For production applications, you will need to build a server
component with a server-friendly transport, like the
DailyTransport, to securely handle API keys.
// at setup time...llmHelper = new LLMHelper({});rtviClient.registerHelper("llm", llmHelper);// the 'llm' name in this call above isn't used.//that value is specific to working with a pipecat pipeline// at time of sending message...// Send text prompt messagellmHelper.appendToMessages({ role: "user", content: 'Hello OpenAI!' });