Skip to main content

​
Overview

UltravoxRealtimeLLMService provides real-time conversational AI capabilities using Ultravox’s Realtime API. It supports both text and audio modalities with voice transcription, streaming responses, and tool usage for creating interactive AI experiences.

Ultravox Realtime API Reference

Pipecat’s API methods for Ultravox Realtime integration

Example Implementation

Complete Ultravox Realtime conversation example

Ultravox Documentation

Official Ultravox API documentation

Ultravox Console

Access Ultravox models and manage API keys

​
Installation

To use Ultravox Realtime services, install the required dependencies: 
pip install "pipecat-ai[ultravox]"

​
Prerequisites

​
Ultravox Account Setup

Before using Ultravox Realtime services, you need:
  1. Ultravox Account: Sign up at Ultravox Console
  2. API Key: Generate an Ultravox API key from your account dashboard
  3. Model Access: Ensure access to Ultravox Realtime models
  4. Usage Limits: Configure appropriate usage limits and billing

​
Required Environment Variables

  • ULTRAVOX_API_KEY: Your Ultravox API key for authentication

​
Key Features

  • Audio-Native Model: Ultravox is an audio-native model for natural voice interactions
  • Real-time Streaming: Low-latency audio processing and streaming responses
  • Multiple Input Modes: Support for Agent, One-Shot, and Join URL input parameters
  • Voice Transcription: Built-in transcription with streaming output
  • Function Calling: Support for tool integration and API calling
  • Configurable Duration: Set maximum call duration limits