Step 1: Local Development
Prerequisites
Environment- Python 3.11 or later
- uv package manager installed
Deepgram (STT)
Create an account and generate your API key for real-time
speech recognition.
OpenAI (LLM)
Create an account and generate an API key for intelligent conversation
responses.
Cartesia (TTS)
Sign up and generate your API key for natural voice
synthesis.
Setup
- Install the Pipecat CLI and scaffold the quickstart project
- Configure your API keys
.env file in your text editor and add your API keys:
- Set up virtual environment and install dependencies
Run your bot locally
Now you’re ready to run your bot! Start it withFirst run note: The initial startup may take ~20 seconds as Pipecat
downloads required models and imports. Subsequent runs will be much faster.
Step 2: Deploy to Production
Transform your local bot into a production-ready service. Pipecat Cloud handles scaling, monitoring, and global deployment.Prerequisites
- Sign up for Pipecat Cloud
- Pipecat CLI
Allow to authenticate your CLI session in the browser page that opens.
Your deployment configuration
Thepcc-deploy.toml file tells Pipecat Cloud how to build and deploy your bot:
agent_name: Your bot’s name in Pipecat Cloudsecret_set: Where your API keys are stored securelymin_agents: Number of bot instances to keep ready (1 = instant start)
Configure secrets
Upload your API keys to Pipecat Cloud’s secure storage:pipecat-quickstart-secrets (matching your TOML file) and uploads all your API keys from .env.
Build and Deploy
Build and deploy your bot to Pipecat Cloud:Want to use your own container registry? See the container registries
guide for advanced
deployment options.
Connect to your agent
- Open your Pipecat Cloud dashboard
- Select your
pipecat-quickstartagent → Sandbox - Allow microphone access and click Connect
Ready to scale?
Explore advanced Pipecat Cloud features like scaling, monitoring, secrets
management, and production best practices.
Understanding the Quickstart Bot
Let’s walk through the generatedbot.py to understand what’s happening. When you speak to your bot, here’s the real-time pipeline that processes your conversation:
- Audio Capture: Your browser captures microphone audio and sends it via WebRTC
- Voice Activity Detection: Silero VAD detects when you start and stop speaking
- Speech Recognition: Deepgram converts your speech to text in real-time
- Language Processing: OpenAI’s GPT model generates an intelligent response
- Speech Synthesis: Cartesia converts the response text back to natural speech
- Audio Playback: The generated audio streams back to your browser
AI Services
Your bot uses three AI services, each configured with API keys from your.env file:
Context and Messages
Your bot maintains conversation history using a context object, enabling multi-turn interactions where the bot remembers what was said earlier. The context is initialized and used to store the conversation history by the context aggregators:RTVI Protocol
When building web or mobile clients, you can use Pipecat’s client SDKs that communicate with your bot via the RTVI (Real-Time Voice Interaction) protocol. Pipecat comes with RTVI enabled by default, allowing your the Pipecat server and client to exchange messages and events in real-time.Pipeline Configuration
The core of your bot is a Pipeline that processes data through a series of processors:Event Handlers
Event handlers manage the bot’s lifecycle and user interactions:Running the Pipeline
Finally, the pipeline is executed by a WorkerRunner:handle_sigint=False because the main runner handles system signals.
Bot Entry Point
The quickstart uses Pipecat’s runner system:Troubleshooting
- Browser permissions: Make sure to allow microphone access when prompted by your browser.
- Connection issues: If the WebRTC connection fails, first try a different browser. If that fails, make sure you don’t have a VPN or firewall rules blocking traffic. WebRTC uses UDP to communicate.
- Audio issues: Check that your microphone and speakers are working and not muted.
Next Steps
Congratulations! You’ve built and deployed your first Pipecat bot. Here’s what to do next based on your goals:🚀 Ready to Build Your Own Application?
The quickstart gave you a working example, but the Pipecat CLI helps you scaffold production-ready projects with your choice of platform (phone vs web/mobile), transport providers, and AI services—all tailored to your specific use case.Build Your Next Bot
Use the CLI to scaffold phone or web/mobile projects customized for your needs
🧠 Want to Understand How It Works?
Dive deeper into Pipecat’s architecture and learn how to build custom solutions.Learn Core Concepts
Master pipelines, processors, transports, and context management
Browse Examples
30+ production-ready examples for inspiration