Documentation Index
Fetch the complete documentation index at: https://docs.pipecat.ai/llms.txt
Use this file to discover all available pages before exploring further.
Overview
Filter Incomplete Turns is an LLM-powered feature that detects when a user’s conversational turn was incomplete (they were cut off or need time to think) and suppresses the bot’s response accordingly. Instead of responding to partial input, the bot waits for the user to continue, then automatically re-engages if they remain silent. This creates more natural conversations by:- Preventing the bot from responding to incomplete thoughts
- Giving users time to finish speaking without interruption
- Automatically prompting users to continue after pauses
How It Works
When enabled, the LLM outputs a turn completion marker as the first character of every response:| Marker | Meaning | Bot Behavior |
|---|---|---|
✓ | Complete - User finished their thought | Respond normally |
○ | Incomplete Short - User was cut off mid-sentence | Suppress response, wait 5s, then prompt |
◐ | Incomplete Long - User needs time to think | Suppress response, wait 10s, then prompt |
- Injects turn completion instructions into the LLM’s system prompt
- Detects markers in the LLM’s streaming response
- Suppresses bot speech for incomplete turns
- Starts a timeout based on the incomplete type
- Re-prompts the LLM when the timeout expires
The public
on_user_turn_stopped
event fires only after the LLM confirms the turn is complete (✓). The
detector that ends speech (e.g. smart turn) instead fires
on_user_turn_inference_triggered,
which kicks LLM inference. Observers, transcript appenders, and UI indicators
that should react to a finalized turn stay quiet on ○ / ◐ markers.Configuration
Enable the feature by passingFilterIncompleteUserTurnStrategies as the user_turn_strategies on LLMUserAggregatorParams when creating an LLMContextAggregatorPair:
FilterIncompleteUserTurnStrategies
FilterIncompleteUserTurnStrategies is a UserTurnStrategies specialization. It keeps your detector chain (the defaults, or any strategies you pass via start/stop) for triggering LLM inference, and appends an LLMTurnCompletionUserTurnStopStrategy that gates the public on_user_turn_stopped event on the LLM’s ✓ verdict. The detector stop strategies are wrapped with deferred(...) automatically, so they trigger inference but leave turn finalization to the LLM gate.
Optional configuration object for customizing turn completion behavior
(instructions, incomplete-turn timeouts, and re-prompts). If not provided,
default values are used.
Start strategies for detecting when the user begins speaking. Defaults to the
standard start strategies.
Detector stop strategies that trigger LLM inference. They are wrapped with
deferred(...) automatically and the LLM gate is appended as the finalizer.
Defaults to AI-powered smart turn detection.Deprecated parameters
The followingLLMUserAggregatorParams fields predate FilterIncompleteUserTurnStrategies. They still work for one release — setting either auto-translates to FilterIncompleteUserTurnStrategies and emits a DeprecationWarning — but new code should configure the feature via user_turn_strategies instead.
Enable LLM-based turn completion detection. When
True, the system
automatically appends turn completion instructions to the LLM’s system prompt
and configures the LLM service to process turn markers. Deprecated in v1.2.0.
Use user_turn_strategies=FilterIncompleteUserTurnStrategies() instead. Will
be removed in v2.0.0.Optional configuration object for customizing turn completion behavior. If not
provided, default values are used. Deprecated in v1.2.0. Pass the config
directly to
FilterIncompleteUserTurnStrategies(config=...) instead. Will be
removed in v2.0.0.UserTurnCompletionConfig
UseUserTurnCompletionConfig to customize timeouts, prompts, and instructions. Pass it to FilterIncompleteUserTurnStrategies via config:
Parameters
Seconds to wait after detecting
○ (incomplete short) before re-prompting the
LLM. Use shorter values for more responsive re-engagement.Seconds to wait after detecting
◐ (incomplete long) before re-prompting the
LLM. Use longer values to give users more time to think.System prompt sent to the LLM when the short timeout expires. Should instruct
the LLM to generate a brief, natural prompt encouraging the user to continue.
System prompt sent to the LLM when the long timeout expires. Should instruct
the LLM to generate a friendly check-in message.
Complete turn completion instructions appended to the system prompt. Override
this to customize how the LLM determines turn completeness.
Markers Explained
Complete (✓)
The user has provided enough information for a meaningful response:✓ marker tells the system to push the response normally. The marker itself is persisted to the conversation context (so the LLM stays consistent on later turns) but is not spoken or included in transcripts.
Incomplete Short (○)
The user was cut off mid-sentence and will likely continue soon:○ marker suppresses the bot’s response entirely. After 5 seconds (configurable), the LLM is prompted to re-engage with something like “Go ahead, I’m listening.”
Incomplete Long (◐)
The user needs more time to think or explicitly asked for time:◐ marker also suppresses the response, but waits 10 seconds (configurable) before prompting. This handles cases like:
- “Hold on a second”
- “Let me think about that”
- “Hmm, that’s interesting…”
Usage Examples
Basic Usage
Enable turn completion with default settings:You don’t need to modify your system prompt. Turn completion instructions are
automatically appended when
FilterIncompleteUserTurnStrategies is
configured.Custom Timeouts
Adjust timeouts for your use case:Custom Prompts
Customize what the LLM says when re-engaging:With Smart Turn Detection
Combine with smart turn detection for better end-of-turn detection: Smart turn detection is the default detector chain, soFilterIncompleteUserTurnStrategies() already uses it. To configure the analyzer explicitly, pass it as a stop strategy — it’s wrapped as an inference trigger automatically:
Transcripts
Turn completion markers are automatically stripped from assistant transcripts emitted via theon_assistant_turn_stopped event. Your transcript handlers will receive clean text without markers:
Supported LLM Services
Turn completion detection works with any LLM service that inherits fromLLMService:
- OpenAI (
OpenAILLMService) - Anthropic (
AnthropicLLMService) - Google Gemini (
GoogleLLMService) - AWS Bedrock (
AWSLLMService) - And other compatible services
Graceful Degradation
If the LLM fails to output a turn marker:- The system logs a warning indicating markers were expected but not found
- The buffered text is pushed normally to avoid losing the response
- The conversation continues without interruption
Related
- User Turn Strategies - Configure turn detection
- Smart Turn Detection - AI-powered end-of-turn detection
- Transcriptions - Working with conversation transcripts