Sarvam AI LLM

Overview

SarvamLLMService provides chat completion capabilities using Sarvam’s API with OpenAI-compatible interface. It supports streaming responses, function calling, and Sarvam-specific features like wiki grounding and configurable reasoning effort levels.

Sarvam LLM API Reference

Pipecat’s API methods for Sarvam integration

Example Implementation

Function calling example with Sarvam

Sarvam Documentation

Official Sarvam documentation

Sarvam Platform

Access models and manage API keys

Installation

To use Sarvam LLM services, install the required dependencies:

uv add "pipecat-ai[sarvam]"

Prerequisites

Sarvam Account Setup

Before using Sarvam LLM services, you need:

Sarvam Account: Sign up at Sarvam
API Key: Generate an API key from your account dashboard
Model: The service supports deepseekv4.1-flash, gemma4, glm5.3, sarvam-105b, and sarvam-105b-conversations models

Required Environment Variables

SARVAM_API_KEY: Your Sarvam API key for authentication

Configuration

str

required

Sarvam API key used for both OpenAI auth and Sarvam subscription header. Raises ValueError when empty.

str | None

default:"None"

Sarvam OpenAI-compatible base URL. When None, resolved from the model at construction: /v1 for sarvam-105b-conversations, /v2 for all other models. Changing model at runtime does not change the endpoint. Override if using a different endpoint.

SarvamLLMService.Settings

default:"None"

Runtime-configurable model settings. See Settings below.

Mapping[str, str]

default:"None"

Additional HTTP headers to include in every request.

Settings

Runtime-configurable settings passed via the settings constructor argument using SarvamLLMService.Settings(...). These can be updated mid-conversation with LLMUpdateSettingsFrame. See Service Settings for details.

Parameter	Type	Default	Description
`model`	`str`	`"sarvam-105b"`	Sarvam model identifier. Supported models: `deepseekv4.1-flash`, `gemma4`, `glm5.3`, `sarvam-105b`, `sarvam-105b-conversations`. Raises `ValueError` at construction for any other model.
`system_instruction`	`str`	`None`	System instruction/prompt for the model.
`wiki_grounding`	`bool`	`None`	Enable or disable wiki grounding feature. Sarvam-specific parameter. `None` omits it from the request.
`reasoning_effort`	`Literal["low", "medium", "high"]`	`None`	Set reasoning effort level. Sarvam-specific parameter. `None` omits it from the request.
`temperature`	`float`	`NOT_GIVEN`	Sampling temperature (0.0 to 2.0). Lower values are more focused, higher values are more creative.
`max_tokens`	`int`	`NOT_GIVEN`	Maximum tokens to generate.
`max_completion_tokens`	`int`	`NOT_GIVEN`	Not sent by this service, so it has no effect. Use `max_tokens`.
`top_p`	`float`	`NOT_GIVEN`	Top-p (nucleus) sampling (0.0 to 1.0). Controls diversity of output.
`frequency_penalty`	`float`	`NOT_GIVEN`	Penalty for frequent tokens (-2.0 to 2.0). Positive values discourage repetition.
`presence_penalty`	`float`	`NOT_GIVEN`	Penalty for new topics (-2.0 to 2.0). Positive values encourage the model to talk about new topics.
`seed`	`int`	`NOT_GIVEN`	Random seed for deterministic outputs.
`top_k`	`int`	`None`	Not sent by this service, so it has no effect.

NOT_GIVEN values are omitted from the API request entirely, letting the Sarvam API use its own defaults. This is different from None, which would be sent explicitly.

Usage

Basic Setup

import os
from pipecat.services.sarvam.llm import SarvamLLMService

llm = SarvamLLMService(
    api_key=os.getenv("SARVAM_API_KEY"),
)

With Custom Settings

import os
from pipecat.services.sarvam.llm import SarvamLLMService

llm = SarvamLLMService(
    api_key=os.getenv("SARVAM_API_KEY"),
    settings=SarvamLLMService.Settings(
        model="sarvam-105b",
        temperature=0.7,
        max_tokens=1000,
        wiki_grounding=True,
        reasoning_effort="high",
    ),
)

Updating Settings at Runtime

Model settings can be changed mid-conversation using LLMUpdateSettingsFrame:

from pipecat.frames.frames import LLMUpdateSettingsFrame
from pipecat.services.sarvam.llm import SarvamLLMSettings

await worker.queue_frame(
    LLMUpdateSettingsFrame(
        delta=SarvamLLMSettings(
            temperature=0.3,
            reasoning_effort="medium",
        )
    )
)

Notes

OpenAI Compatibility: Sarvam’s API is OpenAI-compatible, allowing use of familiar patterns and parameters.
Model-Specific Capabilities: A request that uses a capability the model lacks is not sent; the service pushes an ErrorFrame instead.
- Vision: Only gemma4 supports image input via inline data-URI images.
- Reasoning: deepseekv4.1-flash, gemma4, glm5.3, and sarvam-105b support the reasoning_effort parameter. sarvam-105b-conversations does not.
- Wiki Grounding: gemma4 and sarvam-105b support the wiki_grounding parameter.
Function Calling: Supports OpenAI-style tool/function calling format. A request with tool_choice and no non-empty tools list is not sent; the service pushes an ErrorFrame instead.
Unsupported Parameters: Some OpenAI parameters are not supported by Sarvam’s API and are automatically removed from requests: stream_options and service_tier.

Event Handlers

SarvamLLMService supports the following event handlers, inherited from LLMService:

Event	Description
`on_completion_timeout`	Called when an LLM completion request times out
`on_function_calls_started`	Called when function calls are received and execution is about to start
`on_function_calls_cancelled`	Called after one or more in-progress function calls are cancelled

@llm.event_handler("on_completion_timeout")
async def on_completion_timeout(service):
    print("LLM completion timed out")

Get Started

Pipecat Server

Client SDKs

Pipecat Flows

Pipecat Cloud

CLI

Pipecat Context Hub

Overview

Sarvam LLM API Reference

Example Implementation

Sarvam Documentation

Sarvam Platform

Installation

Prerequisites

Sarvam Account Setup

Required Environment Variables

Configuration

Settings

Usage

Basic Setup

With Custom Settings

Updating Settings at Runtime

Notes

Event Handlers

​Overview

Sarvam LLM API Reference

Example Implementation

Sarvam Documentation

Sarvam Platform

​Installation

​Prerequisites

​Sarvam Account Setup

​Required Environment Variables

​Configuration

​Settings

​Usage

​Basic Setup

​With Custom Settings

​Updating Settings at Runtime

​Notes

​Event Handlers

Overview

Installation

Prerequisites

Sarvam Account Setup

Required Environment Variables

Configuration

Settings

Usage

Basic Setup

With Custom Settings

Updating Settings at Runtime

Notes

Event Handlers