> ## Documentation Index
> Fetch the complete documentation index at: https://docs.pipecat.ai/llms.txt
> Use this file to discover all available pages before exploring further.

# SambaNova

> LLM service implementation using SambaNova's API with OpenAI-compatible interface

## Overview

`SambaNovaLLMService` provides access to SambaNova's language models through an OpenAI-compatible interface. It inherits from `OpenAILLMService` and supports streaming responses, function calling, and context management with SambaNova's high-performance inference platform.

<CardGroup cols={2}>
  <Card title="SambaNova LLM API Reference" icon="code" href="https://reference-server.pipecat.ai/en/latest/api/pipecat.services.sambanova.llm.html">
    Pipecat's API methods for SambaNova integration
  </Card>

  <Card title="Example Implementation" icon="play" href="https://github.com/pipecat-ai/pipecat/blob/main/examples/function-calling/function-calling-sambanova.py">
    Complete example with function calling
  </Card>

  <Card title="SambaNova Documentation" icon="book" href="https://docs.sambanova.ai/">
    Official SambaNova API documentation and features
  </Card>

  <Card title="SambaNova Cloud" icon="microphone" href="https://cloud.sambanova.ai/?utm_source=pipecat&utm_medium=external&utm_campaign=cloud_signup">
    Access models and manage API keys
  </Card>
</CardGroup>

## Installation

To use SambaNova services, install the required dependencies:

```bash theme={null}
uv add "pipecat-ai[sambanova]"
```

## Prerequisites

### SambaNova Account Setup

Before using SambaNova LLM services, you need:

1. **SambaNova Account**: Sign up at [SambaNova Cloud](https://cloud.sambanova.ai/?utm_source=pipecat\&utm_medium=external\&utm_campaign=cloud_signup)
2. **API Key**: Generate an API key from your account dashboard
3. **Model Selection**: Choose from available high-performance models

### Required Environment Variables

* `SAMBANOVA_API_KEY`: Your SambaNova API key for authentication

## Configuration

<ParamField path="api_key" type="str" required>
  SambaNova API key for authentication.
</ParamField>

<ParamField path="model" type="str" default="None" deprecated>
  *Deprecated in v0.0.105. Use
  `settings=SambaNovaLLMService.Settings(model=...)` instead.*
</ParamField>

<ParamField path="settings" type="SambaNovaLLMService.Settings" default="None">
  Runtime-configurable settings. See [Settings](#settings) below.
</ParamField>

<ParamField path="base_url" type="str" default="https://api.sambanova.ai/v1">
  Base URL for SambaNova API endpoint.
</ParamField>

### Settings

Runtime-configurable settings passed via the `settings` constructor argument using `SambaNovaLLMService.Settings(...)`. These can be updated mid-conversation with `LLMUpdateSettingsFrame`. See [Service Settings](/pipecat/fundamentals/service-settings) for details.

This service uses the same settings as `OpenAILLMService`. See [OpenAI LLM Settings](/api-reference/server/services/llm/openai#settings) for the full parameter reference.

## Usage

### Basic Setup

```python theme={null}
import os
from pipecat.services.sambanova import SambaNovaLLMService

llm = SambaNovaLLMService(
    api_key=os.getenv("SAMBANOVA_API_KEY"),
    model="Llama-4-Maverick-17B-128E-Instruct",
)
```

### With Custom Settings

```python theme={null}
from pipecat.services.sambanova import SambaNovaLLMService

llm = SambaNovaLLMService(
    api_key=os.getenv("SAMBANOVA_API_KEY"),
    settings=SambaNovaLLMService.Settings(
        model="Llama-4-Maverick-17B-128E-Instruct",
        temperature=0.7,
        top_p=0.9,
        max_tokens=1024,
    ),
)
```

## Notes

* SambaNova does not support `frequency_penalty`, `presence_penalty`, or `seed` parameters.
* SambaNova has custom handling for tool call indexing. The service includes compatibility logic for processing function calls from the SambaNova API.
* SambaNova is known for high-throughput inference on large language models.

<Tip>
  The `InputParams` / `params=` pattern is deprecated as of v0.0.105. Use
  `Settings` / `settings=` instead. See the [Service Settings
  guide](/pipecat/fundamentals/service-settings) for migration details.
</Tip>