> ## Documentation Index
> Fetch the complete documentation index at: https://docs.pipecat.ai/llms.txt
> Use this file to discover all available pages before exploring further.

# Ollama

> LLM service implementation using Ollama with OpenAI-compatible interface

## Overview

`OLLamaLLMService` provides access to locally-run Ollama models through an OpenAI-compatible interface. It inherits from `BaseOpenAILLMService` and allows you to run various open-source models locally while maintaining compatibility with OpenAI's API format for privacy and cost control.

<CardGroup cols={2}>
  <Card title="Ollama LLM API Reference" icon="code" href="https://reference-server.pipecat.ai/en/latest/api/pipecat.services.ollama.llm.html">
    Pipecat's API methods for Ollama integration
  </Card>

  <Card title="Example Implementation" icon="play" href="https://github.com/pipecat-ai/pipecat/tree/main/examples">
    Browse examples using Ollama models
  </Card>

  <Card title="Ollama Documentation" icon="book" href="https://ollama.com/library">
    Official Ollama documentation and model library
  </Card>

  <Card title="Download Ollama" icon="microphone" href="https://ollama.com/download">
    Download and setup instructions for Ollama
  </Card>
</CardGroup>

## Installation

To use Ollama services, you need to install both Ollama and the Pipecat dependency:

1. **Install Ollama** on your system from [ollama.com/download](https://ollama.com/download)
2. **Install Pipecat dependency**:

```bash theme={null}
uv add "pipecat-ai[ollama]"
```

3. **Pull a model** (first time only):

```bash theme={null}
ollama pull llama2
```

## Prerequisites

### Ollama Local Setup

Before using Ollama LLM services, you need:

1. **Ollama Installation**: Download and install Ollama from [ollama.com](https://ollama.com/download)
2. **Model Selection**: Pull your desired models (llama2, mistral, codellama, etc.)
3. **Local Service**: Ensure Ollama service is running (default port 11434)
4. **Hardware**: Sufficient RAM and storage for your chosen models

### Configuration

* **No API Keys Required**: Ollama runs entirely locally
* **Model Management**: Use `ollama pull <model>` to download models
* **Service URL**: Default is `http://localhost:11434` (configurable)

<Tip>
  Ollama runs as a local service on port 11434. No API key required for complete
  privacy!
</Tip>

## Configuration

<ParamField path="model" type="str" default="None" deprecated>
  The Ollama model to use. Must be pulled locally first with `ollama pull`.

  *Deprecated in v0.0.105. Use `settings=OLLamaLLMService.Settings(model=...)` instead.*
</ParamField>

<ParamField path="settings" type="OLLamaLLMService.Settings" default="None">
  Runtime-configurable settings. See [Settings](#settings) below.
</ParamField>

<ParamField path="base_url" type="str" default="http://localhost:11434/v1">
  Base URL for the Ollama API endpoint.
</ParamField>

### Settings

Runtime-configurable settings passed via the `settings` constructor argument using `OLLamaLLMService.Settings(...)`. These can be updated mid-conversation with `LLMUpdateSettingsFrame`. See [Service Settings](/pipecat/fundamentals/service-settings) for details.

This service uses the same settings as `OpenAILLMService`. See [OpenAI LLM Settings](/api-reference/server/services/llm/openai#settings) for the full parameter reference.

## Usage

### Basic Setup

```python theme={null}
from pipecat.services.ollama import OLLamaLLMService

llm = OLLamaLLMService(
    model="llama2",
)
```

### With Custom Model and URL

```python theme={null}
from pipecat.services.ollama import OLLamaLLMService

llm = OLLamaLLMService(
    model="mistral",
    base_url="http://localhost:11434/v1",
)
```

### With Custom Settings

```python theme={null}
from pipecat.services.ollama import OLLamaLLMService

llm = OLLamaLLMService(
    base_url="http://localhost:11434/v1",
    settings=OLLamaLLMService.Settings(
        model="mistral",
        temperature=0.7,
    ),
)
```

## Notes

* No API key is required. The service automatically uses a placeholder key (`"ollama"`) for OpenAI client compatibility.
* The Ollama service must be running locally before starting your pipeline. Start it with `ollama serve` if it is not already running.
* Model capabilities (function calling, vision, etc.) depend on the specific model you pull. Check the [Ollama model library](https://ollama.com/library) for details.

<Tip>
  The `InputParams` / `params=` pattern is deprecated as of v0.0.105. Use
  `Settings` / `settings=` instead. See the [Service Settings
  guide](/pipecat/fundamentals/service-settings) for migration details.
</Tip>