Large Language Model service implementation using Azure OpenAI API
AzureLLMService
provides access to Azure OpenAI’s language models through an OpenAI-compatible interface. It inherits from OpenAILLMService
and supports streaming responses, function calling, and context management.
AZURE_CHATGPT_API_KEY
- Your Azure OpenAI API keyAZURE_CHATGPT_ENDPOINT
- Your Azure OpenAI endpoint URLAZURE_CHATGPT_MODEL
- Your model deployment nameOpenAILLMContextFrame
- Conversation context and historyLLMMessagesFrame
- Direct message listVisionImageRawFrame
- Images for vision processingLLMUpdateSettingsFrame
- Runtime parameter updatesLLMFullResponseStartFrame
/ LLMFullResponseEndFrame
- Response boundariesLLMTextFrame
- Streamed completion chunksFunctionCallInProgressFrame
/ FunctionCallResultFrame
- Function call lifecycleErrorFrame
- API or processing errorsFeature | Azure OpenAI | Standard OpenAI |
---|---|---|
Authentication | API key + endpoint | API key only |
Deployment | Custom deployment names | Model names directly |
Compliance | Enterprise SOC, HIPAA | Standard compliance |
Regional | Multiple Azure regions | OpenAI regions only |
Pricing | Azure billing integration | OpenAI billing |