Prompt Caching Support for custom models (Azure Open AI)

Azure OpenAI GPT-4o currently supports prompt caching.

https://learn.microsoft.com/en-us/azure/ai-services/openai/how-to/prompt-caching

Prompt caching is enabled in Advanced Model Parameters. However, it seems there is no way to enable it in TypingMind for custom models. About This Chat window always displays "(Model does not support prompt caching)" for the custom Azure GPT-4o model.

Please consider adding prompt caching support to custom models

Please authenticate to join the conversation.

Upvoters
Status

Completed

Board
πŸ’‘

Feature Request

Tags

AI Models

Date

About 1 year ago

Subscribe to post

Get notified by email when there are changes.