Skip to main content

Prompt Caching Support for custom models (Azure Open AI)

Azure OpenAI GPT-4o currently supports prompt caching.

https://learn.microsoft.com/en-us/azure/ai-services/openai/how-to/prompt-caching

Prompt caching is enabled in Advanced Model Parameters. However, it seems there is no way to enable it in TypingMind for custom models. About This Chat window always displays "(Model does not support prompt caching)" for the custom Azure GPT-4o model.

Please consider adding prompt caching support to custom models

Status: Completed

Log in to comment and vote

No comments yet

Be the first to share your thoughts.