Prompt Caching Support for custom models (Azure Open AI)
Azure OpenAI GPT-4o currently supports prompt caching.
https://learn.microsoft.com/en-us/azure/ai-services/openai/how-to/prompt-caching
Prompt caching is enabled in Advanced Model Parameters. However, it seems there is no way to enable it in TypingMind for custom models. About This Chat window always displays "(Model does not support prompt caching)" for the custom Azure GPT-4o model.
Please consider adding prompt caching support to custom models



Status: Completed
Log in to comment and vote
No comments yet
Be the first to share your thoughts.