Azure OpenAI GPT-4o currently supports prompt caching.
https://learn.microsoft.com/en-us/azure/ai-services/openai/how-to/prompt-caching
Prompt caching is enabled in Advanced Model Parameters. However, it seems there is no way to enable it in TypingMind for custom models. About This Chat window always displays "(Model does not support prompt caching)" for the custom Azure GPT-4o model.
Please consider adding prompt caching support to custom models



Please authenticate to join the conversation.
Completed
Feature Request
AI Models
About 1 year ago
Get notified by email when there are changes.
Completed
Feature Request
AI Models
About 1 year ago
Get notified by email when there are changes.