Override Prompt Caching per model

I would like to override the global settings for models that support prompt caching.

Currently there are no way to disable prompt caching for some models like Gemini, that could be very expensive as it is billed by hour.

Please authenticate to join the conversation.

Upvoters
Status

Open

Board
πŸ’‘

Feature Request

Tags

UXUI Improvement

Date

About 1 year ago

Subscribe to post

Get notified by email when there are changes.