Requesting this feature, cache pings like Aider does, Aider saves me a TON of money with this method, please implement it.
"Preventing cache expiration
Aider can ping the provider to keep your prompt cache warm and prevent it from expiring. By default, Anthropic keeps your cache for 5 minutes. Use --cache-keepalive-pings N to tell aider to ping every 5 minutes to keep the cache warm. Aider will ping up to N times over a period of N*5 minutes after each message you send."
Please authenticate to join the conversation.
Open
Feature Request
AI Models
Over 1 year ago
Get notified by email when there are changes.
Open
Feature Request
AI Models
Over 1 year ago
Get notified by email when there are changes.