Anthropic last month reduced the TTL (time to live) for the Claude Code prompt cache from one hour to five minutes for many requests, but said this should not increase costs despite users reporting ...
At 100 billion lookups/year, a server tied to Elasticache would spend more than 390 days of time in wasted cache time.