Configuration for context caching across all agents in an app.
This configuration enables and controls context caching behavior for
all LLM agents in an app. When this config is present on an app, context
caching is enabled for all agents. When absent (null), context caching
is disabled.
Context caching can significantly reduce costs and improve response times
by reusing previously processed context across multiple requests.
Configuration for context caching across all agents in an app.
This configuration enables and controls context caching behavior for all LLM agents in an app. When this config is present on an app, context caching is enabled for all agents. When absent (null), context caching is disabled.
Context caching can significantly reduce costs and improve response times by reusing previously processed context across multiple requests.