Interface ContextCacheManager

interface ContextCacheManager {
handleContextCaching(llmRequest: LlmRequest): Promise<CacheMetadata>;
populateCacheMetadataInResponse(llmResponse: LlmResponse, cacheMetadata: CacheMetadata): void;
}

Implemented by

GeminiContextCacheManager

Index

Methods

handleContextCaching populateCacheMetadataInResponse

Methods

handleContextCaching

handleContextCaching(llmRequest): Promise<CacheMetadata>
Parameters
- llmRequest: LlmRequest
Returns Promise<CacheMetadata>
- Defined in packages/adk/src/models/context-cache-manager.ts:30

populateCacheMetadataInResponse

populateCacheMetadataInResponse(llmResponse, cacheMetadata): void
Parameters
- llmResponse: LlmResponse
- cacheMetadata: CacheMetadata
Returns void
- Defined in packages/adk/src/models/context-cache-manager.ts:31