[ ABORT TO HUD ]
SEQ. 1
SEQ. 2
SEQ. 3

TTL and Cache Economics

🗄️ Context Caching 10m 200 BASE XP

Time-To-Live (TTL)

Caches are not free; you are billed per hour based on the number of tokens stored in the cache. Therefore, you must specify a TTL (Time-To-Live).

If you set a TTL of 60 minutes, the cache will automatically delete itself after an hour. You can update the TTL programmatically if you need to keep the session alive.

SYNAPSE VERIFICATION
QUERY 1 // 1
Why is setting a proper TTL (Time-To-Live) crucial for Context Caching?
Because caches naturally degrade over time
Because you are billed per hour for the tokens stored in the cache
Because the model forgets the cache after 5 minutes
To comply with GDPR
Watch: 139x Rust Speedup
Google Vertex AI Academy | Free Interactive Course | Infinity AI