Caching

A section of the "LLMs in production" topic. The questions check an understanding of practice, not memory of specific library APIs. After each answer comes a review: why the correct option is right, what is wrong with each incorrect one and which chapter to read.

Quiz difficulty Formats: several correct options, one correct option

Quiz 8.3CachingStart Practice or a ranked attempt — you choose after clicking.
  1. Exact caching
  2. A leak through the cache
  3. A semantic cache
  4. A client-side and a server-side cache
  5. Why cache at all
  6. Total savings from optimizations