Caching

Domain: MLOps

🎯 Motivation

Storing recent results so identical requests do not need to be re-processed. Much faster for repeated queries.

πŸ“‹ Concrete Example

Cache: user asks β€˜What is Python?’ Model answers. Another user asks the same. Return cached answer instantly. No re-processing needed.

πŸ”— Analogy

A shortcut on your desk - the document you use most often is on your desk (cache), not in the filing cabinet. Instant access. Caching stores frequent results.