AI and LLMs · Junior · Question 50 of 75
What does prompt caching help with?
- 1Reusing a repeated long prefix to cut cost and latency
- 2Storing user passwords securely in the prompt
- 3Saving every answer so the model never runs twice
Show the answer
Correct answer: Reusing a repeated long prefix to cut cost and latency
Explanation
If many requests share the same system prompt or documents, the provider can cache that prefix and charge less for it.