prompt caching
technique judged 98% likely a named technique or architecture
See how it has spread across media tiers
Mentions over time
Table view
| Week | Articles | Sources |
|---|---|---|
| 2024-W40 | 1 | 1 |
| 2026-W01 | 1 | 1 |
| 2026-W09 | 2 | 1 |
| 2026-W11 | 6 | 1 |
| 2026-W24 | 1 | 1 |
| 2026-W25 | 1 | 1 |
| 2026-W33 | 2 | 2 |
| 2026-W37 | 1 | 1 |
| 2026-W38 | 2 | 2 |
| 2026-W39 | 1 | 1 |
| 2026-W40 | 11 | 2 |
| 2026-W41 | 3 | 1 |
In their words
Prompt caching on Amazon Bedrock can stop working without a single error.
Prompt caching.
Several replies to the original pointed at a third problem: every filtered history is a prompt cache miss.
⚡ Laptop: with the retrieval cache and prompt caching working together on questions that share paragraphs, the model started answering about 10x sooner.
Both had input_tokens and both reported prompt-cache activity.
On DeepSeek V4 Pro the saving was about 2% per session, smaller than ordinary run-to-run variation, because prompt caching had already made the repeated output nearly free.
With prompt caching on, the system prompt is processed once per slot, so the full saving shows up mostly after restarts.
Prompt caching sounds like an obvious win on paper.