Skip to content

Commit a8da604

Browse files
committed
update figures
Signed-off-by: Cody Yu <hao.yu.cody@gmail.com>
1 parent 8b82988 commit a8da604

9 files changed

+4
-0
lines changed
Loading
Loading
Loading
Loading
Loading
Loading
Loading
Loading

docs/source/design/v1/prefix_caching.md

+4
Original file line numberDiff line numberDiff line change
@@ -107,6 +107,10 @@ There are two design points to highlight:
107107

108108
As a result, we will have the following components when the KV cache manager is initialized:
109109

110+
:::{image} /assets/design/v1/prefix_caching/overview.png
111+
:alt: Component Overview
112+
:::
113+
110114
* Block Pool: A list of KVCacheBlock.
111115
* Free Block Queue: Only store the pointers of head and tail blocks for manipulations.
112116
* Cache blocks: Mapping from hash key to block IDs.

0 commit comments

Comments
 (0)