Skip to content

[Core][v1] Unify allocating slots in prefill and decode in KV cache manager#12608

Merged
DarkLight1337 merged 8 commits intovllm-project:mainfrom ShawnD200:unify-prefill-and-decodeFeb 2, 2025

Commits

Commits on Jan 29, 2025

Commits on Jan 31, 2025

Commits on Feb 1, 2025