[Performance] Enable chunked prefill and prefix caching together (#8120) · compressa-ai/vllm@78bac9f · GitHub

Commit

[Performance] Enable chunked prefill and prefix caching together (vll…

Browse files

…m-project#8120)

Co-authored-by: Tao He <sighingnow@gmail.com>
Co-authored-by: Juelianqvq <Juelianqvq@noreply.github.com>
Signed-off-by: Alvant <alvasian@yandex.ru>

Loading branch information

3 people authored and Alvant committed Oct 26, 2024

1 parent 02a82e2 commit 78bac9f