[Performance] Enable chunked prefill and prefix caching together (#8120) · Hyper-Accel/vllm@bd852f2 · GitHub

Commit

[Performance] Enable chunked prefill and prefix caching together (vll…

Browse files

…m-project#8120)

Co-authored-by: Tao He <sighingnow@gmail.com>
Co-authored-by: Juelianqvq <Juelianqvq@noreply.github.com>

Loading branch information

3 people authored Sep 3, 2024

1 parent ec26653 commit bd852f2