Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Fix the type of
paged_kv_cache
in append (#597)
The type is adjusted to be consistent with the prefill/decode wrappers.
- Loading branch information