Speculative decoding #267

New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

#

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

Jump to bottom

Closed

yunfeng-scale opened this issue Sep 8, 2023 · 1 comment

Contributor

yunfeng-scale commented Sep 8, 2023

Currently on roadmap of vLLM and TGI

Contributor Author

yunfeng-scale commented Sep 24, 2024

vLLM already implemented

yunfeng-scale closed this as completed

# for free to join this conversation on GitHub. Already have an account? # to comment