Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

How to support the repetition_penalty parameter? #15

Open
yangbohust opened this issue May 20, 2024 · 0 comments
Open

How to support the repetition_penalty parameter? #15

yangbohust opened this issue May 20, 2024 · 0 comments

Comments

@yangbohust
Copy link

yangbohust commented May 20, 2024

I need to connect the REST scheme with the Transformers library. How can I support repetition_penalty parameter through the logits_processor interface?

https://github.com/huggingface/transformers/blob/481a95781404e48b1c80940be17e8279dec82fe8/src/transformers/generation/utils.py#L1735-L1745

By the way, how to make REST support temperature, top_k, top_p parameters through the logits_warper interface?

Thanks~

# for free to join this conversation on GitHub. Already have an account? # to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant