Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

Gemma by finding the forward function #95

Open
Tracked by #84
justinchuby opened this issue Jul 17, 2024 · 0 comments
Open
Tracked by #84

Gemma by finding the forward function #95

justinchuby opened this issue Jul 17, 2024 · 0 comments

Comments

@justinchuby
Copy link
Owner

justinchuby commented Jul 17, 2024

Concerning generate, although the code is a bit bloated, it is quite simple, the call is within the sampling while loop here: https://github.com/huggingface/transformers/blob/6c1d0b069de22d7ed8aa83f733c25045eea0585d/src/transformers/generation/utils.py#L2650-L2656

@justinchuby justinchuby mentioned this issue Jul 17, 2024
26 tasks
# for free to join this conversation on GitHub. Already have an account? # to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant