Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

#

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

Jump to bottom

model.generate(input_ids=...) support #481

Closed
borzunov opened this issue Aug 26, 2023 · 1 comment
Closed

model.generate(input_ids=...) support #481

borzunov opened this issue Aug 26, 2023 · 1 comment

Comments

@borzunov
Copy link
Collaborator

HF transformers support both inputs and input_ids, while Petals only supports inputs (I didn't know there's an alias). Still, the code with input_ids is common among some examples, e.g., in https://huggingface.co/stabilityai/StableBeluga2
@borzunov borzunov changed the title .generate(input_ids=...) support model.generate(input_ids=...) support Aug 26, 2023
@borzunov
Copy link
Collaborator Author

Fixed in #485.

# for free to join this conversation on GitHub. Already have an account? # to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@borzunov