-
Notifications
You must be signed in to change notification settings - Fork 6.5k
New issue
Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? # to your account
Refactor hub interface for batched inference #1539
Conversation
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Thanks!
One concern is that this will break the API for non-batched inputs. We have a few tutorials around that rely on this, so we should add some backward compatibility. I'll take care of this before merging.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
@myleott has imported this pull request. If you are a Facebook employee, you can view this diff on Phabricator.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
@myleott has imported this pull request. If you are a Facebook employee, you can view this diff on Phabricator.
Summary: # Before submitting - [x] Was this discussed/approved via a Github issue? (no need for typos, doc improvements) - [x] Did you read the [contributor guideline](https://github.com/pytorch/fairseq/blob/master/CONTRIBUTING.md)? - [x] Did you make sure to update the docs? - [] Did you write any new necessary tests? ## What does this PR do? Fixes #1508. Pull Request resolved: #1539 Pulled By: myleott Differential Revision: D19216104 fbshipit-source-id: 14917c1459b8794eeb74c09a16b9899c366242d2
…acebookresearch#1539) Summary: # Before submitting - [x] Was this discussed/approved via a Github issue? (no need for typos, doc improvements) - [x] Did you read the [contributor guideline](https://github.com/pytorch/fairseq/blob/master/CONTRIBUTING.md)? - [x] Did you make sure to update the docs? - [] Did you write any new necessary tests? ## What does this PR do? Fixes facebookresearch#1508. Pull Request resolved: facebookresearch#1539 Pulled By: myleott Differential Revision: D19216104 fbshipit-source-id: 14917c1459b8794eeb74c09a16b9899c366242d2
Summary: # Before submitting - [x] Was this discussed/approved via a Github issue? (no need for typos, doc improvements) - [x] Did you read the [contributor guideline](https://github.com/pytorch/fairseq/blob/master/CONTRIBUTING.md)? - [x] Did you make sure to update the docs? - [] Did you write any new necessary tests? ## What does this PR do? Fixes facebookresearch/fairseq#1508. Pull Request resolved: facebookresearch/fairseq#1539 Pulled By: myleott Differential Revision: D19216104 fbshipit-source-id: 14917c1459b8794eeb74c09a16b9899c366242d2
Summary: # Before submitting - [x] Was this discussed/approved via a Github issue? (no need for typos, doc improvements) - [x] Did you read the [contributor guideline](https://github.com/pytorch/fairseq/blob/master/CONTRIBUTING.md)? - [x] Did you make sure to update the docs? - [] Did you write any new necessary tests? ## What does this PR do? Fixes facebookresearch/fairseq#1508. Pull Request resolved: facebookresearch/fairseq#1539 Pulled By: myleott Differential Revision: D19216104 fbshipit-source-id: 14917c1459b8794eeb74c09a16b9899c366242d2
Before submitting
What does this PR do?
Fixes #1508.