Skip to content
This repository has been archived by the owner on Mar 1, 2022. It is now read-only.

How does fitbert handle answers that have multiple tokens? #22

Closed
mannt-jp opened this issue Jul 3, 2021 · 1 comment
Closed

How does fitbert handle answers that have multiple tokens? #22

mannt-jp opened this issue Jul 3, 2021 · 1 comment

Comments

@mannt-jp
Copy link

mannt-jp commented Jul 3, 2021

If the answer contains multiple tokens (for example containing multiple words, or even a whole sentence), how does fitbert compute the cummulative probability of this kind of answer. Because MLM outputs the probabilities for every single tokens, not for groups of tokens.
@sam-writer
Copy link
Contributor

I would use BART for this, see #19 (comment)

# for free to subscribe to this conversation on GitHub. Already have an account? #.
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@sam-writer @mannt-jp