Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

Support concat of clip outputs for longer prompt #48

Open
wants to merge 1 commit into
base: main
Choose a base branch
from

Conversation

KohakuBlueleaf
Copy link

@KohakuBlueleaf KohakuBlueleaf commented Jul 11, 2024

wd14 tagger usually give us 77~152 tokens prompt.
But current implementation only supports 77 token length.

I try to implement an adaptive implementation which can output longer prompt when needed.
I'm not sure if this implementation is ok but it works well for me.

Some concerns:

  1. Should I drop/mask all the padding tokens?
  2. Should max length be an user option?

# for free to join this conversation on GitHub. Already have an account? # to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant