Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

Error in TensorRT conversion of e5-large model #339

Open
ndeep27 opened this issue Jul 12, 2024 · 1 comment
Open

Error in TensorRT conversion of e5-large model #339

ndeep27 opened this issue Jul 12, 2024 · 1 comment

Comments

@ndeep27
Copy link

ndeep27 commented Jul 12, 2024

I am trying to convert the open source e5-large TF model to TensorRT. This is the model - https://huggingface.co/intfloat/multilingual-e5-large. I am getting below error

[libprotobuf FATAL external/com_google_protobuf/src/google/protobuf/stubs/stringpiece.cc:50] size too big: 18446744071659921560 details: string length exceeds max size

I also tried disabling the graph freezing by setting env var - TF_TRT_EXPERIMENTAL_FEATURES=disable_graph_freezing but I get below error for that

RuntimeError: Not found in the function captures: unknown_390:0

Any pointers on how can I resolve above?

@ndeep27
Copy link
Author

ndeep27 commented Jul 17, 2024

@DEKHTIARJonathan Can you please help with above?

# for free to join this conversation on GitHub. Already have an account? # to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant