Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

#

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

Jump to bottom

Expected all tensors to be on the same device #2

Open
zeinabfarhoudi opened this issue Sep 24, 2023 · 0 comments
Open

Expected all tensors to be on the same device #2

zeinabfarhoudi opened this issue Sep 24, 2023 · 0 comments

Comments

@zeinabfarhoudi
Copy link

zeinabfarhoudi commented Sep 24, 2023 •
edited
Loading

When I run transllm, I face this error:

RuntimeError: Expected all tensors to be on the same device, but found at least two devices, cuda:0 and cpu! (when checking argument for argument index in method wrapper_CUDA__index_select).

I set the device_map with the default value: "auto"
Thanks for your help.
# for free to join this conversation on GitHub. Already have an account? # to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@zeinabfarhoudi