Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

[Installation]: cannot install vllm with openvino backend #11398

Closed
1 task done
yuzisun opened this issue Dec 21, 2024 · 3 comments · Fixed by #11458
Closed
1 task done

[Installation]: cannot install vllm with openvino backend #11398

yuzisun opened this issue Dec 21, 2024 · 3 comments · Fixed by #11458
Labels
installation Installation problems

Comments

@yuzisun
Copy link

yuzisun commented Dec 21, 2024

Your current environment

ERROR: Cannot install openvino-tokenizers[transformers]==2024.4.0.0, optimum-intel and vllm==0.6.3.dev100+g15986f59.openvino because these package versions have conflicting dependencies.

The conflict is caused by:
    vllm 0.6.3.dev100+g15986f59.openvino depends on transformers>=4.45.0
    openvino-tokenizers[transformers] 2024.4.0.0 depends on transformers>=4.36.0; extra == "transformers"

How you are installing vllm

git clone https://github.com/vllm-project/vllm.git
cd vllm
pip install -r requirements-build.txt --extra-index-url https://download.pytorch.org/whl/cpu
PIP_EXTRA_INDEX_URL="https://download.pytorch.org/whl/cpu" VLLM_TARGET_DEVICE=openvino python -m pip install -v .
follow the offical step
https://docs.vllm.ai/en/latest/getting_started/openvino-installation.html

Before submitting a new issue...

  • Make sure you already searched for relevant issues, and asked the chatbot living at the bottom right corner of the documentation page, which can answer lots of frequently asked questions.
@yuzisun yuzisun added the installation Installation problems label Dec 21, 2024
@mgoin
Copy link
Member

mgoin commented Dec 21, 2024

Hey @ilya-lavrenov do you know of any recent changes?

@yuzisun
Copy link
Author

yuzisun commented Dec 21, 2024

This was the change from yesterday
https://github.com/huggingface/optimum-intel/pull/1085/files

@ilya-lavrenov
Copy link
Contributor

Fixed in #11458

# for free to join this conversation on GitHub. Already have an account? # to comment
Labels
installation Installation problems
Projects
None yet
Development

Successfully merging a pull request may close this issue.

3 participants