Skip to content

add openvino support for igpu acceleation #1768

New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

Closed
jsapede opened this issue Feb 28, 2024 · 2 comments
Closed

add openvino support for igpu acceleation #1768

jsapede opened this issue Feb 28, 2024 · 2 comments
Labels
enhancement New feature or request roadmap

Comments

@jsapede
Copy link

jsapede commented Feb 28, 2024

Is your feature request related to a problem? Please describe.
only SYCL acceleraiton is available but intel CPU, even old (> gen6) includes openvino acceleration witch works pretty well (equivalent to google coral for what i've tested on frigate)

enabling openvino could strongly accelerate models even in old / small / cheap systems, no need for cuda

Describe the solution you'd like
docker images including openvino and /dev/dri/renderD128 passthrough to access igpu

Describe alternatives you've considered

Additional context
buildind accelerated local hosted voice assistants for homeassistant including distil-whisper or whisper.cpp / wyioming protocol

@jsapede jsapede added the enhancement New feature or request label Feb 28, 2024
@mudler mudler added the roadmap label Feb 28, 2024
@mudler
Copy link
Owner

mudler commented Feb 28, 2024

Thanks for showing interest in LocalAI and OpenVINO , I'll close this one as there is already another one already opened here: #1722

@mudler mudler closed this as completed Feb 28, 2024
@jsapede
Copy link
Author

jsapede commented Feb 28, 2024

ok thanks !

# for free to join this conversation on GitHub. Already have an account? # to comment
Labels
enhancement New feature or request roadmap
Projects
None yet
Development

No branches or pull requests

2 participants