OpenVINO support #186
OpenVINO support #186
Conversation
# Conflicts: # BUILDING.md # Cargo.toml # README.md # src/whisper_ctx.rs # sys/Cargo.toml # sys/build.rs
|
Looks interesting. Does it works seamlessly on macOS/Linux/Windows just like with Vulkan? I'm pretty sure that it requires installing openvino runtime on the target machine. With vulkan it works without since the GPUs drivers comes with the runtime |
|
@tazz4843 LGTM. Do you think it is possible to release a new version on crates.io with this pr merged? |
|
I was going to test this one last time before merging but got stuck into a massive rabbit hole of trying to get OpenVINO on my Framework 16 running Fedora (long story short it turns out OpenVINO is only supported on Fedora 42 which isn't released until April 🥴) I'll test on my Arch desktop when I have more free time unless one of you two would like to test and see if it still works. |
Possible replacement for removed OpenCL support? Looks promising