Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

#

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

Jump to bottom

engine: Intel OpenVino #677

Closed
Tracked by #470
freelerobot opened this issue Jun 11, 2024 · 2 comments
Closed
Tracked by #470

engine: Intel OpenVino #677

freelerobot opened this issue Jun 11, 2024 · 2 comments
Assignees
@freelerobot
Labels
type: feature request A new feature

Comments

@freelerobot
Copy link
Contributor

freelerobot commented Jun 11, 2024 •
edited by dan-menlo
Loading

Goal

  • Intel is launching their Lunar Lake chips, which have an iGPU (67 TOPs), NPU (48 TOPs)
  • Intel recommends OpenVINO, which takes full advantage of their Lunar Lake chips

Key Decisions
@freelerobot freelerobot added P3: nice to have Nice to have feature type: feature request A new feature labels Jun 11, 2024
@freelerobot freelerobot mentioned this issue Jul 1, 2024
Open
3 tasks
@imtuyethan imtuyethan moved this to Icebox in Menlo Aug 28, 2024
@imtuyethan imtuyethan removed the P3: nice to have Nice to have feature label Aug 28, 2024
@imtuyethan imtuyethan moved this from Icebox to Planning in Menlo Sep 2, 2024
@dan-menlo dan-menlo changed the title feat: support Intel OpenVino engine: Intel OpenVino Sep 6, 2024
@dan-menlo dan-menlo moved this from Planning to Icebox in Menlo Sep 6, 2024
@dan-menlo
Copy link
Contributor

Closing in favor of #470

@github-project-automation github-project-automation bot moved this from Icebox to Completed in Menlo Sep 8, 2024
@RyanMetcalfeInt8
Copy link

Just to point out that this is very much related to this issue: menloresearch/jan#3764

The engine that I am working / testing on uses OpenVINO GenAI framework as an inference engine (i.e. swaps out llama.cpp for OpenVINO GenAI).

# for free to join this conversation on GitHub. Already have an account? # to comment
Assignees

@freelerobot freelerobot

Labels
type: feature request A new feature
Projects
Menlo
Archived in project
Milestone
No milestone
Development

No branches or pull requests
5 participants
@vansangpfiev @freelerobot @imtuyethan @dan-menlo @RyanMetcalfeInt8