Skip to content

Support of Llama 3.2 and AutoModelForImageTextToText model class #260

New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

#

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

Jump to bottom
Closed
wants to merge 9 commits into from
Closed

Support of Llama 3.2 and AutoModelForImageTextToText model class #260

wants to merge 9 commits into from

Conversation

quic-amitraj
Copy link
Contributor

  1. Adding support of class AutoModelForImageTextToText
  2. Adding support of model- meta-llama/Llama-3.2-11B-Vision-Instruct
  3. CLI to handle models with different model classes [WIP]
  4. Test to check qeff model accuracy [WIP]

quic-rishinr and others added 7 commits January 30, 2025 11:11
@quic-rishinr @quic-amitraj
Mllama Vision support (#254)
3f57d3f 
Signed-off-by: Amit Raj <quic_amitraj@quicinc.com>
Signed-off-by: Rishin Raj <quic_rishinr@quicinc.com>
Co-authored-by: Amit Raj <quic_amitraj@quicinc.com>
@quic-rishinr
Compiler command fix
538cc95 
Signed-off-by: Rishin Raj <quic_rishinr@quicinc.com>
@quic-amitraj
Mllama single qpc support added (#258)
8624eec 
1. Mllama single qpc support added
2. Simplified generate inputs for single and dual qpc

---------

Signed-off-by: Amit Raj <quic_amitraj@quicinc.com>
Co-authored-by: asmigosw <asmigosw@qti.qualcomm.com>
@quic-amitraj
Export fix
294a6fa 
Signed-off-by: Amit Raj <quic_amitraj@quicinc.com>
@quic-amitraj
Generate fix-1
52297c6 
Signed-off-by: Amit Raj <quic_amitraj@quicinc.com>
@quic-amitraj
minor-fix
3cda7ef 
Signed-off-by: Amit Raj <quic_amitraj@quicinc.com>
@quic-amitraj
Model swap fix at the time of export and compile
48dfa58 
Signed-off-by: Amit Raj <quic_amitraj@quicinc.com>
@quic-amitraj quic-amitraj marked this pull request as draft February 5, 2025 16:55
quic-rishinr and others added 2 commits February 6, 2025 07:08
@quic-rishinr
Revert "Model swap fix at the time of export and compile"
00eb6eb 
This reverts commit 48dfa58.
@ochougul
fixed tests
781ffbf 
Signed-off-by: Onkar Chougule <quic_ochougul@quicinc.com>
@ochougul
Copy link
Contributor

Closing as it is addressed in #267

@ochougul ochougul closed this Feb 13, 2025
@ochougul ochougul deleted the mllama_vision branch February 13, 2025 09:32
# for free to join this conversation on GitHub. Already have an account? # to comment
Reviewers

@quic-rishinr quic-rishinr Awaiting requested review from quic-rishinr quic-rishinr is a code owner

@ochougul ochougul Awaiting requested review from ochougul ochougul is a code owner

Assignees

@quic-amitraj quic-amitraj

@quic-rishinr quic-rishinr

Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
3 participants
@quic-amitraj @ochougul @quic-rishinr