Skip to content

Support of Llama 3.2 and AutoModelForImageTextToText model class #260

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Closed
wants to merge 9 commits into from
Closed

Support of Llama 3.2 and AutoModelForImageTextToText model class #260

wants to merge 9 commits into from

Conversation

quic-amitraj
Copy link
Contributor

  1. Adding support of class AutoModelForImageTextToText
  2. Adding support of model- meta-llama/Llama-3.2-11B-Vision-Instruct
  3. CLI to handle models with different model classes [WIP]
  4. Test to check qeff model accuracy [WIP]

quic-rishinr and others added 7 commits January 30, 2025 11:11
@quic-rishinr @quic-amitraj
Mllama Vision support (#254)
3f57d3f 
Signed-off-by: Amit Raj <[email protected]>
Signed-off-by: Rishin Raj <[email protected]>
Co-authored-by: Amit Raj <[email protected]>
@quic-rishinr
Compiler command fix
538cc95 
Signed-off-by: Rishin Raj <[email protected]>
@quic-amitraj
Mllama single qpc support added (#258)
8624eec 
1. Mllama single qpc support added
2. Simplified generate inputs for single and dual qpc

---------

Signed-off-by: Amit Raj <[email protected]>
Co-authored-by: asmigosw <[email protected]>
@quic-amitraj
Export fix
294a6fa 
Signed-off-by: Amit Raj <[email protected]>
@quic-amitraj
Generate fix-1
52297c6 
Signed-off-by: Amit Raj <[email protected]>
@quic-amitraj
minor-fix
3cda7ef 
Signed-off-by: Amit Raj <[email protected]>
@quic-amitraj
Model swap fix at the time of export and compile
48dfa58 
Signed-off-by: Amit Raj <[email protected]>
@quic-amitraj quic-amitraj marked this pull request as draft February 5, 2025 16:55
@ochougul
Copy link
Contributor

Closing as it is addressed in #267

@ochougul ochougul closed this Feb 13, 2025
@ochougul ochougul deleted the mllama_vision branch February 13, 2025 09:32
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@quic-rishinr quic-rishinr Awaiting requested review from quic-rishinr quic-rishinr is a code owner

@ochougul ochougul Awaiting requested review from ochougul ochougul is a code owner

Assignees

@quic-amitraj quic-amitraj

@quic-rishinr quic-rishinr

Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
3 participants
@quic-amitraj @ochougul @quic-rishinr