Inference on LLaVA-Llama-3-8B-v1.1

[flab305]

I am new to the LLaVA framework. I have a dataset of image-text pair classified into 2 classes. Using inference on the trained LLaVA-Llama, I want to get classification on my dataset, i.e. given text and image, classify into one of two labels.

Is there a way to do so? like an inbuilt function or adding MLP head over (after fine-tuning)?