streamline the fine-tuning process for multimodal models: PaliGemma, Florence-2, and Qwen2-VL

A collection of guides and examples for the Gemma open models from Google.

MLX-VLM is a package for running Vision LLMs locally on your Mac using MLX.

Testing and evaluating the capabilities of Vision-Language models (PaliGemma) in performing computer vision tasks such as object detection and segmentation.

使用LLaMA-Factory微调多模态大语言模型的示例代码 Demo of Finetuning Multimodal LLM with LLaMA-Factory

Use PaliGemma to auto-label data for use in training fine-tuned vision models.

vision language models finetuning notebooks & use cases (paligemma - florence .....)

PaliGemma FineTuning

PaliGemma Inference and Fine Tuning

Notes for the Vision Language Model implementation by Umar Jamil

Fine Tuning PaliGemma

Using PaliGemma with 🤗 transformers

Fine tunned PaliGemma vision-language models using the ScienceQA dataset for visual question answering.