#

multimodal-foundation-model

Here are 4 public repositories matching this topic...

xid32 / NAACL_2025_TWM

We introduce temporal working memory (TWM), which aims to enhance the temporal modeling capabilities of Multimodal foundation models (MFMs). This plug-and-play module can be easily integrated into existing MFMs. With our TWM, nine state-of-the-art models exhibit significant performance improvements across QA, captioning, and retrieval tasks.

question-answering video-captioning working-memory audio-visual-learning video-text-retrieval multimodal-large-language-models multimodal-foundation-model

Updated Jan 26, 2025
Python

TXH-mercury / VAST

[NIPS2023] Code and Model for VAST: A Vision-Audio-Subtitle-Text Omni-Modality Foundation Model and Dataset

dataset vision-language audio-language multimodal-foundation-model cross-modality-pretraining vision-audio-subtitle-text

Updated Mar 14, 2024
Jupyter Notebook

mahmoodlab / MADELEINE

MADELEINE: multi-stain slide representation learning (ECCV'24)

ssl cancer pathology multimodal-foundation-model slide-representation-learning molecular-status-prediction

Updated Feb 18, 2025
Python

MJ-Bench / MJ-Bench

Official implementation for "MJ-Bench: Is Your Multimodal Reward Model Really a Good Judge for Text-to-Image Generation?"

reward-models multimodal-foundation-model llm-benchmarking llm-as-a-judge multimodal-judge

Updated Feb 23, 2025
Jupyter Notebook

Improve this page

Add a description, image, and links to the multimodal-foundation-model topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the multimodal-foundation-model topic, visit your repo's landing page and select "manage topics."