Repositories list

• MakeAnything

  Public
  Official code of "MakeAnything: Harnessing Diffusion Transformers for Multi-Domain Procedural Sequence Generation"

  Python

  •

  MIT License

  •2•45•0•0•Updated Feb 10, 2025Feb 10, 2025

• Show-o

  Public
  [ICLR 2025] Repository for Show-o, One Single Transformer to Unify Multimodal Understanding and Generation.

  multimodaldiffusion-modelslarge-language-models

  Python

  •

  Apache License 2.0

  •50•1.2k•36•1•Updated Feb 10, 2025Feb 10, 2025

• Awesome-Video-Diffusion

  Public
  A curated list of recent diffusion models for video generation, editing, restoration, understanding, etc.

  awesomevideo-editingvideo-understanding+ 5video-generationdiffusion-modelstext-to-videovideo-restorationtext-to-motion

  222•3.9k•1•0•Updated Feb 10, 2025Feb 10, 2025

• computer_use_ootb

  Public
  Out-of-the-box (OOTB) GUI Agent for Windows and macOS

  Python

  •

  Apache License 2.0

  •117•1.2k•32•6•Updated Feb 8, 2025Feb 8, 2025

• DiffSim

  Public
  Official repository of DiffSim: Taming Diffusion Models for Evaluating Visual Similarity

  Python

  •0•10•0•0•Updated Feb 8, 2025Feb 8, 2025

• LayerTracer

  Public
  Official code of "LayerTracer: Cognitive-Aligned Layered SVG Synthesis via Diffusion Transformer"

  Python

  •

  MIT License

  •2•20•1•0•Updated Feb 8, 2025Feb 8, 2025

• ShowUI

  Public
  Open-source, End-to-end, Vision-Language-Action model for GUI Agent & Computer Use.

  agentvision-language-modelvision-language-action+ 2computer-usegui-agent

  Jupyter Notebook

  •

  Apache License 2.0

  •52•924•2•0•Updated Feb 8, 2025Feb 8, 2025

• Awesome-Robotics-Diffusion

  Public
  (In progress) A curated list of recent robot learning papers incorporating diffusion models for robotics tasks.

  1•29•0•0•Updated Feb 7, 2025Feb 7, 2025

• Awesome-GUI-Agent

  Public
  💻 A curated list of papers and resources for multi-modal Graphical User Interface (GUI) agents.

  awesomegraphical-user-interfaceai-assistant+ 2llm-agentgui-agents

  30•472•0•0•Updated Jan 28, 2025Jan 28, 2025

• Awesome-Unified-Multimodal-Models

  Public
  📖 This is a repository for organizing papers, codes and other resources related to unified multimodal models.

  16•359•0•0•Updated Jan 18, 2025Jan 18, 2025

• MovieSeq

  Public
  [ECCV2024] Learning Video Context as Interleaved Multimodal Sequences

  Jupyter Notebook

  •1•35•0•0•Updated Jan 18, 2025Jan 18, 2025

• FQGAN

  Public
  FQGAN: Factorized Visual Tokenization and Generation

  Python

  •

  Other

  •0•41•0•0•Updated Jan 5, 2025Jan 5, 2025

• Tune-An-Ellipse

  Public
  [CVPR 2024] Tune-An-Ellipse: CLIP Has Potential to Find What You Want

  Python

  •1•9•2•0•Updated Jan 5, 2025Jan 5, 2025

• VideoLISA

  Public
  [NeurlPS 2024] One Token to Seg Them All: Language Instructed Reasoning Segmentation in Videos

  Python

  •

  Apache License 2.0

  •3•102•9•0•Updated Dec 26, 2024Dec 26, 2024

• MovieBench

  Public
  Python

  •1•38•0•0•Updated Dec 24, 2024Dec 24, 2024

• Awesome-MLLM-Hallucination

  Public
  📖 A curated list of resources dedicated to hallucination of multimodal large language models (MLLM).

  20•574•1•0•Updated Dec 23, 2024Dec 23, 2024

• IDProtector

  Public
  The code implementation of **IDProtector: An Adversarial Noise Encoder to Protect Against ID-Preserving Image Generation**.

  0•7•0•0•Updated Dec 16, 2024Dec 16, 2024

• ROICtrl

  Public
  Code for ROICtrl: Boosting Instance Control for Visual Generation

  Python

  •0•100•1•0•Updated Dec 10, 2024Dec 10, 2024

• videogui

  Public
  [NeurIPS2024] VideoGUI: A Benchmark for GUI Automation from Instructional Videos

  guivideo-languagellm-agent

  JavaScript

  •1•28•0•0•Updated Dec 10, 2024Dec 10, 2024

• VideoSwap

  Public
  Code for [CVPR 2024] VideoSwap: Customized Video Subject Swapping with Interactive Semantic Point Correspondence

  Python

  •15•374•4•0•Updated Dec 6, 2024Dec 6, 2024

• Show-1

  Public
  [IJCV] Show-1: Marrying Pixel and Latent Diffusion Models for Text-to-Video Generation

  Python

  •

  Other

  •61•980•9•7•Updated Nov 15, 2024Nov 15, 2024

• BoxDiff

  Public
  [ICCV 2023] BoxDiff: Text-to-Image Synthesis with Training-Free Box-Constrained Diffusion

  text-to-image-synthesisdiffusion-models

  Python

  •18•257•7•0•Updated Nov 12, 2024Nov 12, 2024

• sparseformer

  Public
  (ICLR 2024, CVPR 2024) SparseFormer

  computer-visiontransformerefficient-neural-networks+ 2vision-transformersparseformer

  Python

  •

  MIT License

  •2•70•1•0•Updated Nov 10, 2024Nov 10, 2024

• LOVA3

  Public
  (NeurIPS 2024) Learning to Visual Question Answering, Asking and Assessment

  benchmarkvisual-question-answeringmultimodal-deep-learning+ 3visual-question-generationmultimodal-large-language-modelsdata-asse

  Python

  •2•71•0•0•Updated Nov 7, 2024Nov 7, 2024

• VisInContext

  Public
  Official implementation of Leveraging Visual Tokens for Extended Text Contexts in Multi-Modal Learning

  efficientin-context-learningllm+ 1mllm

  Python

  •2•14•1•0•Updated Oct 30, 2024Oct 30, 2024

• Exo2Ego-V

  Public
  0•10•1•0•Updated Oct 29, 2024Oct 29, 2024

• watermark-steganalysis

  Public
  Python

  •1•4•0•0•Updated Oct 24, 2024Oct 24, 2024

• EvolveDirector

  Public
  [NeurIPS 2024] EvolveDirector: Approaching Advanced Text-to-Image Generation with Large Vision-Language Models.

  Python

  •0•45•0•0•Updated Oct 14, 2024Oct 14, 2024

• GUI-Narrator

  Public
  Repository of GUI Action Narrator

  JavaScript

  •0•5•0•0•Updated Sep 22, 2024Sep 22, 2024

• RingID

  Public
  Python

  •0•24•1•0•Updated Aug 30, 2024Aug 30, 2024