🦦 Otter, a multi-modal model based on OpenFlamingo (open-sourced version of DeepMind's Flamingo), trained on MIMIC-IT and showcasing improved instruction-following and in-context learning ability.

A library for differentiable nonlinear optimization

SAPIEN Manipulation Skill Framework, an open source GPU parallelized robotics simulator and benchmark, led by Hillbot, Inc.

[CVPR 25 Highlight & ECCV Workshop 24 Best Paper] RoboTwin Dual-arm Robot Manipulation Simulation Platform

Unified Reinforcement Learning Framework

[CVPR 2024 Highlight] GenAD: Generalized Predictive Model for Autonomous Driving & Foundation Models in Autonomous System

VoxPoser: Composable 3D Value Maps for Robotic Manipulation with Language Models

🤖 The Full Process Python Package for Robot Learning from Demonstration and Robot Manipulation

🏘️ Scaling Embodied AI by Procedurally Generating Interactive 3D Houses

Open Platform for Embodied Agents

RAI is an agentic framework for robotics, utilizing Langchain and ROS 2 tools to perform complex actions, defined scenarios, free interface execution, log summaries, voice interaction and more.

[TPAMI 2024] Official repo of "ETPNav: Evolving Topological Planning for Vision-Language Navigation in Continuous Environments"

A Foundational Vision-Language-Action Model for Synergizing Cognition and Action in Robotic Manipulation

[ICCV 2023} Official repo of "BEVBert: Multimodal Map Pre-training for Language-guided Navigation"

[CVPR 2025] RoboBrain: A Unified Brain Model for Robotic Manipulation from Abstract to Concrete. Official Repository.

[CVPR 2024] The code for paper 'Towards Learning a Generalist Model for Embodied Navigation'

[CVPR 2025] The offical Implementation of "Universal Actions for Enhanced Embodied Foundation Models"

[ICLR 2025] SPA: 3D Spatial-Awareness Enables Effective Embodied Representation

Official Github repository for "Renderable Neural Radiance Map for Visual Navigation‬". (CVPR 2023 Highlight)

Large-scale photo-realistic virtual worlds for embodied AI