From 3ec97f94e2dd41053a42d2765997fef403649bd7 Mon Sep 17 00:00:00 2001 From: animate3d Date: Thu, 26 Sep 2024 21:56:27 +0800 Subject: [PATCH] update index.html --- index.html | 80 +++++++++++++++++++++++++++++++++++++++++++---- styles/styles.css | 7 +++++ tmp.html | 0 3 files changed, 81 insertions(+), 6 deletions(-) delete mode 100644 tmp.html diff --git a/index.html b/index.html index 4f37903..50a71b5 100644 --- a/index.html +++ b/index.html @@ -19,6 +19,31 @@

Animate3D: Animating Any 3D Model with Multi-view Video Diffusion

+

+ Yanqin Jiang1*, + Chaohui Yu,2* + Chenjie Cao2, + Fan Wang2, + Weiming Hu1, + Jin Gao1 +

+

1CASIA
+ 2DAMO Academy, Alibaba Group

+

NeurIPS 2024

+
@@ -36,13 +61,33 @@

Abstract

Specifically, for MV-VDM, we design a new spatiotemporal attention module to enhance spatial and temporal consistency by integrating 3D and video diffusion models. Additionally, we leverage the static 3D model's multi-view renderings as conditions to preserve its identity. For animating 3D models, an effective two-stage pipeline is proposed: we first reconstruct motions directly from generated multi-view videos, followed by the introduced 4D-SDS to refine both appearance and motion. + Benefiting from accurate motion learning, we could achieve straightforward mesh animation. Qualitative and quantitative experiments demonstrate that Animate3D significantly outperforms previous approaches. Data, code, and models will be open-released.

- + +
+

Video

+
+

The video is best viewed in 4K mode.

+
+
+
+ +
+
+
+ +

Animate Generated 3D Mesh

@@ -69,7 +114,7 @@

Animate Generated 3D Mesh

- +

Animate Reconstructed 3D Model

@@ -95,7 +140,7 @@

Animate Reconstructed 3D Model

- +

Animate Real-world 3D Scan

@@ -121,7 +166,7 @@

Animate Real-world 3D Scan

- +

Animate Generated 3D Model

@@ -149,7 +194,7 @@

Animate Generated 3D Model

- +

Ablation for 4D-SDS

@@ -169,13 +214,36 @@

Ablation for 4D-SDS

+ +
+

Training Data

+
+

+ Our training dataset, MV-Video, comprises 115K animations that are available under a public license, consisting of about 53K animated 3D objects at all, + which are rendered into over 1.8M multi-view videos.
+ Notably, our training data is manually selected and with high-quality. It includes the highest quality part of Objaverse (around 7K animated 3D objects), while the rest (around 46K animated 3D objects) are collected by ourselves. +

+
+
+ + +
+

Relevant Works

+ +

Acknowledgements

Some 3D assets for animation are downloaded from sketchfab, under CC Attribution and CC Attribution-NonCommercial. - We would like to thank the creatorsfor sharing great 3D assets. + We would like to thank the creatorsfor sharing great 3D assets.

diff --git a/styles/styles.css b/styles/styles.css index a212704..d1f5d75 100644 --- a/styles/styles.css +++ b/styles/styles.css @@ -55,6 +55,13 @@ p { margin: 5px 0; } +.accept { + font-size: 1.6rem; + color: #ffffff; + text-align: center; + margin: 5px 0; +} + /* 链接文本的样式 */ .links { text-align: center; diff --git a/tmp.html b/tmp.html deleted file mode 100644 index e69de29..0000000