Here we demonstrate more animation results via our framework.
Click to play result from Follow-Your-Click!
"Fire"
"Tune the body"
"Launch down"
"Driving forward"
"Flow"
"Tune the body"
"Shake the body"
"Dancing"
"Running"
"Driving"
"Dancing"
"Running"
"Angry"
"Go forward"
"Running"
"Flying"
"Tune the body"
"driving back"
"Dancing"
"Dancing"
"Shake the body"
"Dancing "
"Ear wiggle"
"Angry"
"Drift"
"Blink"
"Shake the body"
"Sad"
"Astonish"
"Blink"
"Driving back"
"Storm"
"Happy"
"Blink"
"Raise head"
"Swimming"
"Nod"
"Dancing"
"Blink"
"Blink"
"Close the month"
"Shake head"
"The wind is blowing"
"Drift"
"Walking"
Comparisons
Here we demonstrate the animations generated by different methods.
We qualitatively compare our approach with the most recent open-sourced state-of-the-art animation methods,
including Animate anything, SVD, Dynamicrafter and I2VGen-XL. We also compare our approach
with commercial tools such as Gen-2, Genmo, and Pika Labs.
Click to play the following animations!
User Click
Ours
Animate-Anything
Dynamicrafter
Genmo
Gen-2
I2VGen-XL
PikaLabs
SVD
User Click
Ours
Animate-Anything
Dynamicrafter
Genmo
Gen-2
I2VGen-XL
PikaLabs
SVD
Motion Strength Control
Here we demonstrate the comparisons between our optical flow motion magnitude control (OFM) and FPS-based motion magnitude control (FPS).
Click to play the following animations!
User Click
FPS=4
FPS=8
FPS=12
FPS=16
OFC=4
OFC=8
OFC=12
OFC=16
User Click
FPS=4
FPS=8
FPS=12
FPS=16
OFC=4
OFC=8
OFC=12
OFC=16
Ablation Study
Here we demonstrate the qualitative results of ablation the constructed short prompt dataset
(D) and motion-augmented module (M). The motion prompt is “running”.
Click to play the following animations!
User Click
W/o D+M
W/o D
W/o M
Ours
User Click
W/o D+M
W/o D
W/o M
Ours
Limitation
Our approach is limited in generating large and complex human motions,
as shown in the video.This maybe due to the complexity of the action and the rareness of related training samples.
Click to play the following animations!
User Click
Output
Project page template is borrowed from DreamBooth.