Is the WAN Animate version included in Mega version 11?

#174
by okims - opened

Is the WAN Animate version included in Mega version 11?

No Wan Animate weights in the recipe, there's Wan 2.2 VACE Low instead

Wan Animate is its own model... which makes me wonder... can I add VACE to it and make it a super mega merge, so it can do T2V/I2V/Animate/first->last frame all in one model? It also is just 1 model (no "high" and "low", which means no breaking it up....). It probably won't work.

But I'm going to try.

OK, so Wan Animate doesn't work like that.

BUT.

You can load in a "control video" in WAN VaceToVideo with a low strength (say 0.5 or something, please experiment) and it will do "video to video" which is very powerful, with Mega v11 right now.

You can load in a "control video" in WAN VaceToVideo with a low strength (say 0.5 or something, please experiment) and it will do "video to video" which is very powerful, with Mega v11 right now.

I tried this and it works well, thanks! Is there a way to have the control video guide an object from another image, though? What I did so far is Load Video (Upload) -> control_video, but connecting Load Image -> reference_image just places the image in the first frame or so of the video. Any ideas would be much appreciated!

You can load in a "control video" in WAN VaceToVideo with a low strength (say 0.5 or something, please experiment) and it will do "video to video" which is very powerful, with Mega v11 right now.

I tried this and it works well, thanks! Is there a way to have the control video guide an object from another image, though? What I did so far is Load Video (Upload) -> control_video, but connecting Load Image -> reference_image just places the image in the first frame or so of the video. Any ideas would be much appreciated!

I haven't had much luck with this, though. What I really want, and what I think you are asking for, is an "image to view" + "control motion". I haven't found a solution that serves both... I've been experimenting with using the first frame of a "control" video, using Qwen Image Edit to add in my objects/characters over it, then trying to prompt the motion using that image output as the first frame. Mixed results. Unfortunately it obviously can't take the motion from the whole control video. If someone else finds a solution, please share!

Sign up or log in to comment