Gain precise, element-by-element compositional control of your Image to Video generations using Gen-2's Motion Brush tool.
Getting started
1. Generate a preview image in Text to Video mode or upload your image to Gen-2 Image to Video
Text, Image, and Image + Description prompting modes will all give you access to the Motion Brush tool. For Text mode you first need to generate a preview image and then click "use as input" on the image.
2. Click the Motion Brush icon
It will appear as a small paintbrush to the right of Camera Motion. Once clicked, the tool will open above the input module, in its own editor window.
3. Paint over the part of your image you'd like to add motion to
If you make any mistakes or would like to further refine what's selected, you can switch from brush to eraser using the two buttons at the bottom of your input. Additionally, undo and redo buttons at the top of your input image can provide extra flexibility as you try brushing different elements of your image.
3. Choose your motion modifiers and hit save
With a specific element or area selected, it's now up to you to decide how you want that element or area to move. You can control motion in the horizontal (x), vertical (y), and proximity (z) directions. You can select up to one option from each modifier to create your perfect shot. Additionally, make sure to click save. Clicking out of the Motion Brush window without clicking save will result in your selections being lost.
4. Generate!
With your selections saved, all that's left to do is to sit back and wait for your generation to complete.
Multi Motion Brush
When one motion selection layer isn't enough, Multi Motion Brush introduces a new layer system — you'll be able to select as up to five different portions of your input, and individually define unique motion parameters for each. Follow the below directions to learn how to use Multi Motion Brush.
1. Select the Motion Brush layer you'd like to use
Initiating Multi Motion Brush is as easy as clicking into a new Motion Brush layer. In one generation, you're allowed up to five Motion Brush layers maximum, each with a unique set of parameters. These layers display as Brush 1 (purple), Brush 2 (pink), Brush 3 (green), Brush 4 (blue), and Brush 5 (yellow).
2. Brush over the part of your input you'd like to apply movement to
With your layer selected, you'll now be able to paint that color onto your input to select a movement area. This color will not display in the final render! Rather, it defines the area that your specified movement will apply to.
3. Define the layer's parameters
Back in the side panel, you can now individually define directional motion with four parameters: horizontal (x-axis) movement, vertical (y-axis) movement, proximity (z-axis) movement, and ambient movement. Your choices here will only impact the associated section of the input.
4. Make refinements
If you're unhappy with any portion of your selection, you can use the undo or erase button to further refine the area. Be sure to only click the Clear button if you want to clear all layers.
5. Select another Motion Brush layer, if you'd like
If you have another area you'd like to apply motion to (such as a foreground, background, object, or another figure), click onto a different brush to begin a new layer.
6. Generate!
Click Save, then Generate.
Frequently Asked Questions
Q: Can I use Motion Brush to apply movement to videos that have already generated, or in Gen-1?
A: Unfortunately, Motion Brush currently only works with new inputs, and cannot use previously generated content. Please use a new text or image prompt in Gen-2 to use Motion Brush.