Skip to main content

Search

Creating with Video to Video


Introduction

Gen-3 Alpha is the first of upcoming models that offers improvement in fidelity, consistency, motion and speed over previous generations of models. 

Video to Video allows you to change the style of your videos by using a text prompt.

This article outlines how to use Video to Video on Gen-3 Alpha, the available settings and more.

 

Spec Information

Spec Gen-3 Alpha Gen-3 Alpha Turbo
Cost 5 seconds or less: 50 credits
Longer than 5 seconds: 100 credits
5 seconds or less: 25 credits
Longer than 5 seconds: 50 credits
Supported durations Up to 10 seconds
Explore Mode on Unlimited Plans Yes
Platform availability Web
Supported video inputs See here
Output resolutions 1280x768 1280x768
768x1280
Maximum input size 64mb

 

Step 1 – Selecting the Input Video

Begin by navigating to Generative Video in your Dashboard.

From here, make sure the Gen-3 Alpha or Gen-3 Alpha Turbo model is selected in the top left corner dropdown. 

Select a supported video file from your assets or drag and drop a video to upload it.

You'll be prompted to crop your input video if it is not in a supported resolution. 

Credit notes

When choosing a video, please note that credits are charged based on the length of your input: 

  • ≤ 5 seconds: 50 credits (Gen-3 Alpha), 25 credits (Turbo)
  • > 5 seconds: 100 credits (Gen-3 Alpha), 50 credits (Turbo)

We recommend choosing videos in 5 or 10 second durations for optimized credit usage. Videos longer than 10 seconds will be automatically trimmed to the first 10 seconds of the input.

 

Step 2 – Drafting the Prompt

Video to Video can dramatically change the style of your input with a strong text prompt. A descriptive prompt that focuses on the desired style will provide the best results in most cases.

This tutorial uses an example with a green screen mask, but you can use any type of video input. 

Input Prompt Output
3D halftone CMYK style. halftone print dot. comic book. vibrant colors in layers of cyan blue, yellow, magenta purple, and black circular dots.

Tip: Try out a Custom Preset Screenshot 2024-09-13 at 12.18.02 AM.png to load a curated example prompt. Be sure to replace the purple placeholder text with any customizations you wish to include.

Simple prompts tend to work well, but detailed prompts are more effective and will yield results more closely aligned with the concept you’re envisioning.

 

Step 3 – Configuring the Settings

Video to Video has additional Settings Settings.png that you should review before starting your generation.

Structure transformation

This setting controls the structural consistency between the input and output. Lower values will result in an output that maintains the structure of the original video. Higher values will result in more abstract outputs.

Structure transformation value Output
0
5
10

 

Remove watermark

Checking this box will remove the Runway watermark from your output. Make sure this box is checked to generate without watermarks.

 

Fixed seed

Using a fixed seed will allow you to create similar generations. This is unchecked by default to give you a wide variety of results.

Copy and paste the seed of a previous output if you'd like to receive generations with similar style and movement. Pasting the seed will automatically check the box. 

 

Aspect ratio

On the Turbo model, you'll have the option to choose between a landscape and vertical aspect ratio. 

 

Step 4 – Generating the Video

After drafting your text prompt and configuring your settings, you're now ready to generate your video.

The final result will match the length of the input video if it's 10 seconds or less. For videos longer than 10 seconds, only the first 10 seconds will be used.

Your generations will be scrollable through your session as you continue to generate. You can also access completed videos in your Assets, where they will save to the Generative Video folder by default.