Introduction
Kling 3.0 Motion Control is a third-party model available in Runway that animates a still image using motion from a reference video. The model transfers full-body movement, hand gestures, and facial expressions from the reference video to the character in your image while preserving their visual identity.
This article covers how to access the tool, input best practices, available settings, and what to expect from your generations.
Spec information
| Minimum duration | 3 seconds | |
| Maximum duration *dependent upon orientation mode | Image Orientation — 10 seconds | |
| Aspect ratios | 16:9, 9:16, 1:1 | |
Performance video | Character image | |
| Maximum file size | ≤ 100 MB | ≤ 10 MB |
| Support video types | .mp4, .mov | .jpg, .jpeg, .png |
| Dimension requirements | > 340px | > 340px |
Step 1 — Selecting the Inputs
Kling 3.0 Motion Control accepts two required inputs and one optional input:
Performance video (required)
The motion reference video drives the animation. The model extracts movement, gestures, and expressions from this video and transfers them to your character image.
Click the dropdown below for best practices:
Performance video requirements
- Character should show clear upper body or full body including all limbs and head, avoid occlusion
- Recommend uploading single-person action video; for 2+ people, actions will be taken from the character with largest screen proportion
- Recommend using real person actions; some stylized characters/humanoid body proportions may work
- Video should be single continuous shot with character always visible, avoid cuts or camera movements (will be truncated otherwise)
- Avoid overly fast actions; relatively stable actions produce better results
Character image (required)
The character image is the still image that will be animated. The model uses this image to determine the subject's appearance, which it preserves throughout the generated video.
Click the dropdown below for best practices:
Character image requirements
- Character proportions should match the reference motion as much as possible-- avoid driving half-body characters with full-body motions
- Character should show clear upper body or full body including limbs and head, avoid occlusion
- Avoid extreme orientations (upside down, lying flat, etc.). Character should occupy sufficient screen area
Text prompt (optional)
In Kling 3.0 Motion Control, the text prompt is used to guide elements of the generation that are otherwise not captured in your performance video or character image.
The text prompt may control camera and background motion, character features, and more. Below are examples of generations without and with text prompts:
| Performance video | Character image | Text prompt | Result |
| None | |||
| the goblin has glowing red eyes. | |||
| The camera pulls back as he creeps closer |
Step 2 — Configuring the settings
Resolution
The Kling 3.0 Motion Control model allows for configuring a resolution of 720p or 1080p.
Character Orientation
Found by clicking the Advanced Settings ( icon, the Character Orientation setting controls how the character's facing direction is determined in the output.
- Selecting Video will use the body orientation of your performance video
- Selecting Image will use the body orientation of the input character image
These two options also have unique maximum duration limits:
- Video: 30 second maximum
- Image: 10 second maximum
In the examples below, our video uses a profile orientation that captures them from the side, while the image is forward-facing. Since the angles from the two inputs are different, we observe noticeable changes when switching between Video and Image for this setting:
| Performance video | Character image | Orientation | Result |
Image | |||
Video |
Original Sound
Original Sound controls whether the audio from your performance video is retained in the generated clip. When disabled, the clip will have no audio.
Step 3 — Generating the video
Once you've confirmed the settings, click the Generate button to begin the generation. The processing duration will vary based on the length of the performance video.
Iterating and troubleshooting
In the event of generation errors, ensure that your inputs follow best practices and comply with the file requirements outlined in the spec table.
If you receive unwanted motion, review your text prompt (if entered) and confirm the Character orientation setting is configured appropriately for your ideal result.