Skip to main content

Search

Aleph Prompting Guide


 

This feature is currently available to users on a Standard plan or higher.

Introduction

Aleph opens up exciting new possibilities for generative storytelling. This article showcases practical use cases and prompts to help you discover how the model can adapt to your creative needs.

These workflows can often be combined within a single generation, so experiment with different combinations to achieve your vision. This collection represents just the beginning—we're constantly discovering new applications, and we encourage you to use these examples as inspiration for your own explorations.

To learn more about using Aleph, please see the Creating with Aleph guide. 

 

Prompting recommendations

There are no strict rules for prompting with Aleph, but simplicity works best. Effective prompts typically include two key elements: 

  • An action verb that describes what you want to do (such as add, remove, change, replace, re-light, and re-style)
  • A description of your desired transformation

When combined, your prompt may look something like: Change the video so it's underwater

We recommend starting with this straightforward approach and using Chat Mode to iterate and add details as needed.

 

Tip: If you encounter unexpected changes to parts of the video you wanted to preserve, try adding phrases like "keep the lighting the same" or "the background stays unchanged" to your prompt.

Using input images

You can accompany your input video with an image to influence color, styles, lighting, and much more.

When using an image, specify how your image and video inputs should interact. In example, you might try prompts such as:

  • Change the color of the house in the video to the color from the image
  • Re-light the video using the lighting from the image
  • Restyle the video using the 3D animation style from the image

Please note that subjects and objects from images may not be consistent at this time. 

For elements that must remain consistent, we recommend ensuring that they are included in your input video. You can generate consistent subjects and objects in References and then animate the image with Gen-4.

 

Add VFX to shots

Aleph transforms ordinary footage into cinematic moments with professional-grade VFX. Describe what you want to seamlessly integrate it into your shot.

Prompt Input Output
Add ice that starts spreading over the hand
vfxGroup.gif
Change the ball into a glowing lava rock

 

Change seasons and weather

No rain or snow on shoot day? No problem. Aleph instantly transforms any scene's atmosphere by changing seasons and weather conditions. Describe the climate you envision to turn summer footage into winter wonderlands or add dramatic storms to sunny days.

Prompt Input Output
Change the season in the original video to winter. Snow and ice on the road
weatherGroup.gif
Add rain to the scene

 

Control motion with simple animations

Add simple animations over an image for precise control over specific element movement. Describe the motion you want to see to transform still images into dynamic scenes without complex prompting or animation software.

Prompt Input Output
change the cartoon tear into a realistic tear drop
motioncontrol.gif
The dinosaur follows the blue dot with its nose. Remove the blue dot

 

Generate new camera angles

Aleph creates fresh perspectives from your existing footage by generating entirely new camera angles and viewpoints. Describe the shot you need to transform close-ups into wide shots or capture angles that were never filmed.

Prompt Input Output
Change the camera angle to the back of the jazz club, silhouetted people sitting in the foreground
angleGroup.gif
Change the camera angle to be a wide shot of the room the person is in.

 

Predict next shots

Aleph can extend the application of your footage by predicting what happens next in a scene. Describe what happens next to seamlessly generate follow-up moments that feel naturally connected to your original clip.

Prompt Input Output
Predict and visualize the next shot in the sequence
fireworks.gif

 

Relight footage

Aleph transforms the mood and atmosphere of your scenes by completely relighting your footage with professional-grade lighting effects. Describe the lighting setup you want to achieve cinematic looks that would normally require expensive equipment and controlled environments.

Prompt Input Output
Change the lighting so the left side of his face is lit with an orange light. high contrast
relight.gif
Change the scene to use warm, natural lighting

 

Replace objects or subjects

Seamlessly swap out objects or subjects in your footage while maintaining the natural flow and context of the scene. Describe what you want to replace and with what to achieve convincing substitutions that look like they were always part of the original shot.

Prompt Input Output
Change the boxes to ice cubes
changeobjects.gif

 

Remove objects or subjects

Aleph cleanly removes unwanted objects or subjects from your footage, eliminating the need to block off public spaces or control busy sets. Describe what you want to remove to achieve clean, distraction-free shots without the logistical challenges of location management.

Prompt Input Output
Remove the cars from the scene
removal.gif

 

Age or De-age subjects

Transform the apparent age of subjects in your footage with realistic aging and de-aging effects. Describe how you want to age or de-age your subject to achieve convincing time shifts with the click of a button.

Prompt Input Output
Make the man look young
deage.gif

 

Recolor objects 

Aleph changes the color of any object in your footage with precise, natural-looking results that maintain realistic lighting and shadows. Describe the new colors you want to achieve perfect product variations or creative color schemes without reshooting.

Prompt Input Output
Change the white paint of the house to the color of the image.
house3.gif

 

Stylize new scenes using footage

Analyze your existing footage to create entirely new scenes that match the same visual style and aesthetic. Describe the new scene you want to generate fresh content that maintains the consistent look and feel of your original footage.

Prompt Input Output
Using the exact hand drawn sketch art style and animation style as the input video, show me a flower blooming
stylize.gif

 

Remove backgrounds

Aleph cleanly removes backgrounds from your footage, creating professional compositing results without green screens or complex masking.

Prompt Input Output
extract the woman and add her in front of green screen
greenscreen.gif