With Firefly Image to video (beta), you can turn an image and a text prompt into visually compelling videos that express creative intent, fill gaps in your timeline or even add elements to an existing shot.
My name is Brian Wood.
I'm a content strategist for the Adobe MAX Creativity Conference.
Let's explore how to use Firefly Image to video (beta) to create part of a short teaser launch video for a project like you see here.
From the Firefly homepage, you can choose Video
Setting up image to video and choosing inputs
and then you can select Image to video (beta) here.
First, I usually set the Aspect ratio of the resulting video.
For instance, if you're creating a video that you want to view on a device, you're probably going to use 9:16, so it's a more vertical orientation.
To create a video based on an image, you can upload any image down here where it says Frame.
I've got a Firefly image I created for a book launch in a previous project, so I'll upload that.
This actually gives Firefly the content for the first frame of the video, so it knows where to start.
You can even upload an image for the last frame.
In other words, what you want the video to end with.
Writing prompts to define video motion and action
In order to create the video action, you're going to enter a Prompt.
It's usually best to start with a simpler Prompt and then iterate on it.
In other words, keep adding to it.
I'll start with something like this, 'zoom into the armoire, plants are growing out of the armoire, birds are flying in scene'.
Then I can Generate.
To be the most effective, your video prompt can include things like shot type description, character, action, location, and even aesthetic.
I've got my video.
I'll play it.
Not quite what I need, so I'm going to make a few changes.
Refining video with camera controls and prompt iteration
Over on the left here we can actually change some of the Camera options if it's available, like Shot size.
What I want to do is I want to make it so that we Zoom in.
I put it in the Prompt, but I'm going to do it over here as well.
And I'm going to start to iterate on the Prompt by adding more and more detail.
I try not to overload it up front and see where it changes.
Using generation history and exporting final video
We also have a Generation history down here, where you can go back in time and start from any previous generation point.
This looks pretty good.
I want to download this and we're going to create a short teaser out of it.
I can actually download it and take it right over to let's say Adobe Premiere or Adobe After Effects and add whatever I need, like maybe title graphics to finish my book launch teaser.
Firefly Image to video (beta) has a lot of great control.
I even went back and added a new first frame image and tweaked the Prompt a little bit to spin the armoire and got something totally different.
And now that you know how to do it, why don't you give it a try?
Make a video for your own launch teaser you come up with.
What you’ll learn
Get started with Image to Video (beta)
Set the basics, like aspect ratio, and use keyframe images for the first and last frames. Then, type a simple prompt to generate your video.
Use effective prompt techniques
Add details like shot aesthetic, location, action, and characters. Include camera perspective, motion, and lens settings for better control. For more tips, search Writing effective text prompts for video generation.
Refine the video output
Set Motion settings to enhance movement — add zoom, tilt, or realistic handheld motion for a more natural feel.
You can control how Adobe websites use cookies and similar technologies by making choices below. But note that if you disable cookies and similar technologies entirely, Adobe websites may not function properly.
Cookies are small text files stored by your web browser when you use websites. There are also other technologies that can be used for similar purposes like HTML5 Local Storage and local shared objects, web beacons, and embedded scripts. These technologies help us do things like remembering you and your preferences when you return to our sites, measure how you use the website, conduct market research, and gather information about the ads you see and interact with.
You can make choices in the menu below about what cookies and other technologies you want us to use on Adobe sites when you visit them from this browser. You can always change those choices later by clicking on the Cookie Preferences link at the bottom of the page.
If enabled:
We can improve your experience by tailoring the site and the content to things we think might be of interest
We can better keep track of your preferences — like what language you prefer to use
We will better understand your likely interests so we can provide you more relevant Adobe ads and content on non-Adobe websites and in non-Adobe apps
It will help us improve the performance of our website and those of our partners who use the Adobe Experience Cloud
If disabled:
We won’t be able to remember you from session to session so the experience may not be tailored to your interests
You’ll still have access to the content of the site but certain features that depend on cookies may not function
You’ll still see ads, they just may not be as relevant to you
General information
You can control how Adobe websites use cookies and similar technologies by making choices below. But note that if you disable cookies and similar technologies entirely, Adobe websites may not function properly.
Cookies are small text files stored by your web browser when you use websites. There are also other technologies that can be used for similar purposes like HTML5 Local Storage, web beacons, and embedded scripts. These technologies help us do things like remembering you and your preferences when you return to our sites, measure how you use the website, conduct market research, and gather information about the ads you see and interact with.
You can make choices in the menu below about what cookies and other technologies you want us to use on Adobe sites when you visit them from this browser. You can always change those choices later by clicking on the Cookie Preferences link at the bottom of the page.
If enabled:
We can improve your experience by tailoring the site and the content to things we think might be of interest
We can better keep track of your preferences — like what language you prefer to use
We will better understand your likely interests so we can provide you more relevant Adobe ads and content on non-Adobe websites and in non-Adobe apps
It will help us improve the performance of our website and those of our partners who use the Adobe Experience Cloud
If disabled:
We won’t be able to remember you from session to session so the experience may not be tailored to your interests
We’ll still count your use of our site and services
You’ll still have access to the content of the site but certain features that depend on cookies may not function
You’ll still see ads, they just may not be as relevant to you
Operate the site and core servicesOperate site and measure engagement
Always active
These cookies are required, and they are used to enable the site and related services core functionality. Without them the site could not operate, so they cannot be disabled.
These cookies enable the site and related services’ core functionality and collect statistics about user engagement, such as counting active use to help us understand trends. These cookies cannot be disabled.
Measure performance
These cookies are used to analyze site usage to measure and improve performance. Without them Adobe cannot know what content is most valued and how often unique visitors return to the site, making it hard to improve information we offer to you.
These cookies are used to analyze site usage to measure and improve performance. Without them Adobe cannot know what content is most valued, making it hard to improve information we offer to you.
Extend functionality
These cookies are used to enhance the functionality of Adobe sites such as remembering your settings and preferences to deliver a personalized experience; for example, your username, your repeated visits, preferred language, your country, or any other saved preference.
Personalize advertising
These cookies are used to enable Adobe and our partners to serve ads more relevant to your interests. Without them you will still see ads, but they might not be as relevant to you.
Personalize advertising
These cookies are used to enable Adobe and our partners to serve ads more relevant to your interests. Without them you will still see ads, but they might not be as relevant to you.
