Did you know that you can use a simple sketch or drawing as a guide for your generated images?
With Adobe Firefly's Structure Reference feature that's exactly what you can do.
My name is Rob de Winter, and in the next few minutes, I'll show you how to use the Structure Reference feature in the Text to image module to precisely place objects where you want them and match the outlines and depth of your sketch.
First, go to the Adobe Firefly website, www.firefly.adobe.com
Generating images with text prompts
and click on the Text to image module.
Then enter the prompt night scene of an old fairy tale house with smoking chimney, paved landscape road, mountains with large bright moon in the background.
Then click Generate.
Adobe Firefly will give you four variations based on your prompt.
But now let's generate four new variations based on the structure of a reference image.
First, set Aspect ratio to Landscape and set Content type to Photo.
Applying structure reference using a sketch
Then navigate to the Structure option and upload your sketch.
I created the sketch on my iPad in Adobe Fresco, and now drag the JPEF image into the Reference Structure box.
Use the Strength slider to adjust the degree of similarity
Adjusting strength to control sketch accuracy
to the reference image.
Drag the Strength slider all the way to the right for the greatest possible resemblance.
Because we want the elements in the generated image to be in the same place and follow the outlines and edges of the sketch as much as possible.
Click Generate to create four new variations based on your sketch and your text prompt.
I'm always amazed at how well Firefly recognizes the outlines of a sketch and puts all the elements in the right place.
Comparing results with different strength settings
If you drag the Strength slider more to the left and then regenerate your image, Firefly will have more freedom to deviate from your original image.
I generated this image with the Strength slider dragged to the center, and in this image, I dragged the Strength slider all the way to the left.
Now that you know how to use the Structure Reference feature to generate image variations matching the structure of your drawings or sketches in Adobe Firefly, give it a try with your own images.
Again, my name is Rob de Winter and I look forward to seeing you in the next video.
Note: Stock assets provided are for practice purposes only. See terms.
What you learned
Start with a prompt, then use a sketch as reference
After generating initial image variations with a prompt, upload a sketch to the Structure Reference section. The sketch will guide the overall composition.
Control sketch influence on results
Use the Strength slider to control how closely Firefly matches the sketch. Drag to the right for a precise composition, mimicking outlines and depth; drag to the left for more creative freedom.
You can control how Adobe websites use cookies and similar technologies by making choices below. But note that if you disable cookies and similar technologies entirely, Adobe websites may not function properly.
Cookies are small text files stored by your web browser when you use websites. There are also other technologies that can be used for similar purposes like HTML5 Local Storage and local shared objects, web beacons, and embedded scripts. These technologies help us do things like remembering you and your preferences when you return to our sites, measure how you use the website, conduct market research, and gather information about the ads you see and interact with.
You can make choices in the menu below about what cookies and other technologies you want us to use on Adobe sites when you visit them from this browser. You can always change those choices later by clicking on the Cookie Preferences link at the bottom of the page.
If enabled:
We can improve your experience by tailoring the site and the content to things we think might be of interest
We can better keep track of your preferences — like what language you prefer to use
We will better understand your likely interests so we can provide you more relevant Adobe ads and content on non-Adobe websites and in non-Adobe apps
It will help us improve the performance of our website and those of our partners who use the Adobe Experience Cloud
If disabled:
We won’t be able to remember you from session to session so the experience may not be tailored to your interests
You’ll still have access to the content of the site but certain features that depend on cookies may not function
You’ll still see ads, they just may not be as relevant to you
General information
You can control how Adobe websites use cookies and similar technologies by making choices below. But note that if you disable cookies and similar technologies entirely, Adobe websites may not function properly.
Cookies are small text files stored by your web browser when you use websites. There are also other technologies that can be used for similar purposes like HTML5 Local Storage, web beacons, and embedded scripts. These technologies help us do things like remembering you and your preferences when you return to our sites, measure how you use the website, conduct market research, and gather information about the ads you see and interact with.
You can make choices in the menu below about what cookies and other technologies you want us to use on Adobe sites when you visit them from this browser. You can always change those choices later by clicking on the Cookie Preferences link at the bottom of the page.
If enabled:
We can improve your experience by tailoring the site and the content to things we think might be of interest
We can better keep track of your preferences — like what language you prefer to use
We will better understand your likely interests so we can provide you more relevant Adobe ads and content on non-Adobe websites and in non-Adobe apps
It will help us improve the performance of our website and those of our partners who use the Adobe Experience Cloud
If disabled:
We won’t be able to remember you from session to session so the experience may not be tailored to your interests
We’ll still count your use of our site and services
You’ll still have access to the content of the site but certain features that depend on cookies may not function
You’ll still see ads, they just may not be as relevant to you
Operate the site and core servicesOperate site and measure engagement
Always active
These cookies are required, and they are used to enable the site and related services core functionality. Without them the site could not operate, so they cannot be disabled.
These cookies enable the site and related services’ core functionality and collect statistics about user engagement, such as counting active use to help us understand trends. These cookies cannot be disabled.
Measure performance
These cookies are used to analyze site usage to measure and improve performance. Without them Adobe cannot know what content is most valued and how often unique visitors return to the site, making it hard to improve information we offer to you.
These cookies are used to analyze site usage to measure and improve performance. Without them Adobe cannot know what content is most valued, making it hard to improve information we offer to you.
Extend functionality
These cookies are used to enhance the functionality of Adobe sites such as remembering your settings and preferences to deliver a personalized experience; for example, your username, your repeated visits, preferred language, your country, or any other saved preference.
Personalize advertising
These cookies are used to enable Adobe and our partners to serve ads more relevant to your interests. Without them you will still see ads, but they might not be as relevant to you.
Personalize advertising
These cookies are used to enable Adobe and our partners to serve ads more relevant to your interests. Without them you will still see ads, but they might not be as relevant to you.
