Adobe Premiere with Firefly

[Deepa Subramaniam] How about we talk video? Yes. [Applause] [Deepa Subramaniam] You have helped make Premiere Pro the standard for professional video, and your feedback continues to make Premiere Pro a fundamentally better application. From Hollywood movies such as this year's Academy Award winner Anora, which was edited with Premiere Pro, to episodic television and streaming shows to marketing and social videos, the demand for high-quality and engaging video is insatiable. The latest version of Premiere Pro is the fastest, snappiest, and most stable version ever, with up to four times faster playback and three times faster exports. We've also been reinventing pro video workflows end-to-end across editing, color, audio and effects to solve real-world workflow problems. And we're leveraging AI where it makes sense, so you can work smarter and have time to explore even more creative options. AI isn't going to do the work for you, but it can help you get through the more tedious parts of your day. So, to show you everything new in Premiere Pro and the power of what you can create when using Premiere and Firefly together, please welcome Kelly Weldon. [Kelly Weldon] All right. [Applause] [Kelly Weldon] What's up, everyone. Welcome back to my channel. Okay, I'm kidding, this isn't my channel, this is Adobe MAX. But I am working on a video here, and I love to start my videos with a little trailer to really capture my audience and get their attention. So, let's jump in and start working on this together. I've got some placeholder clips that I want to replace. Let's start with the beach clip. So, normally I go over here to my bin, open up these clips and scroll through forever trying to find the right thing. That takes ages, right? I've got hundreds of clips in here. Well, it's no longer an issue because new to Premiere Pro is Media Intelligence. So now, when I bring footage into my project, Media Intelligence does an analysis of that footage to understand it, so that I can just search for it using natural language. Let's try something. I'm going to pop open my Search panel here. Let's try sunset.

Amazing, all of my sunset clips right here. But this is a beach clip, so how about water? Again, all of my visuals with water, but not just the visuals, also, whenever I mentioned water in the transcript or in the metadata, but let's get even more specific. I remember I was wearing a brown hat. And this is awesome. It's got all of my clips with the color brown. But narrowing it down further, I was wearing a brown hat, I was on the beach. Perfect. These are exactly the clips I was looking for. So, now I can just double-click, select which bit I want to bring in and then drag and drop it into my project just like that. So, that's Media Intelligence. It just helps me speed up my workflow and find the exact clips I'm looking for by searching for them. Let's keep moving. I want to replace this one with a cinematic aerial drone shot. I love to start my videos that way, but I'll admit, sometimes when it's cold outside, I'll avoid bringing the drone out. I got to protect my fingers, but I think I have a solution. Let's go to the Firefly site. So earlier, you saw Paul using Image to video. I want to try out Text to video. And what's awesome about Text to video is I have so many different options. I can choose from things like Resolution, let's go Shot size, Long shot, Camera angle, and even Camera motion. And I'm also going to add a prompt here because the prompt works in conjunction with those settings. So, I want to see an aerial drone shot over Lake Michigan with some gentle snowfall. Now that takes about 90 seconds. So, I was generating earlier, and I love this clip. This is beautiful. I got that gentle snowfall. So, let's download that and then bring it into our project. Good old drag and drop here, there we go. I'm going to cut this down. And what's great about this is with a few really quick color corrections I can really make this my own. So, let's go over here, I'm going to go to creative here I'm going to add the LUT that I've been using. And then go down to the curves here, make it a little dark and moody. That's my vibe here. I'm sure you can tell. So, I think this is flowing so nicely. Look at that, that's beautiful. And that's because Firefly Video allows me that flexibility to generate B-roll when I just have those gaps in my footage. Let's keep moving here. Now when I'm scrubbing through, I don't know if you all saw this, but I have a pretty big problem here. I've got this beautiful clip of the wind blowing over a frozen lake. But then I did this crazy zoom. I don't know if you guys ever done that. I'm just like, why did I do that to myself. I just want a few more seconds of that nice, still shot. So, what can I do? Well, normally I try to go find a new clip, or maybe find new music, but I don't want to do any of those things. Nobody's got time for that. So, what can I do? I can use Generative extend in 4K right here in Premiere Pro. So, here's what I want to do, I want to clip this, delete that ending, so I never have to see it again. And then go over here to my Toolbar and grab my Gen extend Tool. Now I'm just going to pull those frames out so that Gen extend can recreate that ending for me and give me those still frames, now that takes some time. We all know GenAI takes a little while, so I generated this earlier. Here's my original clip with that deleted ending you can see. Here are my new AI generated frames, let's take a look together. My original and the AI generated frames. How amazing is that? That is so seamless. Yes. Gen extend just saved the day. It's 4K quality, which is perfect for my video, and I can just keep moving with my edit. One more placeholder clip to replace. I want to end this trailer with a beautiful snowy sunset shot. Now, I don't happen to have any footage like that, but over here in Lightroom I've got a bunch of images, and I really love these two. So, what I want to do is create a video that starts with this image and then ends with this one. Wild, I know, but Firefly Video is actually perfect for this. So, back to the Firefly site. I'm going to upload that first image as my first frame and that second image as my last frame. And now this is optional, but I'm going to add a prompt as well because I like to get pretty specific. I want to see the sun setting, the day slowly fading into night, the fog rolling in. Now again that takes a little bit of time. I was generating backstage, let's see what we've got. It's like a timelapse vibe, let's see that fog is rolling in. Let's download that again. And I'm going to drag and drop that into my sequence here, so we can take a look. Look at this. The colors blend perfectly with my previous clip. And that's because Firefly Video allowed me to bring my images to life. So, again, I filled those gaps in my B-roll. This is beautiful. So, now I can just keep moving. This is looking pretty good, as I would say so myself. Let's start to finalize this, I want to add some captions. I love to watch all of my content with the captions on. I know a lot of my subscribers do too. So, let's add some captions. I've got some voiceover here which Premiere automatically transcribed for me. Let me play you a little a preview of that voiceover. [Voiceover] We're Kelly and Nicolai. [Kelly Weldon] There it is, so you can see my transcript. Now all I need to do is go over here to Captions and click Create captions from transcript. Look how fast that was, I couldn't even finish my sentence. It was right there, here are all my captions. I'm going to grab them and just really make them my own. So, let's give them a background color, black, my favorite color. Let's give them a little space here, maybe some rounded corners. And then I'm going to save that style to use again. I like to have the same captions style for all of my videos. That's awesome, quick and easy. I've got captions in English, but I've noticed a lot of my new subscribers are coming from Europe, so France, Germany, Spain, and I think that they deserve to have captions in their languages too. So, we've been listening to your requests, and now right here in Premiere Pro, I can actually translate these captions into other languages. So, let's click this button. Translate your captions is auto detected as English. So, I'm just going to choose which languages I want. We have over 25 different languages here. I'm going to go for French, German and scroll down for Spanish. And then I'll choose that style that I just created and click Translate. Premiere is going to take my transcript and then translate it into those other languages and put them in those caption tracks. That was so fast, let's take a look. We've got English, French, German and Spanish. That was so quick and easy. Now Translate Captions is going to allow me to capture new audiences in just a few seconds. I have captions in four different languages. That's pretty impressive. I won't lie, but what I think would be even cooler is to have translated captions with translated voiceovers. Let me show you something so awesome. Firefly site, this is Translate audio. So, this is where I can actually upload my footage. I don't need to remove the music or anything, and I can translate my actual voiceover into other languages. So, I've uploaded my footage here. You can see my transcription, and I can choose the language languages I want, again. So, let's go to Spanish, French and German and click Generate. You know the drill, that takes some time. So, I clicked Generate backstage and I really want to hear what I sound like in German. I don't speak German, so this is going to be as surprising to me as it is for all of you. You can see my German transcript here, let's listen to this together.

[Voiceover] Wir sind Kelly und Nikolai. Kommen Sie mit uns, wenn wir Ihnen zeigen, was es braucht, um ein Haus von Anfang bis Ende zu bauen. [Kelly Weldon] Oh my gosh, that is so impressive. I simply could not have done this by myself before today. So, I have this awesome trailer in four different languages with captions and audio. In Premiere, I used Gen extend to save the day, Media Intelligence to find the right clips, and I used Firefly Video to generate those gaps in my footage. This is so awesome! It's all available for you to try today on the Firefly site and in Premiere Pro. And now please feel free to like and subscribe. Thank you. [Applause] [Deepa Subramaniam] Thank you, Kelly. That was great! Kelly showed us the power of Media Intelligence and how easy it is to find clips by just describing it in your own words. Even if you have hours and hours of footage. And now with 4K and vertical video support, Generative extend is primed for real production use. It's now generally available in Premiere. And we also saw how Kelly used the creative control of Firefly to generate custom footage, using her own images and description of the shot composition. Along with how easy it is to reach a global audience by localizing her captions into multiple languages directly in Premiere and then translating her voiceover with Firefly's audio and video translation features. All of these new workflows and highly requested improvements are available today in Premiere Pro and Firefly, so go check it out.

Keynote

Adobe Premiere with Firefly - GS1-5

ON DEMAND

Closed captions in English can be accessed in the video player.

Share this page

Speakers

About the Session

Kelly Weldon shows the lastest version of Adobe Premiere, Media Intelligence, and Generative Extend.

Technical Level: General Audience

This content is copyrighted by Adobe Inc. Any recording and posting of this content is strictly prohibited.

Adobe Firefly

Jump-start your genius with Firefly creative AI.

Imagine and then create images, vectors, audio, and videos. Explore and visualize ideas early in the process with Firefly Boards.