Ben Kaluza - AI Tutorials — How To Turn a Storyboard into a Video using GPT & Seedance 2.0.
Source: YouTube Channel: Ben Kaluza - AI Tutorials (4140 subs) Duration: 8:12 Views: 21441 · Likes: 969 Video: Watch on YouTube
In this video I show you how to generate a storyboard using GPT Image 2.0 and then turn this into a video using Seedance 2.0.
This is a really fun and easy way to generate videos.
@BenKaluza
https://www.instagram.com/benkaluza https://www.instagram.com/benkaluza.tech https://www.instagram.com/benkaluza.lab
https://www.tiktok.com/@benkaluza https://www.tiktok.com/@benkaluza.tech https://www.tiktok.com/@benkaluza.lab
Business Enquires:
Key Insights
In this video, I’m going to show you how to create a storyboard like this with GPT image 2.0 and then take this image and turn it into a video like this using Seed Art 2.0. Right, so this is actually really easy and and fun to do. And so first we’re going to go into creating the prompt here. So I’m just in chat GPT here. And we’ve got generate me a prompt for a 4 * 4 storyboard, 16 frames total, clean layout with thin black border separating each frame. So basically this is describing what I want in terms of the layout and format. And then below here I’ve got Asian girl tattoo artist wearing her latest gloves preparing her tattoo colors and stuff like this and getting started with a tattoo on a huge bald man on his back and the design of the tattoo is black and red samurai. Style is inspired by Arcane. So you really yeah, you can do anything you want with this prompt. Like I don’t want you to like think that you need like some super complex prompt for this. You don’t because this will be what this produces. So yeah, start with the format, then the idea, and then the style. You could start with the the style or the idea and then the format. It really it really does not matter, right? So once we’ve got that, right? This is going to generate the image prompt for us. And it should be fairly long and it should should detail out all of like the frames in the storyboard. Right, so here is the prompt that it’s produced. Again, we’ve just got yeah, explaining what we want. I think for the actual the tattoo one I did a 3 by 4 storyboard, but again doesn’t matter. And what we want to do is just take this prompt. We want to put it into here and we just want it to create a image. We want it in a 1 by 1. Again, doesn’t matter too much. We could go 16 by 9, 1 by 1. And then now this should create the image for the storyboard which we put into Seed Art. Right, so here is the storyboard that it’s generated as in 4 by 4. This will vary each time, but as you can see it’s kind of followed the general guidance of the the prompt here. This is the original one that I generated was this one. This is actually 3 by 4. But, if we look at them, you know, we’ve got preparing the gloves, putting in the ink, putting the paper on the back of the tattoo, drawing the tattoo. You know, very similar to here, just slightly different style. So, again, you can just generate these all day long until you get what you want. Maybe you like you want to change one part of the storyboard, you’re not quite happy with it. Um you can go back and forth here, you know, that’s the great thing about it is that we’re just trying to get to a a storyboard essentially that just has some sort of sequence that the video model can follow. I’m going to go through some different examples that I generated with my editors. And so, just looking now how this was actually created. So, I’m going to show you just in Artlist here. So, all I’m really doing is I’m going to click on generate video here. But, what I’m doing is I’m using Seedance 2.0 and I’m uploading a image reference. So, I’m going to upload the storyboard as an image reference in here. And all you really need to say is like, “Use uh image one as a storyboard to generate a sequence of videos adhering to the images and text and style.” Like, honestly, it really doesn’t matter. Like, if you just tell it to just make a video based on the storyboard, it it just does it and it will just work, to be honest. And I find that when you do them, it generates like each generation is different. Everyone knows that when when it when you’ve got like a like a multi you know, sequence video, I found that while it follows the general guidance of the storyboard, everyone is kind of different. And so, just looking at actually the the video generations that I did, I find that like sometimes each generation is different and it actually sometimes is better to just if you generate multiple of the same storyboard, to kind of like cherry-pick different of t
Transcript continues…