Dreambooth local training has finally been implemented into Automatic 1111’s Stable Diffusion repository, meaning that you can now use this amazing Google’s AI technology to train a stable diffusion model with your own images. You can train a character, an object, a style, or anything you want! There is also a new option that allows you to use Dreambooth training with the CPU instead of the GPU, all of that for FREE in only a few minutes! So in this video, I will show you how to activate this Stable Diffusion extension, how you can get the best results and also give you a few troubleshooting advices for those of you that have trouble with it. What a time to be alive!
Hello humans my name is overload and Finally my brothers Rejoice because Finally this is the day we finally have A dream Booth training in stable Diffusion no need for Google call up Docs or GPU ranking you can train your Own images locally without leaving Stable diffusion and that is absolutely Fantastic are you ready let’s go alright So before we begin we need to make sure That you are using the latest version of Stable diffusion so for this you have Two solution either you come here and You click on your photo URL and you type CMD and you press enter here in the Command prompt window you’re gonna type Get pull and press enter and we saw Update your stable diffusion folder the Second option is to right click on the Web UI user.bot file click on edit with Notepad and here right above called Web Ui.bat you’re gonna type git pull and Then You’re Gonna Save the file this way Each time you launch table diffusion it Will automatically update the folder and Then you can launch stable diffusion now Before we begin I think it’s important For me to tell you that if you do have a Very a weak GPU this is probably not Gonna work for you obviously and to be Able to run this correctly you need at Least 12 gigabytes of vram and even with 12 gigabytes is probably not going to be Enough if you want to have all the bells
And whistles so unless you have a very Very powerful GPU this is probably not For you now as some of you know I also Don’t have a very powerful GPU since I Have a 1080 with only 10 gigabytes of Vram so to show me how this entire thing Work I will basically be simulating a Local environment using run pod so the Entire training will actually be done by A very powerful GPU but don’t worry the Same exact steps will still apply to you If you do have a GPU that can handle This kind of operation okay so now to Active in Dreamboat you’re gonna click Here on the extensions tab you’re gonna Click here on available click on this Button right here load from and you’re Gonna see a bunch of options right here Also if you’re interested in a separate Video where I show you an explain what Are the best extensions available for a Stable diffusion you can let me know in The comments down below but today the Extensions that we want is right here The dreambooth one also if you click Here you can arrive on the GitHub Repository also if you have any issue With the dreamboof extension you can Come here and search if other people Didn’t have the same problem as you Which is probably the best way to solve Your problem as fast as possible so to Install this extension you’re gonna Click on this button right here and
Click on install and then click on this Button right here that says apply and Restart UI and as you can see we have Now a brand new dreambooth tab also if This doesn’t work for you I highly Suggest that you actually restart Completely stable diffusion because Sometimes not all the requirements are Installed correctly also if you relaunch Stable diffusion and you see the same Right here this basically means that you Need to install stable diffusion in a Folder that doesn’t have any spaces as You can see right here I have a folder That’s called super stable diffusion 2.0 That has basically two spaces right here Now in my case I don’t really care since I will not be using my PC to do the Training but if you do plan on using This extension this is something that You need to keep in mind so then once You are inside the dreambooth tab we’re Gonna start by creating an empty model Now we need to create an empty model Before we actually start the training Now I know this might be a little Confusing which is why I named this Extension super stable confusion because Yesterday I actually spent an entire day Trying to make this work until finally Succeeding so this really took me a lot Of time but I did it so you don’t have To now the training that I will be doing Today is again with the renera actress
And the reason why I’m doing this is Because since I’ve done this training Multiple times with different dream Booth options I know what kind of Results I can actually expect from this So here you’re gonna start by creating a Name for your model so in my case I Decided to call it renira ddim SSC DCIM For the scheduler that we’re going to be Using an ssce for super stable confusion Here you’re going to select the source To your checkpoint you can either choose The 1.4 version or the 1.5 so for this I Will be using the simple 1.5 version and Here for the scheduler I highly suggest That you choose ddim this is the one That creates the best results and then You can click on the button create and There you go after around one or two Minutes your empty model is finally Created and now you can click on the Train model Tab and here you’re gonna See a bunch of options now I know this Might sound a little complicated but This is actually not that difficult Because there is only a few options that You really need to change now here the Concept list this is something that you Don’t want to choose because for this You need to create a separate Json file But we don’t need this because we’re Gonna start completing the rest of the Options so here the instance prompt this Is basically a short description of your
Subject using a unique keyword and and Also the name of a class so if you’ve Done previous Dreamboat training before You know that we need to use a certain Keyword for the model to activate and You will usually use the name of your Character for this so in my case it will Simply be using the name of my model so Renera ddim SSC and also the name of my Class and if you remember my previous Dreamboof video we know that we usually Use the class person also if we take a Look at our sample images we see that This is basically a photo of renera this Is a photo of a character this is a Photo of a person which is why here for The instance prompt we’re simply going To describe what our sample images look Like so in my case my images are simply A photo of character name person so if For example you want to train it on your Dog for example for the instance prop You will probably use photo of name of Your dog dog instead of person and of Course you can use this for objects in The style too so instead of using person You can use objects you can use style And you can use anything that you want As long as this represents the class of Your subject so the class prompt is very Similar to the instance prompt but here We just don’t use the name of the Character we simply input what our Subject actually is so in my case this
Is simply photo of a person simple as That so again if you want to use a dog For example if you want to train a dog You would simply use here photo of a dog So just replace person by the class of Your subject here the data set directory Is the folder of where your simple Images are located so for me my images Are right here so I’m just gonna Ctrl C Ctrl V so the classification data set Directory this is where you would put The regularization images now I know This is optional but I highly suggest That you actually use it because if you Do use these regularization images that Means the that you do activate the prior Preservation option which is essential If you want to have the best results so For me my regularization images are Right here and will also leave a link in The description down below where you can Download this entire folder these are Again the same 1500 images from the Joe Pena repository that we use the in the First dream book video so I’m just gonna Come here copy the folder URL and paste It right here total number of Classification images to use so as I Said we have here 1500 images now if you Don’t want to download these images you Can actually input an empty folder and Here you can input the number of images That you want stable the fusion to Create on the spot before it starts the
Training and usually the best number That you want is at least 10 times the Amount of sample images that you have so Let’s say you have 20 sample images the Total number of classification images That you want to create should be at Least 200. now I would personally Suggest just download these images this Way you don’t have to waste time trying To create hundreds of images from Scratch I mean why waste time when Everything is already done for you now Here we have finally the training steps And the learning rate these are one of The most important options right here And you should definitely change this Because the default ones are absolutely Terrible they do not work well with each Other so for this you have basically two Options either you keep a Higher Learning rate in a low training steps or You keep a high training steps and a low Learning rate otherwise you’re gonna end Up over training your model and you’re Not gonna have the results that you want Now what I personally recommend you to Do which is basically how I got the best Results myself is basically a low Learning rate of one exponent -6 which Basically means five zeros right here And a training step between 1100 and 1200 these are the options that I Recommend you to keep deep to really get The best results out of your training
Now in my case just for fun I’m just Gonna put 11 11. it should be more than Enough then the batch size in class Batch size you don’t want to touch that You leave this at default same Resolution now here for the save a Checkpoint every end steps and generate A preview image every end steps you Absolutely need to change these two Values because as of right now this is Completely broken if you leave it like That you will actually never finish and You will always get an error during Training so what we recommend you to do For the save a checkpoint every end Steps you’re gonna input a value that is Higher than your training steps so in my Case since my training steps is 11 11 You can simply put 5000 here and 5000 Here this way this option will never Activate so then you can scroll down and Leave everything by default you don’t Need to touch anything then you’re gonna Click on this Arrow right here that says Advanced and here you’re also gonna have A bunch of options now here surprising Enough you actually have an option to Train using your CPU but I’m gonna tell You right now never use this option this Is completely useless this is only for Fun and Giggles because you don’t want To spend 20 30 hours waiting for your Training to be over this is absolutely Not worth it so basically here the only
Options that you really need to change Is right here use 8bit To decrease the amount of vram that it Will use at the cost of speed and here For mixed Precision you need to change It to fe16 this is the only option that You need to change everything else you Need to leave by default because all These options right here are checked so That you actually use less vram at the Cost of speed which is obviously what You want and if you actually don’t leave This checked even a 24 gigabyte SV card Will not be enough and again all the Oceans that we see right here you need To leave them by default and once you Are done once you have completed Everything do not forget to come right Here and select your model so for me It’s runera ddim SSC and then once You’re ready you can click on this Button right here to start the training And there you go for me the training has Finally finished as I said I’m currently Running this on run pod and with a 3090 11 training steps actually took me less Than 15 minutes which is actually super Super fast and then once the training System complete the finished model Should actually be in the folders models Stable diffusion and your finished Trained model should be right here and For the model to appear correctly in Stable diffusion you can click on this
Button right here to refresh the list And then you can select your finished Model that is ready to be used and as an Example to prove that it worked I’m just Gonna put a prompt right here so close The portrait of Arena ddim SSC person as You remember these are the two words That you need to use in order for the Model to work which is the name of your Character plus the name of your class And then I’m gonna click on generate and This is the final result looking really Really good I gotta say this is actually The best model that I did using the Young greenera images which is also Coincidentally one of the fastest dream Booth training I did to this day because This only took less than 15 minutes so If you do have a powerful GPU like a 3090 for example you should definitely Try to use extension because this is a Game changer and there you have it folks Now you can train your own images using Dreambooth without leaving your stable Diffusion UI what a time to be alive and There you go thank you so much to my Patreon supporters for supporting my Videos you guys are absolutely awesome Thank you so much for watching don’t Forget to subscribe and smash the like Button for the YouTube algorithm and I’ll see you guys next time bye bye