Unable to load image

[Update: Jannied :marseyitsover:] r/StableDiffusion: Comparison of DreamBooth and Textual Inversion (Meet Marsey!) :marseywave:

https://old.reddit.com/r/StableDiffusion/comments/xjlv19/comparison_of_dreambooth_and_textual_inversion

								

								

:#marseyclapping: @float-trip

Meet Marsey! An adorable cat from a Telegram sticker pack. I've been trying to get SD to generate more of this character, and wanted to share my results for anyone else working on a specific 2D style.

Comparisons


a photo of a spaceman Marsey in outer space

Textual Inversion / DreamBooth

https://i.rdrama.net/images/16841357703112879.webp / https://i.rdrama.net/images/16841357715438375.webp

a photo of Marsey as a lifeguard

Textual Inversion / DreamBooth

https://i.rdrama.net/images/16841357726722727.webp / https://i.rdrama.net/images/1684135773795822.webp

a photo of Marsey as a scientist

Textual Inversion / DreamBooth

https://i.rdrama.net/images/16841357749498625.webp / https://i.rdrama.net/images/16841357767355447.webp

a photo of Marsey as a gardener

Textual Inversion / DreamBooth

https://i.rdrama.net/images/16841357782806287.webp / https://i.rdrama.net/images/168413577961412.webp

What I've noticed:


Textual inversion:

DreamBooth:

  • Far, far better for my use case. The character is more editable and the composition improves. It doesn't match the art style quite as well, though.

  • 3 images worked better than 72

  • works extremely well with cross-attention prompt2prompt (the "img2img alternative test" script in automatic1111's UI)

  • 1,000 steps (30min on an A6000) is sufficient for good results

  • Worth mentioning - it's usable with deforum for animations

Combining the two doesn't seem to work, unfortunately. The next step might be either to directly finetune the network itself and apply one of these techniques afterwards, or possibly training the classifier.

86
Jump in the discussion.

No email address required.

When will :marseyclueless: this become user friendly?

Jump in the discussion.

No email address required.

if you don't mind colabs, you can try the Marseys here: https://rdrama.net/h/marsey/post/104962/dreambooth-marseys-marseyastronaut-added-colab-instructions

if you're wondering when you can SD on your own stuff, though, not sure. Emad says finetuning will be available in dreamstudio soon, but he overpromises like crazy

Jump in the discussion.

No email address required.

i think there's img2img on dreamstudio now and they're using version 1.5: https://beta.dreamstudio.ai/dream

Jump in the discussion.

No email address required.

https://www.mage.space/ is probably the easiest way to generate stable diffusion images

Jump in the discussion.

No email address required.



Now playing: Bad Boss Boogie (DKC).mp3

Link copied to clipboard
Action successful!
Error, please refresh the page and try again.