emoji-award-marseywholesome
emoji-award-marseywholesome

DreamBooth Marseys :marseyastronaut: (added colab instructions)

Colab:

#@title Normal 1.4 model
# get a token from https://huggingface.co/settings/tokens
user_token = "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" #@param {type:"string"}
user_header = f"\"Authorization: Bearer {user_token}\""
!wget --header={user_header} https://huggingface.co/CompVis/stable-diffusion-v-1-4-original/resolve/main/sd-v1-4.ckpt -O model.ckpt

With:

!apt install megatools
!megadl "https://mega.co.nz/#!FxclSKoL!EFSM4nLlXMuOvBLkoZNmtOH4Y8oycjrU7h2Hn6mKl1k"
  • Run (it'll take a few minutes to download)

  • Refer to Marsey as a sks cat in your prompt. a photo of a sks cat as a gardener etc


Download the weights: https://models.rdra.ma/

Development on Stable Diffusion has been happening at a wild pace, and there's already written a working implementation of DreamBooth for it. Whereas Textual Inversion refines your prompt, DreamBooth is able to finetune the model itself to teach it new concepts. I did one run with 87 Marseys and another with just 3 upscaled ones. So far the upscaled run (u1000.ckpt) is looking best.

See the Textual Inversion posts for a comparison with that. DreamBooth is far better at keeping her colors consistent and producing recognizable images. Decent results were something like 1 in 50 before, now they're nearly every image.

a photo of Marsey

https://i.rdrama.net/images/16841360552191563.webp

a photo of a spaceman Marsey in outer space

https://i.rdrama.net/images/1684136058790262.webp

a photo of Marsey as a gardener

https://i.rdrama.net/images/16841360599337094.webp

I love that it creates real Marseys too :marseymarseylove:

a photo of Marsey running away from a dinosaur

https://i.rdrama.net/images/16841360618260746.webp

Missing the :marseydinosaur:. Might be overfitting and improve with better regularization in DreamBooth.

a photo of Marsey cooking in the kitchen

https://i.rdrama.net/images/1684136064080669.webp

These models also work with Deforum to create animations:

There's still plenty of low-hanging fruit to suggest these will get better quickly - the DreamBooth repo doesn't do regularization correctly, and we'll get a free bump in quality when SDv1.5 is released. The plague of AIposting continues

101
Jump in the discussion.

No email address required.

Holy shit we're on the cusp of replacing our own Marsey artists, no wonder they're pissing and pooping themselves.

Jump in the discussion.

No email address required.

I can’t fricking wait to incorporate this into marseycrossing are you joking

of course for marseyartists that can’t code…

Jump in the discussion.

No email address required.

also even these aren't perfect, this tool is best seen as a tool for artists. for instance this lil dude (C:2, R:3) is cute but he out of frame

![](/images/16633598285087729.webp)

Jump in the discussion.

No email address required.

Link copied to clipboard
Action successful!
Error, please refresh the page and try again.