emoji-award-marseywholesome
emoji-award-marseywholesome

DreamBooth Marseys :marseyastronaut: (added colab instructions)

Colab:

#@title Normal 1.4 model
# get a token from https://huggingface.co/settings/tokens
user_token = "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" #@param {type:"string"}
user_header = f"\"Authorization: Bearer {user_token}\""
!wget --header={user_header} https://huggingface.co/CompVis/stable-diffusion-v-1-4-original/resolve/main/sd-v1-4.ckpt -O model.ckpt

With:

!apt install megatools
!megadl "https://mega.co.nz/#!FxclSKoL!EFSM4nLlXMuOvBLkoZNmtOH4Y8oycjrU7h2Hn6mKl1k"
  • Run (it'll take a few minutes to download)

  • Refer to Marsey as a sks cat in your prompt. a photo of a sks cat as a gardener etc


Download the weights: https://models.rdra.ma/

Development on Stable Diffusion has been happening at a wild pace, and there's already written a working implementation of DreamBooth for it. Whereas Textual Inversion refines your prompt, DreamBooth is able to finetune the model itself to teach it new concepts. I did one run with 87 Marseys and another with just 3 upscaled ones. So far the upscaled run (u1000.ckpt) is looking best.

See the Textual Inversion posts for a comparison with that. DreamBooth is far better at keeping her colors consistent and producing recognizable images. Decent results were something like 1 in 50 before, now they're nearly every image.

a photo of Marsey

https://i.rdrama.net/images/16841360552191563.webp

a photo of a spaceman Marsey in outer space

https://i.rdrama.net/images/1684136058790262.webp

a photo of Marsey as a gardener

https://i.rdrama.net/images/16841360599337094.webp

I love that it creates real Marseys too :marseymarseylove:

a photo of Marsey running away from a dinosaur

https://i.rdrama.net/images/16841360618260746.webp

Missing the :marseydinosaur:. Might be overfitting and improve with better regularization in DreamBooth.

a photo of Marsey cooking in the kitchen

https://i.rdrama.net/images/1684136064080669.webp

These models also work with Deforum to create animations:

There's still plenty of low-hanging fruit to suggest these will get better quickly - the DreamBooth repo doesn't do regularization correctly, and we'll get a free bump in quality when SDv1.5 is released. The plague of AIposting continues

101
Jump in the discussion.

No email address required.

Holy shit we're on the cusp of replacing our own Marsey artists, no wonder they're pissing and pooping themselves.

Jump in the discussion.

No email address required.

I can’t fricking wait to incorporate this into marseycrossing are you joking

of course for marseyartists that can’t code…

Jump in the discussion.

No email address required.

also even these aren't perfect, this tool is best seen as a tool for artists. for instance this lil dude (C:2, R:3) is cute but he out of frame

![](/images/16633598285087729.webp)

Jump in the discussion.

No email address required.

my mind is literally blown right now, this is insane. it has the style, the structure, the shape perfect.

currently downloading the model, can you just swap out the original SD model with the marsey model? if so I could use AUTOMATIC1111's webui

also, why is the model so big? its like 3x larger than the SD model lmao

also also, models.rdra.ma, when did that happen, lol

edit: column 2 row 3 is actually really cute :marseylove:

![](/images/1663356517059518.webp)

Jump in the discussion.

No email address required.

Yeah it's a drop in replacement so automatic's UI should work. The extra size is from the "ema" version of the SD model which has extra metadata for training

I was high one night and got rdra.ma off njalla, I'm glad I'm getting some use out of it lmao

Jump in the discussion.

No email address required.

Can you use the usual pruning script on that model?

I'm talking about shit like https://github.com/harubaru/waifu-diffusion/blob/main/scripts/prune.py

I use a "custom" .bat (https://pastebin.com/R15jTB8U) .py (https://pastebin.com/W4mrB0nf) where you just have to edit the last line of the .py for your model. I think it needs to be in the root webui folder but I'm not certain. It works on Waifu-Diffusion so it might work on Marsey-Diffusion

Jump in the discussion.

No email address required.

Oh perfect, thanks, I'll give that a try in the future

Jump in the discussion.

No email address required.

Also, if you want to do crossovers between models (like waifu-diffusion and marsey-diffusion for anime marseys), it's dead easy to do, you just need to add the weights lmao

There's an automated script .bat (https://pastebin.com/0J9TPEcs) along with the .py (https://pastebin.com/056xeuVm). This one doesn't require changing anything, just type what's needed in cmd.

It will ask you for a ratio between the two models, there's no general rule on merges yet so just guess.

Jump in the discussion.

No email address required.

based af

![](/images/16633734948250468.webp)

Jump in the discussion.

No email address required.

Darn that's a LOT of unused shit, most models "only" get halved in size

Jump in the discussion.

No email address required.

cc @HeyMoon cc @chiobu (could you swap out my pin in /h/marsey?)

if anyone has a prompt idea lmk and I'll try to generate it

Jump in the discussion.

No email address required.

-Marsey at a blm riot

-Marsey on trial for warcrimes

-marsey in a tim burton movie

-marsey executing POWs in saigon

-god-emporer marsey

-marsey shocked and scared when confronting a photorealistic cat

-marsey catching and eating a carp

Jump in the discussion.

No email address required.

editing the others in in a sec

a photo of Marsey at a blm riot

https://i.rdrama.net/images/16841284710821784.webp

a photo of Marsey in a courtroom on trial for warcrimes

https://i.rdrama.net/images/16841284732419538.webp

digital art of Marsey in a courtroom on trial for warcrimes

https://i.rdrama.net/images/16841284738899665.webp

a photo of marsey executing POWs in saigon

https://i.rdrama.net/images/16841284743269248.webp

a photo of Marsey dressed as a god emperor of mankind, warhammer 40k

https://i.rdrama.net/images/16841284748264484.webp

marsey shocked and scared when confronting a photorealistic cat

https://i.rdrama.net/images/16841284756597924.webp

the tooth it gives shocked Marsey is cute

digital art of marsey catching and eating a carp

https://i.rdrama.net/images/16841284762649748.webp

Jump in the discussion.

No email address required.

This is gold dude

![](/images/16633614313718405.webp)

Jump in the discussion.

No email address required.

>Marsey on trial for war crimes is most realistic

:marseyworried:

Jump in the discussion.

No email address required.

How do you plead?

![](/images/16634761466294773.webp)

Jump in the discussion.

No email address required.

This frickin rules

Jump in the discussion.

No email address required.

zoz

Jump in the discussion.

No email address required.

zle

Jump in the discussion.

No email address required.

zozzle

Jump in the discussion.

No email address required.

Hahaha holy shit this is awesome. The blm riots are perfect

Jump in the discussion.

No email address required.

can you do george bush marsey :marseybegging:

Jump in the discussion.

No email address required.

tried a few, but style transfer seems trickier with dreambooth than textual inversion. I wonder if combining the two would work, hmm https://i.rdrama.net/images/168412868103343.webp

Jump in the discussion.

No email address required.

take #2:

https://i.rdrama.net/images/16841285271718872.webp

prompt2prompt is amazing with DB :marseystars:. you gotta try it if you haven't (automatic's UI has a couple versions, this and this, the second one is the "img2img alt" script)

https://i.rdrama.net/images/16841285276034226.webp

https://i.rdrama.net/images/16841285280168047.webp

https://i.rdrama.net/images/16841285290906575.webp

https://i.rdrama.net/images/16841285297120967.webp

https://i.rdrama.net/images/16841285301735191.webp

just need to figure out if it can be trained for style transfer too

Jump in the discussion.

No email address required.

i may be dumb but where is the version for automatic1111? this is neat btw

Jump in the discussion.

No email address required.

for doggettx's version, just use it in the prompt (digital art of a [cat:sks cat] holding a gun). the other one is in the scripts dropdown under "img2img alternative test". negative prompts like "poorly drawn" and "bad art" seem to help too

Jump in the discussion.

No email address required.

Oh shit, its already in the code? Nice I will def try that thanks

Jump in the discussion.

No email address required.

Born just in time to see good ai generated marseys

:#marsoyhype::#marsoyhype::#marsoyhype:

Jump in the discussion.

No email address required.

INFINITE MARSEYS

:#marseystars:

Jump in the discussion.

No email address required.

These are incredible

:#marseyclappingglasses:

Jump in the discussion.

No email address required.

Holy shit these are amazing, especially the astronaut Marsey

Jump in the discussion.

No email address required.

You could go right in there and re-design an "Always Has Been" meme with AI space Marsey.

Jump in the discussion.

No email address required.

Holy shit these are amazing, maybe you could try some prompts of different artists from https://generrated.com/ ?

![](/images/1663358204290164.webp)

Jump in the discussion.

No email address required.

can't believe I forgot to try this. I think it kind of works, I'll have to try again on artists that focus on animals in the future

Caspar David Friedrich - https://i.rdrama.net/images/16841289597113404.webp

Edward Hopper - https://i.rdrama.net/images/1684128960360896.webp

Howard Arkley - https://i.rdrama.net/images/16841289609869142.webp

Jump in the discussion.

No email address required.

those edward hopper marseys are perfect

Jump in the discussion.

No email address required.

I hate how good these are.

Jump in the discussion.

No email address required.

Wowwee mister this is pretty nifty

:leexcited:

Not like my dad :marseyrain:

Jump in the discussion.

No email address required.

👏Absolutely 👏🏼amazing👏🏿

Jump in the discussion.

No email address required.

finally a thread that needs commendations, well done!

-wpd user

Jump in the discussion.

No email address required.

:#marseybestfriends:

Snapshots:

https://models.rdra.ma/:

working implementation:

https://i.rdrama.net/images/16841312643438563.webp:

https://i.rdrama.net/images/1684131265366033.webp:

https://i.rdrama.net/images/16841312669646115.webp:

https://i.rdrama.net/images/16841312684157832.webp:

https://i.rdrama.net/images/1684131269856919.webp:

Jump in the discussion.

No email address required.

comparison of characters and styles in different marsey attempts. "sks cat" is dreambooth version, "fmarsey" is float-trip's original, "smarsey2" is my (shit) attempt at using textual-inversion

smaller model: https://mega.nz/file/AWsDGIAC#3EXe-ChMJaIBOlale2--ld6usX55Q9H6iqLVnRHlvNA

![](/images/16633756716353054.webp)

Jump in the discussion.

No email address required.

textual inversion is no good with this. I just trained embeddings off of the new model here - https://models.rdra.ma/embeddings/

elephant in the style of * (old model/embeddings) https://i.rdrama.net/images/1684137605030221.webp

elephant in the style of * (new model/embeddings) https://i.rdrama.net/images/16841376088613117.webp

could be related to this: https://github.com/XavierXiao/Dreambooth-Stable-Diffusion/issues/15

at some point it might be worth commissioning Marsey in 3-5 more standard poses for the AI to learn from. a few issues (like her tail) seem to stem from the dataset

Jump in the discussion.

No email address required.

version that has what the originals would look like unmodified by style

![](/images/16633772261077898.webp)

comparison of holding a sword

![](/images/16633780249302318.webp)

Jump in the discussion.

No email address required.

[row] marsey holding [column]

![](/images/16633808449615316.webp)

![](/images/16633810696216805.webp)

![](/images/1663381195459585.webp)

Jump in the discussion.

No email address required.

Comparison of CFG scales

![](/images/16633792448060815.webp)

lol she be gooning with friends

![](/images/1663379434145782.webp)

Jump in the discussion.

No email address required.

horny marsey :marseyflushzoom:

![](/images/1663382954109217.webp)

![](/images/16633829541787386.webp)

![](/images/16633829542952156.webp)

![](/images/16633829543653955.webp)

Jump in the discussion.

No email address required.

porn :marseyflushzoom:

![](/images/16633854531611505.webp)

![](/images/16633854532703218.webp)

![](/images/16633854533254592.webp)

![](/images/16633854533954508.webp)

Jump in the discussion.

No email address required.

Link copied to clipboard
Action successful!
Error, please refresh the page and try again.