Colab:
-
Open automatic1111's colab: https://colab.research.google.com/drive/1Iy-xW9t1-OQWhb0hNxueGij8phCyluOh
-
Replace this cell:
#@title Normal 1.4 model
# get a token from https://huggingface.co/settings/tokens
user_token = "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" #@param {type:"string"}
user_header = f"\"Authorization: Bearer {user_token}\""
!wget --header={user_header} https://huggingface.co/CompVis/stable-diffusion-v-1-4-original/resolve/main/sd-v1-4.ckpt -O model.ckpt
With:
!apt install megatools
!megadl "https://mega.co.nz/#!FxclSKoL!EFSM4nLlXMuOvBLkoZNmtOH4Y8oycjrU7h2Hn6mKl1k"
-
Run (it'll take a few minutes to download)
-
Refer to Marsey as
a sks cat
in your prompt.a photo of a sks cat as a gardener
etc
Download the weights: https://models.rdra.ma/
Development on Stable Diffusion has been happening at a wild pace, and there's already written a working implementation of DreamBooth for it. Whereas Textual Inversion refines your prompt, DreamBooth is able to finetune the model itself to teach it new concepts. I did one run with 87 Marseys and another with just 3 upscaled ones. So far the upscaled run (u1000.ckpt) is looking best.
See the Textual Inversion posts for a comparison with that. DreamBooth is far better at keeping her colors consistent and producing recognizable images. Decent results were something like 1 in 50 before, now they're nearly every image.
a photo of Marsey
a photo of a spaceman Marsey in outer space
a photo of Marsey as a gardener
I love that it creates real Marseys too
a photo of Marsey running away from a dinosaur
Missing the . Might be overfitting and improve with better regularization in DreamBooth.
a photo of Marsey cooking in the kitchen
These models also work with Deforum to create animations:
There's still plenty of low-hanging fruit to suggest these will get better quickly - the DreamBooth repo doesn't do regularization correctly, and we'll get a free bump in quality when SDv1.5 is released. The plague of AIposting continues
Jump in the discussion.
No email address required.
Snapshots:
https://web.archive.org/https://i.imgur.com/hm3JJg6.mp4
https://archive.ph/?url=https://i.imgur.com/hm3JJg6.mp4&run=1 (click to archive)
https://ghostarchive.org/search?term=https://i.imgur.com/hm3JJg6.mp4 (click to archive)
https://models.rdra.ma/:
https://web.archive.org/https://models.rdra.ma/
https://archive.ph/?url=https://models.rdra.ma/&run=1 (click to archive)
https://ghostarchive.org/search?term=https://models.rdra.ma/ (click to archive)
working implementation:
https://web.archive.org/https://github.com/XavierXiao/Dreambooth-Stable-Diffusion
https://archive.ph/?url=https://github.com/XavierXiao/Dreambooth-Stable-Diffusion&run=1 (click to archive)
https://ghostarchive.org/search?term=https://github.com/XavierXiao/Dreambooth-Stable-Diffusion (click to archive)
https://web.archive.org/https://i.rdrama.net/images/16841312643438563.webp
https://archive.ph/?url=https://i.imgur.com/T5PAT1d_d.webp?maxwidth=9999&fidelity=high&run=1 (click to archive)
https://ghostarchive.org/search?term=https://i.imgur.com/T5PAT1d_d.webp?maxwidth=9999&fidelity=high (click to archive)
https://web.archive.org/https://i.rdrama.net/images/1684131265366033.webp
https://archive.ph/?url=https://i.imgur.com/7UCyptp_d.webp?maxwidth=9999&fidelity=high&run=1 (click to archive)
https://ghostarchive.org/search?term=https://i.imgur.com/7UCyptp_d.webp?maxwidth=9999&fidelity=high (click to archive)
https://web.archive.org/https://i.rdrama.net/images/16841312669646115.webp
https://archive.ph/?url=https://i.imgur.com/Mlj7IHD_d.webp?maxwidth=9999&fidelity=high&run=1 (click to archive)
https://ghostarchive.org/search?term=https://i.imgur.com/Mlj7IHD_d.webp?maxwidth=9999&fidelity=high (click to archive)
https://web.archive.org/https://i.rdrama.net/images/16841312684157832.webp
https://archive.ph/?url=https://i.imgur.com/i1ReyQm_d.webp?maxwidth=9999&fidelity=high&run=1 (click to archive)
https://ghostarchive.org/search?term=https://i.imgur.com/i1ReyQm_d.webp?maxwidth=9999&fidelity=high (click to archive)
https://web.archive.org/https://i.rdrama.net/images/1684131269856919.webp
https://archive.ph/?url=https://i.imgur.com/xoOkLal_d.webp?maxwidth=9999&fidelity=high&run=1 (click to archive)
https://ghostarchive.org/search?term=https://i.imgur.com/xoOkLal_d.webp?maxwidth=9999&fidelity=high (click to archive)
Jump in the discussion.
No email address required.
More options
Context