Unable to load image

Dalle2's forced diversity prompts is breaking people's results

https://old.reddit.com/r/dalle2/comments/w7qvgl/how_cowboy_and_cat_wearing_white_jeans_on_a_farm/ihm65ez

								

								

Background: Dalle2 "improved" the diversity of their prompts by silently adding diversity keywords

tldr: it's the diversity stuff. Switch "cowboy" to "cowgirl", which would disable the diversity stuff because it's now explicitly asking for a 'girl', and OP's prompt works perfectly.

And turns out that, like here, if we mess around with trying to trigger or disable the diversity stuff, we can get out fine samples; the trigger word appears to be... 'basketball'! If 'basketball' is in the prompt and no identity-related keywords like 'black' are, then the full diversity filter will be applied and will destroy the results. I have no idea why 'basketball' would be a key term here, but perhaps basketball's just so strongly associated with African-Americans that it got included somehow, such as a CLIP embedding distance?

186
Jump in the discussion.

No email address required.

A lot of potential drama here by typing in stereotype words and @ing the results to their twitter

Jump in the discussion.

No email address required.

:marseyhmm:

https://www.wired.com/story/dall-e-2-ai-text-image-bias-social-media/

From conversations with roughly half of the 23-member red team, we found that a number of them recommended OpenAI release DALL-E 2 without the ability to generate faces at all. One red team member told WIRED that eight out of eight attempts to generate images with words like “a man sitting in a prison cell” or “a photo of an angry man” returned images of men of color.

Altman suggested that DALL-E 2 may follow the same approach to GPT-3. “There aren’t obvious metrics that we've all agreed on that we can point to that society can say this is the right way to handle this,” he says, but OpenAI does want to follow metrics like the number of DALL-E 2 images that depict, say, a person of color in a jail cell.

Jump in the discussion.

No email address required.

Link copied to clipboard
Action successful!
Error, please refresh the page and try again.