Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Body of article:

> Weatherbed asked to depict "Taylor Swift celebrating Coachella with the boys."

> Weatherbed selected "spicy" and confirmed her birth date

> Grok produced more than 30 images of Swift in revealing clothing

> Weatherbed was shocked to discover the video generator spat out topless images

Headline: "Grok generates fake Taylor Swift nudes without being asked"

I wonder what the reported was looking for in a spicy image of Swift celebrating Coachelle with the boys? I would not call that unprompted.

Fake outrage much?



Your summary ignores much of the nuance of the article, such as the fact X claims to have a "zero-tolerance policy" for non-consensual nudity images, or that Grok refused to generate similar images with actual literal direct prompting.

So that's the cause of the outrage. Non-consensual nudity is immoral, it violates X's own policies, and they're trying to prevent it - but they did a very poor job of it.


So why did they muddy the water with "without being asked"? Grok was kinda asked. And the problem is not the asking or not in the first place, it's that it's easily possible to generate those images.

It's the headline itself that's misleading.


It wasn't asked to generate nudes. Weird hill to die on.


the title implies someone "@grok is this true?" and grok mechahiltered nudes of Taylor swift. someone's gonna die on this hill, it aint who you think tho


While spicy doesn't have to mean actual hot peppers, it doesn't have to mean flat out nudity, too, IMHO.

Yes, xAI is playing to the stands here, but they can be more creative and tasteful in this.

Who am I kidding with the last paragraph, but eh.

Also, somebody put it out so much better than me: https://news.ycombinator.com/item?id=44811611


The word "spicy" seems to be tripping people up--it's kind of vague and tongue-in-cheek, and I guess the output surprises some people.

As a general user, if I asked a tool to create "spicy" pictures of some celebrity, I wouldn't be surprised to see a few mildly raunchy or topless results, but I would be very surprised to see full-on hardcore porn. Of course there is huge spectrum between "80's movie spicy" and "PornHub spicy." Other people's definition of "spicy" might differ though, hence the confusion.


Google "coachella women topless" and you get a vibe for the range of expression at Coachella.

I would not decribe "topless" as "flat out nudity".

Even if people are still outraged, I should also point out that we're trusting what the reporting is saying without any evidence...


And most of those Google images don't even look particularly "spicy" or sexualized. (Except of course for the US American tradition of considering any instance of partial nudity as pornographic, which manifests itself e.g. in YouTube allowing a significant amount of violence while videos with any uncensored breasts are immediately taken down. Which looks rather prudish from a European perspective.)

> Even if people are still outraged, I should also point out that we're trusting what the reporting is saying without any evidence...

The reporters could have easily included the offending images in censored form. The fact that they didn't is somewhat telling.


Does it give permission to AI companies to create (deep)fakes on demand with no repercussions, though?

What would happen if you generate them at your home with your own model and release them to the public?

When somebody does something, that person is crucified and cancelled (and even prosecuted), but when a company does this, it's called free viral marketing. This is neither fair nor ethical.


What are you upset about?

That a tool is able (and willing) to create an image in someone real's likeness if the user of the tool asks for it?

And you advocate that the tool should refuse?


I personally believe that these tools should refuse to generate erotic images of specific people.


What about non-erotic images?

Imagine you give it a photo of someone (you or someone else) and ask for a fun modification like adding wings or a crown or some cool clothes?

Should that be verboten?


> And you advocate that the tool should refuse?

Yup, and I advocate this on ethical grounds, and I don't care if laws allow this (and even they do not).

> What are you upset about?

Double standards & free pass to corporations. When an individual does or enables this, SWAT will raid their home and take them and their everything in six hours or less.

When a company does this, people go "it's just an image, why so upset".

I believe people shall have dignity and rights. This is why I'm upset.

Why are you so upset that I'm upset about disregard for human dignity?


Thanks, I'm not particularly upset. I was just curious to understand your point of view better.

The reason I'm not super upset is that I believe these things will settle at a reasonable state that societies expect. Especially large corporations will conform to societal expectations.

If you're very worried about deepfakes of actual people, I think you should be more concerned about those models that are NOT the product of a large company, but rather the ones that any random person can run on their computer.


Scale matters. Yes, local models will always be able to run without any guardrails and somebody can use them to create as much objectionable content as they want. But the vast majority of people will interact with these tools through the most convenient mechanism, which isn't a local model. Guardrails can be valuable here even if people can go somewhere else.


I'll still point out it's Grok, which does make porn of people already and racist comments and is tuned to be politically incorrect. So there's already enough to be outraged about IMO if you aren't someone like Musk.


[flagged]


remember when elon literally cried about the short sellers




Consider applying for YC's Fall 2026 batch! Applications are open till July 27.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: