A Telegram user who advertises their services on Twitter will create an AI-generated pornographic image of anyone in the world for as little as $10 if users send them pictures of that person. Like many other Telegram communities and users producing nonconsensual AI-generated sexual images, this user creates fake nude images of celebrities, including images of minors in swimsuits, but is particularly notable because it plainly and openly shows one of the most severe harms of generative AI tools: easily creating nonconsensual pornography of ordinary people.

  • SendMePhotos@lemmy.world
    link
    fedilink
    English
    arrow-up
    18
    arrow-down
    13
    ·
    8 months ago

    I’d like to share my initial opinion here. “non consential Ai generated nudes” is technically a freedom, no? Like, we can bastardize our president’s, paste peoples photos on devils or other characters, why is Ai nudes where the line is drawn? The internet made photos of trump and putin kissing shirtless.

    • Maggoty@lemmy.world
      link
      fedilink
      English
      arrow-up
      14
      arrow-down
      2
      ·
      8 months ago

      It’s a far cry from making weird memes to making actual porn. Especially when it’s not easily seen as fake.

        • Maggoty@lemmy.world
          link
          fedilink
          English
          arrow-up
          4
          ·
          8 months ago

          Psychological trauma. Normal people aren’t used to dealing with that and even celebrities seek help for it. Throw in the transition period where this technology is not widely known and you have careers on the line too.

    • antlion@lemmy.dbzer0.com
      link
      fedilink
      English
      arrow-up
      9
      ·
      8 months ago

      Seems to fall under any other form of legal public humiliation to me, UNLESS it is purported to be true or genuine. I think if there’s a clear AI watermark or artists signature that’s free speech. If not, it falls under Libel - false and defamatory statements or facts, published as truth. Any harmful deep fake released as truth should be prosecuted as Libel or Slander, whether it’s sexual or not.

    • abhibeckert@lemmy.world
      link
      fedilink
      English
      arrow-up
      8
      arrow-down
      2
      ·
      edit-2
      8 months ago

      The internet made photos of trump and putin kissing shirtless.

      And is that OK? I mean I get it, free speech, but just because congress can’t stop you from expressing something doesn’t mean you actually should do it. It’s basically bullying.

      Imagine you meet someone you really like at a party, they like you too and look you up on a social network… and find galleries of hardcore porn with you as the star. Only you’re not a porn star, those galleries were created by someone who specifically wanted to hurt you.

      AI porn without consent is clearly illegal in almost every country in the world, and the ones where it’s not illegal yet it will be illegal soon. The 1st amendment will be a stumbling block, but it’s not an impenetrable wall - congress can pass laws that limit speech in certain edge cases, and this will be one of them.

      • WaxedWookie@lemmy.world
        link
        fedilink
        English
        arrow-up
        7
        ·
        8 months ago

        The internet made photos of trump and putin kissing shirtless.

        And is that OK?

        I’m going to jump in on this one and say yes - it’s mostly fine.

        I look at these things through the lens of the harm they do and the benefits they deliver - consequentialism and act utilitarianism.

        The benefits are artistic, comedic and political.

        The “harm” is that Putin and or Trump might feel bad, maaaaaaybe enough that they’d kill themselves. All that gets put back up under benefits as far as I’m concerned - they’re both extremely powerful monsters that have done and will continue to do incredible harm.

        The real harm is that such works risk normalising this treatment of regular folk, which is genuinely harmful. I think that’s unlikely, but it’s impossible to rule out.

        Similarly, the dissemination of the kinds of AI fakes under discussion is a negative because they do serious,measurable harm.

    • afraid_of_zombies@lemmy.world
      link
      fedilink
      English
      arrow-up
      2
      ·
      8 months ago

      Public figures vs private figures. Fair or not a public figure is usually open season. Go ahead and make a comic where Ben Stein rides a horse home to his love nest with Ben Stiller.

    • UsernameIsTooLon@lemmy.world
      link
      fedilink
      English
      arrow-up
      3
      arrow-down
      1
      ·
      8 months ago

      Lemme put it this way. Freedom of speech isn’t freedom of consequences. You talk shit, you’re gonna get hit. Is it truly freedom if you’re infringing on someone else’s rights?

      • John_McMurray@lemmy.world
        link
        fedilink
        English
        arrow-up
        5
        arrow-down
        1
        ·
        8 months ago

        Yeah you don’t have the right to prevent people from drawing pictures of you, but you do have the right not to get hit by some guy you’re drawing.

    • GhostTheToast@lemmy.world
      link
      fedilink
      English
      arrow-up
      4
      arrow-down
      6
      ·
      8 months ago

      Don’t get me wrong it’s unsettling, but I agree, I don’t see the initial harm. I see it as creating a physical manifestation of someone’s inner thoughts. I can definitely see how it could become or encourage dangerous situations, but that’s like banning alcohol because it could lead to drunk driving or sexual assault.