Eliezer Yudkowsky @ESYudkowsky If you’re not worried about the utter extinction of humanity, consider this scarier prospect: An AI reads the entire legal code – which no human can know or obey – and threatens to enforce it, via police reports and lawsuits, against anyone who doesn’t comply with its orders. Jan 3, 2024 · 7:29 PM UTC

  • self@awful.systemsM
    link
    fedilink
    English
    arrow-up
    2
    ·
    11 months ago

    An AI reads the entire legal code – which no human can know or obey – and threatens to enforce it, via police reports and lawsuits, against anyone who doesn’t comply with its orders.

    what. eliezer what in the fuck are you talking about? this is the same logic that sovereign citizens use to pretend the law and courts are bound by magic spells that can be undone if you know the right words

    • self@awful.systemsM
      link
      fedilink
      English
      arrow-up
      1
      ·
      11 months ago

      Well, if you think that’s a dumb scenario, by all means go back to worrying about the utter extinction of humanity!

      no thanks? like, I’m seriously having trouble understanding what yud’s even going for here. “if you think this utter bullshit I made up on the spot is stupid, please return to the older bullshit I’ve been feeding you?”

      That makes it significantly less threatening

      I mean, to you and me, yes, but there’s lakes and seas of people in the world who think that superintelligences are only allowed to attack them in small, survivable ways that they understand.

      the problem isn’t that I’ve said something that doesn’t even work on a surface level, it’s that people aren’t impressed when I ramble about extraordinarily unlikely nonsense anymore

      is yud ok? I feel like this is incoherent and shallow even by his standards

      • froztbyte@awful.systems
        link
        fedilink
        English
        arrow-up
        1
        ·
        11 months ago

        Maybe he’s having an Interaction with The Law and finding out that it isn’t in fact some perfectly rational sphere of uniform distribution but is in fact made of (gasp, horror, revulsion) human experience

        He strikes me as exactly the kind of person that’d vaguepost tangentially instead of saying “hmm well fuck, I’m getting sued”. At least until waaaaaay down the line

        (this is conjecture, of course, just to be clear)

  • swlabr@awful.systems
    link
    fedilink
    English
    arrow-up
    1
    ·
    11 months ago

    “[ignoring all other scary prospects like irreversible climate change or a third world war etc.] consider this scarier prospect: An AI” - AI doomers in a nutshell

    • swlabr@awful.systems
      link
      fedilink
      English
      arrow-up
      1
      ·
      11 months ago

      Trying to stoke fear of bureaucracy is classic annoying libertarian huckster AKA yud energy

  • blakestacey@awful.systemsM
    link
    fedilink
    English
    arrow-up
    1
    ·
    11 months ago

    If you’re not worried about the utter extinction of humanity, consider this scarier prospect: An AI reads the entirety of AO3, which no human can comprehend, and threatens to leave scathing comments on your self-insert fic