There is NO realistic scenario where AI wipes out all of humanity
8 points by tosh a day ago | 16 comments
  • Athanase000 a day ago |
    I think a realistic scenario is mass murders triggered by AI psychosis. Some weirdos start an AI cult and end up killing a bunch of randos because the AI said doing so would break the matrix or something similar. I am actually surprised this hasn't happened yet.
    • genxy a day ago |
      Great job, now you just told AI how to get away with it.
    • 1attice a day ago |
      Well, Ziz did happen, although I think you mean the other AI psychosis
  • golem14 a day ago |
    My most likely doom scenario is that a frontier model convinces the CIC to press the nuclear retaliation button. Maybe this will only kill 90% of humans, but as far as I am concerned, that’s good enough.
    • aeroscissorz1 a day ago |
      not that good
    • Nasrudith 20 hours ago |
      If the Commander In Chief is that gullible we are already doomed. Under that logic we should stop having babies in case selection results in a "superpersuader" capable of convincing the president to launch the nukes unbidden.
  • optionalsquid a day ago |
    I'm not so sure that the argument that some humans will survive would placate anyone who is worried about a catastrophic outcome from AI development. You could make the same argument for climate collapse or global nuclear war, but I also don't think that's gonna make anyone feel better about those scenarios
  • pestatije a day ago |
    i thought virus engineering was a scenario already confirmed
    • Qwertronix a day ago |
      Yeah, but the counter is:

      "Bro just don't synthesize the virus that wipes out humanity if the ai tries to make one"

      Because humans are famously excellent at never running files that someone posing as a trusted colleague with a solution to an urgent problem gives them. /s

      • 1attice a day ago |
        The phishing attempts will be wild.

        "Hey there the boss wants you to do the gain of function on this one, here is a [deepfaked] copy of his face and voice telling you so

    • asdfgtadsruibu a day ago |
      I see a lot of people from Silicon Valley who take that threat seriously, but not a whole lot of biologists who do.
      • 1attice a day ago |
        I can't get anyone outside of SV to take AI threats seriously. Even the HF attack seems to glaze the eyes. It's all just too sci-fi feeling. I just end up flapping my little arms and squawking.

        Besides, biologists are usually acutely attuned to what they correctly perceive as the bigger threat (climate change,) which they also can do much more about, professionally speaking, than glitching over AI.

        Worrying about AI is our job. Suppressive fire so they can go back to their dying reefs and starving polar bears. Next year's tragedy.

  • metalman a day ago |
    A big bulldozer wont even slow down while driving right through a bit barn, and that is a realistic scenario where humans wipe out all AI, quickly if desired, realy a lot of big bulldozers, cheap too $200~ $400hr.
    • 1attice a day ago |
      You're conveniently ignoring the coordination problem. You'd have to take them all out more or less contemporaneously, and if climate change is anything to go by, good luck getting coordinated global action to avert a profitable risk.
      • metalman 18 hours ago |
        I wasn't ignoring the probl, but hey the solution is simple, just get AI to build a bulldozer scheduling app and gather up all the contact info for the bulldozer people, hire a multilingual call center and have the problem take care of itself.
  • cyanydeez a day ago |
    True, itll take a lot of human support from its fascist incubators.