Comments by "Michael Nurse" (@michaelnurse9089) on "Steelmanning the \"Doomer\" Argument: How Uncontrollable Super Intelligence (USI) could kill everyone" video.

  1. Militaries turned out to be very controllable. Uncontrollable militaries usually engage in a coup d'etat. When was the last such thing in a Western/Democratic developed country? (Greece 1967)
    4
  2. "We've been accelerating on a parabolic curve for the last 100 years." Depends on the subject matter - physics has made no significant progress in the last 40+ years.
    2
  3. Inference is limited by single thread speed and that has been flat for more than a decade. I can imagine future LLMs which take 24 hours to get back to you but accuracy is excellent.
    1
  4. Covid was a bioweapon. How did we do?
    1
  5. No. Once humans are economically useless we become a liability. Either they give us a food and entertainment allowance or find ways to kill us. The primary customers will be other corporations with their machines. Customers are not really needed when you control all the resources - you just use them directly to build your empire - no need to buy and sell stuff anymore.
    1
  6. Neither. AI cannot surpass the intelligence in its training data. Instead it will get better and better at driving up corporate efficiency, military efficiency, cyber attack efficiency - which can cause problems that ruin your life all the same.
    1
  7. To mine Moon, Mercury, Mars, Asteroid Belt we would need roughly 1 trillion - so 50%.
    1