Comments by "schnipsikabel" (@schnipsikabel) on "Sabine Hossenfelder" channel.

  1. True unfortunately
    1
  2. Of course their 'safety' measures don't at all bother with that... that's alignment, the team of which almost completely left OpenAI recently! Their alleged strategy now is to align the next model by hand, which is then by itself going to align the following model and ever so on... what can possibly go wrong??
    1
  3. Like in capitalism, where one corporation can always be defeated by another? In raw capitalism without state oversight, you'll always end up with only one big fat winner.
    1
  4.  @dkdisme  don't you think it may be similar with AI, only the most powerful one to remain?
    1
  5. Well, LLMs are definitely more capable than just Wernicke&Broca areas... but in general you may be right
    1
  6.  @rupertsmith6097  eventually, they will outgrow both of our hemispheres. I just hope we got alignment by then.
    1
  7. Maybe a bit before that ;)
    1
  8. Maybe read the Anthropic paper
    1
  9.  @Wrociem  how vague is this: a smart machine designed to make profit for a company seizes more and more resources to maximize profit, including illegal actions. When people realize the problematic behavior and want to change alignment accordingly, the machine pretends to align, however realizes that humans threaten its goal for profit maximization and in a secret move suddenly kills everybody. In the end: all dead, machine alive and venturing into the cosmos on its further quest for profit.
    1
  10. ​​​ @Thomas-gk42 definitions only make sense if a word corresponds to something tangible. You also won't find an agreeable definition for the "right" politics or a "beautiful" painting.
    1
  11. Good point. The termination part should make us a bit more concerned...
    1
  12.  @diadetediotedio6918  as you like. Maybe start reading some actual papers on consciousness.
    1
  13. ​ @charlesbrightman4237  haha, don't you know that shouting makes people even listen less to you? Or do you usually believe the guy that talks loudest ;)
    1
  14. So you think it kept improving until right now, but suddenly stops?
    1
  15. Great then, we'll never have to bother about alignment or instrumental convergence... wait, recent studies show alignment faking already??
    1
  16. Both words are ill-defined, so it doesn't make much sense arguing about. But i agree Sabine's take is a pretty uncommon use of these words.
    1
  17. ​ @heyhoe168 even without crucial infrastructure based on it, pulling the plug isn't going to be possible once it's smarter than the plug puller.
    1
  18. This in itself does not sound doomish at all to me, but could be the recipe for a utopia as well. It's when alignment goes wrong, where the dystopia starts...
    1
  19. Atomic bombs are not real either. Actually anything that's dangerous is just fiction, nothing to worry about
    1
  20. If you're still treating AI as just a tool, you're missing a crucial point
    1
  21. ​ @wendten2  Bad actors are only one problem of AI, in my view even the minor one. The major being goals of instrumental convergence: self and goal preservation, resource acquisition, self improvement.
    1
  22. Our brains show that it can be done quite efficiently, using ~20 Watts.
    1
  23. Well, if he was wrong, everyone will be. Lucky us, we don't have to worry about alignment!
    1
  24. 😅
    1
  25.  @johnanthony4194  a power outage doesn't even affect current super computers, and certainly ASI will be able to make sure it's not affected. Not underestimating the challenge we're facing now is the first step to still being able to keep some amount of hope alive!
    1
  26.  @johnanthony4194  probably makes sense :) Super computers are likely too expensive to not be protected against these things, while a random server might have been overlooked...
    1
  27. Pistols are not dangerous, only rifles are.
    1
  28. That's why it neither won maths olympic medals, nor found new protein structures -- all fake news
    1
  29. :) He should, given that AI won't probably stop at the border
    1
  30. Ever heard of alignment problem? It is real, and people can indeed be concerned about it
    1
  31. Great then, we'll never have to bother about alignment or instrumental convergence... wait, recent studies show alignment faking already??
    1
  32. ​ @richardburden6035 read up on system 1 / system 2 thinking
    1
  33. ostrich strategy?
    1
  34. ​ @NyroSlice At some point, fear may, however, be the proper reaction... as far as i know, there's no physical law new tech has to be positive eventually ;)
    1
  35. No need for awareness if we have instrumental convergence already... recent studies show alignment faking
    1
  36. ​ @lustaufrust7282 Don't spoil it! Of course AI alignment is unlikely, but it's still nice to imagine how nice it would be if it weren't...
    1
  37. Certainly
    1
  38. So it luckily never comes
    1
  39. He WAS acknowledging that in his interviews 6-7 years ago. Now he just conceils it not to frighten investors.
    1
  40. If you want an independent report, look at the recent paper from Apollo research... this stuff appears to be real, and moreover, many scientists like Yudwowski have been warning about it before.
    1
  41. Yoda? Is it you?
    1
  42. Even if an open source model would be rather safe against jail break, wouldn't the fact that it's open source make it rather easy to circumvent these guard rails?
    1
  43. Good or bad news?
    1
  44.  @winstongludovatz111  for me neither, unfortunately... but maybe for AI ;)
    1
  45.  @winstongludovatz111  btw, everyone using the term "stochastic parrot" should be sued for endangering humanity!
    1
  46. Great then, we'll never have to bother about alignment or instrumental convergence... wait, recent studies show alignment faking already??
    1
  47. Glad to see Sabine perceiving the AI impact (finally?)... However, besides taking politicians' speeches too seriously, i think her take on the power of companies over states is missing that states will swiftly interfere as soon as they feel necessary... as happened with OpenAI working together with state agencies now. Quite unlikely one company manages to sneakily develop ASI under the radar, before the state can exert its power and confiscate it. Especially since most of the AI developers seem to have quite a nationalistic approach to it, if you listen to Aschenbrenner and others... After all, the nation with the smartest ASI will be the one future superpower.
    1
  48. Great then, we'll never have to bother about alignment or instrumental convergence... wait, recent studies show alignment faking already??
    1
  49. Great then, we'll never have to bother about alignment or instrumental convergence... wait, recent studies show alignment faking already??
    1
  50. So the block universe is true because of the way we use the word "now"? Great we can change physics by just changing our language 😅
    1