Comments by "Chrysippus" (@4.0.4) on "the ONLY way to run Deepseek..." video.

  1. >128GB RAM (FAST) No it's not. DDR5 would be slow; DDR4 is even slower. That's the bottleneck for AI, memory speed (not compute!) Btw you can run 72B with a couple 24GB cards. You can actually run it with one, it just isn't worth it (offloading ruins speed and quantizing ruins quality). Since 3090s are relatively cheap (compared to those quadro type cards), it's perfectly possible to have a PC with two, even on a non-workstation platform. For a very cheap AI home server, you could definitely make do with P40s.
    1
  2. As a non-regular, the intro has me confused. Is it safe to run a local, offline AI model? What's the target audience here??
    1