Comments by "Zach B" (@zachb1706) on "Do we really need NPUs now?" video.

  1. You put the hardware in now that you’ll need in 4 years time. I don’t even think it will be that long, Microsoft is really pushing for AI to be incorporated into the entire system and that’s only possible if the hardware can run it natively
    1
  2. Yeah, they’ll be useful for SoCs or mobile/laptop chips. But desktop chips don’t really need them
    1
  3.  @noobyfromhell  I like his reasoning though. Having your GPU power up for a few seconds to answer a query or edit an image isn’t going to have a big impact on battery drain or heat output. NPUs are for things that will run for long periods, or constantly. Sure they can also answer queries, but if you’re taking about a LLM, even small ones require massive brute force so you’d probably power up your GPU anyway.
    1
  4. Let’s listen to people with no experience building products for people how products should be made for people
    1
  5. As much as you can afford. AI performance improves with compute
    1