Comments by "Paul Aiello" (@paul1979uk2000) on "Is it the Fastest AI Chip in the World? Groq Explained" video.

  1. I'm sure we all know that rivals are more or less going to do much of the same thing to rob them of that advantage, probably even integrated into cpu's or gpu's. On the plus side, this could have a big impact on reducing the price of A.I. chips, which is distorting the entire gpu market at the moment. From what I understand of it, from performance per watt, it's already much better than what Nvidia offers, if so and considering that this is 14nm, I do wonder how much faster and lower power consumption the 4nm will be. I also think that because of the task that this chip does, which is far more streamlined compared to a cpu or gpu, it's likely that a lot of rivals will be able to enter that market much easier than the traditional cpu and gpu markets, especially because for A.I. the drivers are much more streamlined and easier to do, that's great news because it very likely in the coming years will put a lot of downwards pressure on the price whiles boosting performance and with that, we might end up with some kind of A.I. chip that we can slot into a consumer grade PC, which I think locally run A.I. models are going to be far more important then the online centralised models, because of privacy and security reasons, which has A.I. because more capable and useful, it's going to be more involved in our daily lives, which I suspect for most of us as well as businesses, it wouldn't be that appealing to share so much data with an online central database/
    2
  2. We're going to be massive progress, we should remember that gpu's where the best we had when it comes to accelerating A.I. but it was only a matter of time before someone invents a chip that is designed for that task. The irony is, because of the task of processing A.I. an A.I. designed chip is likely far less complicated and a lot cheaper to manufacture compared to a gpu which has a lot of fluff around it, so it wouldn't surprise me if many more companies enter the A.I. specialised chip market which should drive the price down a lot and what will fuel that is the high growth demand and the current high prices, which I think will get slashed massively in the next 5 or so years.
    1