Comments by "Mikko Rantalainen" (@MikkoRantalainen) on "Is it the Fastest AI Chip in the World? Groq Explained" video.

  1. Great point on lowering packaging costs thanks to built-in memory!
    1
  2. Scaling to 100T models is going to be hard as long as accelerator cards have 10–100 GB RAM and you really wanted cards with 1–50 TB RAM.
    1
  3. Running low latency AI chips on cloud seems a bit weird because latency from your own system to cloud is always going to add extra latency. I guess you should locate your servers into the same cloud provider as the Croq service provider.
    1