Comments by "Paul Aiello" (@paul1979uk2000) on "How Did Llama-3 Beat Models x200 Its Size?" video.

  1. He's the good guy compared to the likes of OpenAI, but in the end, they are all corporations and care about profit over everything else, but clearly Mata are seeing the open source community as an asset when it comes to A.I. in that open sourcing the models, allows the community to fine-tune them so they become a lot better, the end result is that Mata can save billions on running cost whiles also the open source community have a lot more options in running A.I. at a local level, it's a win-win for all sides, especially compared to OpenAI that keeps everything under lock and key.
    9
  2. Yeah, it does surprise me how quickly these open source models are developing, from a size to performance level. You get a sense that the likes of OpenAI, Microsoft and Google are using a brute force approach to A.I. which must cost them a fortune to run compared to the smart nimble way that the open source community is doing, and it makes sense, if you have limited resources, you're going to think outside the box to get better results. I really do wonder how much better a 7b, 13,b 40b and 70b can get before we get to limits that we need bigger models for better results, it looks like we are still a long way away from that because we keep finding better solutions for the given model sizes, which improves performance and like you said, it's remarkable the pace of development in just over 1 year, makes me wonder what we will see over the next 5, 10 years.
    8
  3.  @Slav4o911  The signs are looking promising that Llama 3 will beat GPT4 once the community starts to fine-tune them, especially looking at how big of an improvement that's been done on Llama 2, it's likely we will see some big improvements on the newer model, probably more so because these are bigger models.
    5
  4. I suspect a big reason for them to want to release open source is because for one, the community themselves will help to improve the model a lot, which over the long run would save Mata a fortune, and two is probably to level the playing field, being that A.I. is likely going to be important in so many areas that it would be dangerous to allow so few governments and corporations control them, so open sourcing them, blows that open and puts everyone on the same playing field. If we had a situation where eventually one or two closed models dominant the market, that would give that corporation and probably the government of the country a massive advantage over everyone else, it's a given that they will use the uncensored version of the model whiles everyone else gets the restricted one, because of all this, open source is very important for A.I. models. There is also the advantage of open source models that will lower the cost for consumers and gives consumers far more control and privacy when running at a local level.
    2