Comments by "IgorTheLight" (@igorthelight) on "Sabine Hossenfelder" channel.

  1. You are just doing what is natural for humans. For big numbers please use calculators because you may "predict" it wrong. But that's fine! People could calculate it wrong (the bigger the number - the bigger the chance).
    1
  2. Yep! Most people wouldn't actually do 10 * 10 and would just predict 100 because it's "obvious". ;-)
    1
  3. But a calculator can't fix your errors in code ;-)
    1
  4. Kinda. * Some models are truly Open Source - anyone who is working in this field could see exactly how it works. * But most newest advanced models are not Open Source (or partially Open Source) so only their developers could know how it works. Claude is one of those. For those cases, developers should test it so they could try to understand what is happening under the hood.
    1
  5. Absolutely! Most people would not really calculate 10 * 10 and would just answer 100. Why? Because we just remember the answer. We just "predict it". What if modern LLMs can predict much more hard answers?
    1
  6. * It thinks much like humans but simplified * It explains you how to get to the answer - he can't show you his real steps because some of them don't contain words at all (first few steps) and some steps could reveal how exactly it works (and that's a trade secret). So yes - it does some mental gymnastics to not look like that: Step 1: Unexplainable for humans Step 2: Unexplainable for humans Step 3: Firing different nodes (can't provide additional information - it's a secret!) Step 4: Comparing weights (can't provide additional information - it's a secret!) ... It wouldn't be useful for us but I DO want to see that. actually.
    1
  7. Exactly!
    1
  8. Yep!
    1
  9. Fair point!
    1
  10. Agree!
    1
  11. It is! It may look stupid and inefficient but that's pretty close how human brain works xD
    1
  12.  @zsoltmolnar1143  Looks like we are more efficient! xD Just wait 10 years!
    1
  13. Maybe one day, LLM could explain us why the Ultimate Question of Life, the Universe, and Everything is 42 xD
    1