Comments by "Michael Nurse" (@michaelnurse9089) on "" video.

  1. Loss in the middle problem is a temporary issue. Some LLMs are already calling it solved.
    4
  2. Memory: the AI can be trained to write and read to a db. Still would be very far from human level memory but it is possible to improve this area.
    2
  3. An AI can never have a good working relationship with a person.
    1
  4. You can teach them simple things not in their training data - just explain how to do it in the prompt. If this can be scaled up 1^n times then guy who wrote book will be very wrong.
    1
  5. Strictly speaking: the algorithms have no mathematical limit to what they can learn. There is only the question of insufficient good data and enough compute. And there will be enough compute, I can assure you of that. Because programmers don't write down WHY they are writing or editing code(it would take a long time), and prefer to keep it in their head, it is unlikely there is enough data to make a good programmer AI. Of course, that all changes when an LLM company hires or contracts 10 000 good programmers to start giving them a full account of WHY they are doing the things they do. Then they will have the dataset. It will cost 10s or 100s of billions.
    1