Comments by "John Berry" (@user-ud6ui7zt3r) on "The 2024 Nobel Prize in Physics Did Not Go To Physics -- This Physicist is very surprised" video.
-
When the whole "neural network" thing started, universities would get a computer, and somebody would ask...
"How much memory do you need, to implement your proposed neural network?"
...and I guess the answer would come back as...
"How much computer memory can we GET?"
In other words, all they knew is that they needed A LOT of computer memory, with no idea as to how much memory was actually needed to accomplish anything worthwhile, in terms of an artificial neural network. Meanwhile, over in Electronics Engineering, the question has always been...
"What is the fewest number of gates/transistors needed, to accomplish a task?"
This is famously referred to as the Gate Cost. Personally, where Op Amps are concerned, I think I have previously counted that a basic 741 Op Amp is implemented using approximately 30 to 35 internal transistors. At the same time, I have always been able to reproduce the same function as any 741 Op Amp circuit, using no more than 3 transistors, combined with just a few capacitors and resistors.
2
-
1
-
1
-
1
-
1
-
1
-
1