Comments by "Mikko Rantalainen" (@MikkoRantalainen) on "The Death of Computer Memory. New Era of Data Storage" video.

The only really important spec for any new memory technology is latency. You can always improve bandwidth by having more units in parallel but you cannot fix bad latency by having more components. I truly wish we had something that's equally low latency to SRAM but would work efficiently with smallest process technologies. And the ultimate goal would be to get rid of SDRAM for good. I'd love to have the whole system RAM made out of SRAM (or any other memory technology with < 1ns latency).
1
@kazedcat The problem is obviously the cost. If you use 20 transistors per bit, building something the size of i9-13900K would result in about 128 MB of really fast RAM if the whole chip area were spent for this kind of super-fast RAM. And if you build optimized SRAM instead with 4 transistors per bit, you would still only have roughly 700 MB of RAM on that chip. You don't see many people willing to pay about $1 per 1 MB for really low latency RAM. 40 years ago that would have been insanely cheap but we need insane amounts of RAM these days.
1