Comments by "Aga" (@aga5109) on "Eliezer Yudkowsky: When will AGI arrive? | Lex Fridman Podcast Clips" video.

I think with supreme intelligence & huge money investment, many technical constraints can be overcome. It is not fantasy in todays billionaries world. The question remains, which of limitations can not be overcome because we live in a finite system with finite possibilities like physical constants, physical laws, etc. What degree of chaos can we inject into the set system to not destroy the fine tuning? There are limits to it, too. But the pursuit of power is never-ending.
2
When it comes to models of scientific cognition that will be built by humans with the help of AI or AGI, there will also be build in limit. We do not know all the variables of the model. We enter the initial assumptions into the model, we verify scientific hypotheses with tools with limited parameters, also by matter. Our senses have a limited range. Knowledge will be accumulated and analyzed within a limited set of possibilities in finiteness. Overgenralized From one system to another, given that they differ in their level of complexity and operation. The problem is to generalize such conclusions, from finite to infinity. And it's dangerous. Unfortunately, we are threatened by overgeneralising, which is one of the aspects of human cognition, for example, leading to severely judging of other people, within a limited knowledge about them to get oriented in a situation & to retain "psychological homeostasis" governed by "defence mechanism". It is an obvious process seen by people who work with peoples' minds.
1
@ljuhan2 That's true. What does constitute the subjective experience ? It emerges from interactions with different, various sets of information processing systems that build its complexity. Maybe it is not merely material in its essence. Emerging from less complex to way more complex and intricate.We do not know what "law" governs the emergence - transcendence- process, from more simple to more complex systems like for example, quantatomic level. Atomic realm emerges from quantum. Consciousness emerges from the processing of information from different systems, and it is innate in a brain. We are not sure what set of systems this processing it encompasses but what is certain we can think in abstract ways also through language using knowledge & logic. That's how, as far as l understood, current AI operates. It is not consciousness per say but ability to process information with speed and complexity. Operating on imput and programmed layers of complex algorithms, which can learn by itself and reason also build models, for example, a model of a language by which it communicates and interacts with people. images recognition and creation. Both very complex human functions are integrated in GPT4.
1