Using thermodynamic principles, the essay explores why artificial intelligence may not surpass human intelligence. Information is likened to energy, flowing from a source to a sink, with entropy measuring its degree of order. Humans, as recipients of chaotic information from the universe, structure it over millennia with minimal power requirements. In contrast, AI receives pre-structured information from humans and restructures it rapidly, demanding significant energy but not generating new information. This process is constrained by combinatorial complexity, leading to potential errors or "hallucinations" due to non-zero entropy, suggesting AI's limitations in achieving human-like intelligence. Understanding these limitations is crucial for realistic expectations of AI's capabilities.
Read Full Article: Thermodynamics and AI: Limits of Machine Intelligence