“Learning machines” are “Learning Rooms” that only take on the appearance of learning. These mistakes are mere symptoms of a lack of genuine learning; machines still wouldn’t be learning even if they give perfect results. Neither the man nor the Chinese Room was “speaking Chinese;” They were merely following the instructions of the Chinese-speaking programmer of the Chinese Room. They no more learn how to drive or drive themselves than a Chinese Room learn Chinese or speak Chinese. Artificial consciousness is impossible due to the extrinsic nature of programming which is bound to syntax and devoid of meaning.
Source: New York Times September 04, 2023 15:52 UTC