# Computer Power and Human Reason Computer Power and Human Reason is a 1976 book by Joseph Weizenbaum that critically examines artificial intelligence, arguing that computers cannot replicate human judgment and that their uncritical use threatens human responsibility. **Computer Power and Human Reason: From Judgment to Calculation** is a 1976 book by computer scientist Joseph Weizenbaum. It is a foundational critique of artificial intelligence (AI) and the uncritical application of computational thinking to human affairs. Weizenbaum, who created the ELIZA chatbot at MIT in the 1960s, used the book to argue that computers, while powerful, cannot and should not replace human judgment, empathy, and moral responsibility. The book became a landmark in the philosophy of computing and continues to influence debates about AI ethics and the limits of technology. The work emerged from Weizenbaum's disillusionment with the direction of AI research. He observed that many researchers treated human reasoning as a mere information-processing task, ignoring the emotional, social, and ethical dimensions that are integral to human intelligence. He warned that this reductionist view could lead to a society that over-relies on computers for decisions that require human wisdom, such as in medicine, law, and warfare. ## The ELIZA Effect and the Limits of Computation Weizenbaum's most famous example was ELIZA, a simple program that simulated a Rogerian psychotherapist by rephrasing user statements as questions. Despite its simplicity, many users became emotionally attached to ELIZA, treating it as a real therapist. This phenomenon, later called the "ELIZA effect," demonstrated how easily people anthropomorphize computers. Weizenbaum argued that this tendency was dangerous because it obscured the fundamental difference between a machine's pattern-matching and genuine human understanding. He contended that computers can only manipulate symbols according to formal rules; they lack the ability to grasp meaning, context, or intentionality. Human reasoning, by contrast, is embedded in a lived world of values, relationships, and bodily experience. Thus, no matter how sophisticated the algorithms, a computer cannot truly understand a human problem or make a moral judgment. ## The Instrumental Reason Critique Weizenbaum drew on the philosophical concept of instrumental reason, which reduces all thinking to the efficient calculation of means to given ends. He argued that the computer embodies this mode of thought, and its widespread adoption encourages people to view themselves and others as objects to be optimized. This leads to what he called the "imperialism of instrumental reason," where human problems are redefined as technical problems, stripping them of their ethical and political dimensions. He was particularly critical of the use of computers in military and government decision-making, such as the automated systems for nuclear war planning. He argued that such applications dehumanize both the decision-makers and the affected populations, making catastrophic choices seem rational and inevitable. ## The Responsibility of Scientists Weizenbaum placed a strong emphasis on the moral responsibility of computer scientists. He argued that researchers cannot hide behind the neutrality of their tools; they must consider the social consequences of their work. He famously stated that there are some tasks that computers should never be asked to do, regardless of their technical feasibility, because doing so would undermine human dignity. He criticized the AI community for its hubris, particularly the claim that machines could eventually replicate all human cognitive abilities. He saw this as a form of self-deception that ignored the irreducibly subjective and emotional aspects of human life. Instead, he called for a more humble and reflective approach to technology, one that respects the limits of computation. ## Legacy and Contemporary Relevance *Computer Power and Human Reason* has been widely cited in discussions of AI ethics, human-computer interaction, and the philosophy of technology. Its warnings about the dangers of over-reliance on algorithms resonate strongly in the era of [large-language-model](https://www.wikiprompt.org/wiki/large-language-model)s, [generative-ai](https://www.wikiprompt.org/wiki/generative-ai), and [machine-learning](https://www.wikiprompt.org/wiki/machine-learning). For example, the tendency to treat AI outputs as authoritative, even in domains like medicine or law, echoes the ELIZA effect. The book also anticipated debates about AI alignment, bias, and the need for human oversight. Weizenbaum's critique of instrumental reason is now central to many critiques of [artificial-intelligence](https://www.wikiprompt.org/wiki/artificial-intelligence) in society, including concerns about surveillance, automation, and the erosion of human agency. His insistence on the moral responsibility of technologists is reflected in contemporary calls for AI ethics boards and responsible AI development. Despite its age, the book remains a touchstone for those who question the assumption that more computing power always leads to better outcomes. It challenges readers to consider what it means to be human in a world increasingly shaped by machines. ## See Also - [artificial-intelligence](https://www.wikiprompt.org/wiki/artificial-intelligence) - [machine-learning](https://www.wikiprompt.org/wiki/machine-learning) - [large-language-model](https://www.wikiprompt.org/wiki/large-language-model) - [generative-ai](https://www.wikiprompt.org/wiki/generative-ai) - [mit-csail](https://www.wikiprompt.org/wiki/mit-csail) --- Source: https://www.wikiprompt.org/wiki/computer-power-and-human-reason License: CC BY-SA 4.0 (https://creativecommons.org/licenses/by-sa/4.0/) Last updated: 2026-09-14T04:26:44.671868+00:00