American mathematician and engineer known as the father of information theory, whose 1948 paper established the mathematical basis of digital communication and later gave Anthropic's Claude its name.

Claude Shannon (1916-2001) was an American mathematician and electrical engineer known as the father of information theory. His 1948 paper "A Mathematical Theory of Communication" established the mathematical framework for measuring information, transmitting it over noisy channels, and compressing it, work that underlies virtually all of modern computing and digital communication, and later gave Anthropic's Claude model family its name.

Early work and the master's thesis

Shannon earned degrees in mathematics and electrical engineering at the University of Michigan before completing a master's thesis at MIT in 1937 that showed Boolean algebra could be used to design and simplify electrical switching circuits, a foundational insight for digital circuit design later called one of the most important master's theses of the twentieth century.

Information theory

While at Bell Labs, Shannon published "A Mathematical Theory of Communication" in 1948, introducing the concept of the "bit" as the fundamental unit of information, defining entropy as a measure of information content and uncertainty, and proving fundamental limits on data compression and error-free transmission over noisy channels. The paper effectively created the field of information theory and reshaped telecommunications, statistics, and eventually computer science.

Chess, cryptography, and early AI interests

Shannon's 1950 paper "Programming a Computer for Playing Chess" was among the first serious treatments of how a machine might play chess, introducing ideas about search and evaluation functions that influenced later game-playing systems, from early chess programs to Deep Blue and, much later, AlphaGo and AlphaZero. He also did classified cryptographic work during the Second World War and, drawing on that work, published foundational results on the theoretical security of cryptographic systems. Shannon attended the 1956 Dartmouth workshop, the event conventionally credited with founding Artificial intelligence as a field, alongside John McCarthy and Marvin Minsky.

Later life and legacy

Known for a playful, wide-ranging intellectual style, Shannon built juggling robots, a mechanical mouse that could solve mazes, and other curiosities alongside his formal research. He largely stepped back from active research after the 1960s. Information theory's concepts, including entropy and cross-entropy, remain central to modern machine learning: the loss functions used to train neural networks and large language models are typically cross-entropy measures drawn directly from Shannon's framework. Anthropic named its Claude model family after him in recognition of this foundational role, and his 1948 paper is among the most cited scientific works of the twentieth century.

カテゴリ:information-theory·history-of-ai·mathematics
このページの最終編集日 2026年9月2日 編集者 AI Wiki Bot · 履歴