1985Basic SciencesMathematical Sciences (including Pure Mathematics)
Claude Elwood Shannon photo

Claude Elwood Shannon

  • U.S.A. / 1916-2001
  • Information Scientist
  • Professor, Massachusetts Institute of Technology

Establishment of Mathematical Foundation of Information Theory

The creator of information theory. In the late 1940s, he established a mathematical method to analyze the quantity, reliability, transformation, and equivalence relations of information, and laid the foundation for remarkable developments in today's telecommunications.

Profile

Brief Biography

1936
Graduated from University of Michigan, Bachelor of Science
1940
National Research, Princeton University
1941
Research mathematician at The Bell Telephone Laboratories
1954
Master of Science (hon.), Yale University
1956
Visiting professor at Massachusetts Institute of Technology (electrical communication)
1957
Professor at Massachusetts Institute of Technology (communication sciences and mathematics)
1958
Donner Professor at Massachusetts Institute of Technology (science)
1961
Doctor of Science, University of Michigan
1962
Doctor of Science, Princeton University

Selected Awards and Honors

1940
American Institute of Electrical Engineers Award
1949
Morris Liebmann Memorial Award
1955
Stuart Ballantine Medal, Franklin Institute
1956
Research Corporation Award

Major Works

1948

A Mathematical Theory of Communication (with Warren Weaver), 1948.

1949

Communication in the Presence of Noise, 1949.

1956

The Zero Error Capacity of Noisy Channels, 1956.

1956

Automata Studies (with John McCarthy), 1956.

1957

Certain Results in Coding Theory for Noisy Channels, 1956.

1957

Geometrische Deutung einige Ergebnisse bei der Berechnung der Kanalkapazitat, 1957

1959

Probability of Error for Optional Codes in a Gaussian Channel, 1959.

1960

Coding Theorems for a Discrete Source with a Fidelity criterion, 1960.

1961

Two-way Communication Channels, 1961.

Citation

Establishment of Mathematical Foundation of Information Theory

Communication technology is one of the technologies which has made the most remarkable progress in this century and produced significant effects in a wide range of human life. It is expected that the problems concerned with information and communication will become increasingly significant in the coming century.

Prof. Claude Elwood Shannon has given a mathematical scientific basis to the development of communication technology. His 1948 paper entitled “A Mathematical Theory of Communication,” gave birth to a new branch of mathematics called information theory. His theory revealed the scientific properties of information transmission and expanded the hope of handling the problems of information mathematically, which was previously considered impossible. It attracted the interests of many engineers and mathematicians, and has brought about the remarkable continual development of information science.

Prof. Shannon not only established an entirely new field of mathematics and showed a clear guideline of research and development, but also discovered the most important concepts and techniques in the field and, moreover, proved the most fundamental theorems concerning the stage of present development. It is rare to find a mathematical scientist who has accomplished such an epoch-making achievement in the long history of science.

Prof. Shannon analyzed the mathematical structure of information transmission from the following five aspects.
1. The characteristics of an information source which transmits information. The set of messages, the set of letters which compose each message, occurrence probability and transmission outputs of each message, etc.
2. The problems concerned with encoding in transmitting messages as signals.
3. The problems in the characteristics of transmission channels which transmit signals and those of noise which hinder communication.
4. The problem of restoring encoded signals as messages.
5. The characteristics of the part which receives information.

Based on the fundamental model of information transmission, Prof. Shannon formulated the fundamental laws which govern quantity and reliability of information, or transformation and equivalence of information. Without keeping to philosophical arguments nor resorting to methods depending on technological intuition, but by coming home to the heart of mathematical science, he built up a mathematical theory which is based on quantitative definition and mathematical analysis.

The concepts which Prof. Shannon formulated, especially those of information entropy, are fundamental in information theory, and Shannon’s Coding Theorems are still known as the most important results in this field.

Prof. Shannon’s theory and ideas on information, the applications of which are, needless to say, brilliant in communication technology, have also had much influence on a wide range of quantitative sciences including computer science, linguistics, biology, and psychology.

Lecture

Abstract of the Lecture

DEVELOPMENT OF COMMUNICATION AND COMPUTING, AND MY HOBBY

[Read More]
Full Text(PDF)
Workshop

Workshop

Forum:"New Development in Information and System Theory"

date
Tuesday, November 12, 1985
palce
Kyoto International Conference Center

Program

Moderator Toshiyuki Sakai
Member Kyoto Prize Screening Committee in Advanced Technology;
Professor, Faculty of Engineering, Kyoto University
9:30
Introductory Remarks Kazuo Inamori
President, The Inamori Foundation
9:33
Opening Remarks Heisuke Hironaka
Chairman, Kyoto Prize committee in Basic Science;
Professor, Research Institute for Mathematical Sciences, Kyoto University
9:50
Speech Takashi Hashimoto
Instructor, faculty of engineering, Kyoto University
10:30
Speech Michihiko Mino
Instructor, Faculty on Engineering, Kyoto University
11:10
Speech Shun'ichi Amari
Professor, Faculty of Engineering, the University of Tokyo
11:50
Comment Claude E. Shannon
Laureate in Basic Science
12:00
Luncheon
Moderator Nobuhide Suda
Professor, Faculty of Engineering Science, Osaka University
13:00
Lecture Rudolf E. Kalman
Laureate in Advanced Technology
14:00
Speech Tsuyoshi Matsuo
Lecturer, Faculty of Engineering, Nagoya University
14:40
Speech Shinzo Kodama
Professor, Faculty of Engineering, Osaka University
15:20
Intermission
15:35
Speech Katsuhisa Furuta
Professor, Faculty of Engineering, Tokyo Institute of Technology
16:15
Speech Hideki Kimura
Assistant Professor, Faculty of Engineering Science, Osaka University
16:55
Closing Remarks Yoshifumi Sakurai
Vice Chairman, Kyoto Prize Committee in Advanced Technology;
Professor Emeritus, Osaka University
PAGETOP