KNOWLEDGE LIBRARY | DISCUSSION | BUSINESS RESEARCH | ANNOUNCE | HELP & FAQs | @BRINT



Welcome to World's No. 1 Business, Information Technology, and Financial Risk Management Resource
Recommended by Business Week, Wall Street Journal, New York Times, Fortune, Forbes, CIO, Computerworld, Information Week, Others
@Brint.com
SEARCH [HELP]

Help


Re: Information Theory... Continued


[ ] [ Post Followup ] [ Discussion Forums ] [ Discussion Index ]

Posted by Yogesh Malhotra on March 03, 1998 at 21:12:02:

In Reply to: Re: Information Theory: What Weiner Really Said posted by Yogesh Malhotra on March 03, 1998 at 20:49:58:

Review of:

MacKay, D.M. (1969). Information, Mechanism and Meaning, Cambridge, MA: The MIT Press.

Why should we need to measure information: the method which gives us the maximum amount of information for a given outlay of time or space or other resources. [Is more information good? Information deficit vs. Information overload.]

What we mean by information? Roughly speaking, we say that we have gained information when we know something now that we didn't know before, when 'what we know' has changed. In a technical sense, 'information' implies: that which enables us to make a selection from a set of possibilities or to narrow the range of possibilities about which we are ignorant . The number of choices is at a minimum if at each stage we arrange to choose between two equally likely possibilities. "Selective information- content" is the equivalent number of independent choices between equally likely alternatives.

The theory of information is first and foremost a linguistic tool. It enables us to speak precisely and quantitatively where previously we have had to speak vaguely and qualitatively.

The general information theory is concerned with the problem of measuring changes in knowledge. It key is the fact that we can represent what we know by means of pictures, logical statements, symbolic models, etc.

While theory of communication (referred to by some as Information Theory, but never so by Shanon, its chief originator) is based on the concept of 'communication' as the replication of what is transmitted by the sender. Communication is the activity of replicating information.

The founders of the theory of information have insisted that the "amount of information" (or, better, the selective information-content) of a signal, as they define it, bears no direct relation to the semantic function of the signal. The trouble here appears to be due largely to a confusion of the concept of information with that of information- content -- the confusion of a thing with a measure of a thing (??). Communication engineers have not developed a concept of information at all. They have developed a theory dealing explicitly with only one particular feature or aspect of messages "carrying" information -- their unexpectedness or surprise value.

Semanticists on the other hand are concerned with different features of information, such as its logical complexity and its meaning. But both engineers and semanticists have in mind the same concept of information. Both mean by information that which promotes or validates representational activity (activity from which it is possible to infer something about some other state of affairs). Both are entitled to regard the function of information as to be selective: to prescribe choice or decision.

McKay argues that the connection between statistical and semantic features of information cannot but be indirect, these are features of one and the same central concept. I have gained information when I know something that I didn't know before: when what I know has changed. Fundamentally, it implies that in some circumstance or other my expectations will be different. I am now conditionally ready to react differently. Information in fact could be defined in actor-language as that which alters my total state of adaptive readiness in this sense. What is internally imitated is not a static structure of relations between things, so much as the dynamic structure of relations between events. Events of perception are what we know primarily, and what is organised as we receive information is our conditional readiness to match the pattern of events of perception by the pattern of our own internal or external reaction.

The meaning of a signal to a given receiver (in observer-language) may be defined as the selective operation which the signal defines (in a logical, not a physical sense) on the set of possible states of readiness. The selective information-content for the receiver as defined in communication theory is a logarithmic measure of the unexpectedness of that selective operation. Thus we can readily see why even to the receiver the selective information content is not directly related to the meaning (p. 71).



Follow Ups:



Click Here to Post Follow Up in New Forums

    Knowledge Management Think Tank (New)

Subject:

Message:

[ ] [ Post Followup ] [ Discussion Forums ] [ Discussion Index ]

SITE MAP OF OUR WEB SITES

HOME Home Page with 4 Generations of Risk, Latest 500 Articles in Finance & Accounting, and Site Map

NEW!! World's Most Powerful Stock and Company Research & Analysis and Business Intelligence Tool

Research Portals Save 99% of Research Time and Effort with Exclusive Research Tool.

Information Now! Reference section for ALL Work-Life Concerns.

World News ALL Countries, Industries, Sectors, & Newspapers Research Center.

Finance & Accounting Finance, Accounting, and, Economics Research Center.
> Latest 1,250 Articles, Research Portals on 10,000 Concepts; Worldwide Markets Data; Topical Directories

Trading & Investing Financial Securities Trading & Investing Research Center.
> Latest 1,200 Articles, Research Portals on 10,700 Concepts; Worldwide Markets Data; Topical Directories

Business & Entrepreneurship Business, Management, & Entrepreneurship Research Center.
> Latest 700 Articles, Research Portals on 1,600 Concepts; Worldwide Markets Data; Topical Directories

Information Technology Information Technology & Information Systems Research Center. [C
> Latest 900 Articles, Research Portals on 2,500 Concepts; Worldwide Markets Data; Topical Directories

IT Security IT Security, Information Assurance, Controls & Compliance Research Center.
> Latest 200 Articles, Research Portals on 4,000 Concepts; Worldwide Markets Data; Topical Directories

Competitive Strategy Business Strategy and Competitive Strategy Research Center.
> Latest 400 Articles, Research Portals on 900 Concepts; Worldwide Markets Data; Topical Directories

Business Technology Business Technology Management Best Practices Research Center.

Knowledge Management WWW Virtual Library on Knowledge Management.

e-Business & E-Commerce e-Business & Electronic Commerce Research Center.

Executive Jobs Professions, Jobs, and Careers Research Center.

Global Network Global Network Community Forums with 100,000+ Opt-in Registered Members.

Events Calendar Global Network Community Events and Conferences Calendar.

About BRINT Institute You Are in 'Fabulous Company' on the BRINT Global Network.

Advertise on BRINT Minds and Brains That Move the World Advertise on the BRINT Network.

Monthly User Sessions: Several Million Monthly on Average.


Top of Page

BRINT: 'Your Survival Network for The Brave New World Of Business'tm

About BRINT | News About BRINT | Help & FAQs

Terms of Use | Privacy | © Copyright 1994-2010, BRINT Institute LLC, New York, USA

KNOWLEDGE LIBRARY | DISCUSSION | BUSINESS RESEARCH | ANNOUNCE | HELP & FAQs | @BRINT