Conservation of mutual and directed information

James L. Massey, P Massey

Research output: Chapter in Book/Report/Conference proceedingPaper in conference proceedingpeer-review

Abstract

Two conservation laws for mutual information in terms of directed informations between two synchronized sequences of random variables are derived, the first for the case of no conditioning and the second for the case of causal conditioning on a third synchronized sequence. As a byproduct of the derivation of the first conservation law, the directed information specifying the feedback flowing from the second sequence to the first sequence is identified, which leads to a simple proof that a previously known sufficient condition for equality of mutual and directed information is also a necessary condition
Original languageEnglish
Title of host publication2005 IEEE International Symposium on Information Theory (ISIT)
PublisherIEEE - Institute of Electrical and Electronics Engineers Inc.
Pages157-158
ISBN (Print)0-7803-9150-0
DOIs
Publication statusPublished - 2005
EventIEEE International Symposium on Information Theory (ISIT), 2005 - Adelaide, Australia
Duration: 2005 Sept 42005 Sept 9

Conference

ConferenceIEEE International Symposium on Information Theory (ISIT), 2005
Abbreviated titleISIT05
Country/TerritoryAustralia
CityAdelaide
Period2005/09/042005/09/09

Subject classification (UKÄ)

  • Electrical Engineering, Electronic Engineering, Information Engineering

Free keywords

  • conservation law
  • directed informations
  • causal conditioning
  • synchronized sequences
  • random variables

Fingerprint

Dive into the research topics of 'Conservation of mutual and directed information'. Together they form a unique fingerprint.

Cite this