Wyner's common information in Gaussian channels

Pengfei Yang, Biao Chen

Research output: Chapter in Book/Report/Conference proceedingConference contribution

4 Citations (Scopus)

Abstract

This paper considers the computation of Wyner's common information between outputs of additive Gaussian channels with a common input. The work is motivated by recent generalization of Wyner's common information to continuous random variables and the associated lossy source coding interpretation, as well as its application to statistical inference. It is shown that with independent and identically distributed Gaussian noises, Wyner's common information between channel outputs is precisely the same as the mutual information between the source input and the channel outputs regardless of the source distribution. The result extends the previous result when the source distribution is Gaussian. Generalization to additive channels with correlated noises and its application to statistical estimation are also presented.

Original languageEnglish (US)
Title of host publicationIEEE International Symposium on Information Theory - Proceedings
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages3112-3116
Number of pages5
ISBN (Print)9781479951864
DOIs
StatePublished - 2014
Event2014 IEEE International Symposium on Information Theory, ISIT 2014 - Honolulu, HI, United States
Duration: Jun 29 2014Jul 4 2014

Other

Other2014 IEEE International Symposium on Information Theory, ISIT 2014
CountryUnited States
CityHonolulu, HI
Period6/29/147/4/14

Fingerprint

Output
Gaussian distribution
Random variables
Continuous random variable
Correlated Noise
Statistical Estimation
Source Coding
Gaussian Noise
Statistical Inference
Mutual Information
Identically distributed
Generalization
Interpretation

ASJC Scopus subject areas

  • Applied Mathematics
  • Modeling and Simulation
  • Theoretical Computer Science
  • Information Systems

Cite this

Yang, P., & Chen, B. (2014). Wyner's common information in Gaussian channels. In IEEE International Symposium on Information Theory - Proceedings (pp. 3112-3116). [6875407] Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/ISIT.2014.6875407

Wyner's common information in Gaussian channels. / Yang, Pengfei; Chen, Biao.

IEEE International Symposium on Information Theory - Proceedings. Institute of Electrical and Electronics Engineers Inc., 2014. p. 3112-3116 6875407.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Yang, P & Chen, B 2014, Wyner's common information in Gaussian channels. in IEEE International Symposium on Information Theory - Proceedings., 6875407, Institute of Electrical and Electronics Engineers Inc., pp. 3112-3116, 2014 IEEE International Symposium on Information Theory, ISIT 2014, Honolulu, HI, United States, 6/29/14. https://doi.org/10.1109/ISIT.2014.6875407
Yang P, Chen B. Wyner's common information in Gaussian channels. In IEEE International Symposium on Information Theory - Proceedings. Institute of Electrical and Electronics Engineers Inc. 2014. p. 3112-3116. 6875407 https://doi.org/10.1109/ISIT.2014.6875407
Yang, Pengfei ; Chen, Biao. / Wyner's common information in Gaussian channels. IEEE International Symposium on Information Theory - Proceedings. Institute of Electrical and Electronics Engineers Inc., 2014. pp. 3112-3116
@inproceedings{4a15d8814c884a38be891648f1866501,
title = "Wyner's common information in Gaussian channels",
abstract = "This paper considers the computation of Wyner's common information between outputs of additive Gaussian channels with a common input. The work is motivated by recent generalization of Wyner's common information to continuous random variables and the associated lossy source coding interpretation, as well as its application to statistical inference. It is shown that with independent and identically distributed Gaussian noises, Wyner's common information between channel outputs is precisely the same as the mutual information between the source input and the channel outputs regardless of the source distribution. The result extends the previous result when the source distribution is Gaussian. Generalization to additive channels with correlated noises and its application to statistical estimation are also presented.",
author = "Pengfei Yang and Biao Chen",
year = "2014",
doi = "10.1109/ISIT.2014.6875407",
language = "English (US)",
isbn = "9781479951864",
pages = "3112--3116",
booktitle = "IEEE International Symposium on Information Theory - Proceedings",
publisher = "Institute of Electrical and Electronics Engineers Inc.",

}

TY - GEN

T1 - Wyner's common information in Gaussian channels

AU - Yang, Pengfei

AU - Chen, Biao

PY - 2014

Y1 - 2014

N2 - This paper considers the computation of Wyner's common information between outputs of additive Gaussian channels with a common input. The work is motivated by recent generalization of Wyner's common information to continuous random variables and the associated lossy source coding interpretation, as well as its application to statistical inference. It is shown that with independent and identically distributed Gaussian noises, Wyner's common information between channel outputs is precisely the same as the mutual information between the source input and the channel outputs regardless of the source distribution. The result extends the previous result when the source distribution is Gaussian. Generalization to additive channels with correlated noises and its application to statistical estimation are also presented.

AB - This paper considers the computation of Wyner's common information between outputs of additive Gaussian channels with a common input. The work is motivated by recent generalization of Wyner's common information to continuous random variables and the associated lossy source coding interpretation, as well as its application to statistical inference. It is shown that with independent and identically distributed Gaussian noises, Wyner's common information between channel outputs is precisely the same as the mutual information between the source input and the channel outputs regardless of the source distribution. The result extends the previous result when the source distribution is Gaussian. Generalization to additive channels with correlated noises and its application to statistical estimation are also presented.

UR - http://www.scopus.com/inward/record.url?scp=84906544673&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84906544673&partnerID=8YFLogxK

U2 - 10.1109/ISIT.2014.6875407

DO - 10.1109/ISIT.2014.6875407

M3 - Conference contribution

AN - SCOPUS:84906544673

SN - 9781479951864

SP - 3112

EP - 3116

BT - IEEE International Symposium on Information Theory - Proceedings

PB - Institute of Electrical and Electronics Engineers Inc.

ER -