On Some Almost Properties

Abstract :

Previous works have shown that regular distribu- tions with differential entropy or mean-squared error behavior close to that of the Gaussian are also close to the Gaussian with respect to some distances like Kolmogorov-Smirnov or Wasserstein distances, or vice versa. In keeping with these results, we show that under the assumption of a functional dependence on the Gaussian, any regular distribution that is almost Gaussian in differential entropy has a mean-squared error behavior of an almost linear estimator. A partial converse result is established under the addition of an arbitrary independent quantity: a small mean-squared error yields a small entropy difference. The proofs use basic properties of Shannon’s information measures and can be employed in an alternative solution to the missing corner point problem of Gaussian interference channels.

Complete list of metadatas

https://hal.telecom-paristech.fr/hal-02288458
Contributor : Telecomparis Hal <>
Submitted on : Saturday, September 14, 2019 - 6:50:39 PM
Last modification on : Thursday, October 17, 2019 - 12:36:59 PM

Identifiers

  • HAL Id : hal-02288458, version 1

Citation

Olivier Rioul, Max H. M. Costa. On Some Almost Properties. IEEE Information Theory and Applications Workshop (ITA 2016), Feb 2016, San Diego, United States. ⟨hal-02288458⟩

Share

Metrics

Record views

8