On the equivalence between Stein and de Bruijn identities

Sangwoo Park*, Erchin Serpedin, Khalid Qaraqe

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

13 Citations (Scopus)

Abstract

This paper focuses on illustrating 1) the equivalence between Stein's identity and De Bruijn's identity, and 2) two extensions of De Bruijn's identity. First, it is shown that Stein's identity is equivalent to De Bruijn's identity under additive noise channels with specific conditions. Second, for arbitrary but fixed input and noise distributions under additive noise channels, the first derivative of the differential entropy is expressed by a function of the posterior mean, and the second derivative of the differential entropy is expressed in terms of a function of Fisher information. Several applications over a number of fields, such as signal processing and information theory, are presented to support the usefulness of the developed results in this paper.

Original languageEnglish
Article number6248705
Pages (from-to)7045-7067
Number of pages23
JournalIEEE Transactions on Information Theory
Volume58
Issue number12
DOIs
Publication statusPublished - 2012
Externally publishedYes

Keywords

  • Bayesian Cramér-Rao lower bound (BCRLB)
  • Costa's EPI
  • Cramér-Rao lower bound (CRLB)
  • De Bruijn's identity
  • entropy power inequality (EPI)
  • Fisher information inequality (FII)
  • Stein's identity

Fingerprint

Dive into the research topics of 'On the equivalence between Stein and de Bruijn identities'. Together they form a unique fingerprint.

Cite this