Minimum mean-squared error estimation of stochastic processes by mutual entropy

Bing-Fei Wu*

*Corresponding author for this work

研究成果: Article同行評審


An upper bound on the correlation coefficients in terms of the mutual entropy is developed for a general estimation problem. This upper bound may be reached by means of a nonlinear transformation such that, after the transformation, the processes are jointly gaussian. In order to minimize globally the mean-squared estimation error, we use an approach based on the Calculus of Variations to find the vector nonlinear functions whose elements turn out to be the eigenfunctions of two vector integral operators that could be concurrently solved from two vector integral equations. The relationship between the minimum mean-squared error (MMSE) and the mutual entropy is discussed. Since the MMSE error is linear with the number of experimental data, we consider the mutual entropy rate, which is the average of the mutual entropy, to evaluate the average MMSE error. This rate is related to the average MMSE error and it is show that a mutual entropy rate of 0·5 is the critical threshold for the MMSE problem. Moreover, given a correlation coefficient, ergodic and jointly gaussian signals can be generated easily by computer. An approach to create these signals is also presented.

頁(從 - 到)1391-1402
期刊International Journal of Systems Science
出版狀態Published - 1 一月 1996

指紋 深入研究「Minimum mean-squared error estimation of stochastic processes by mutual entropy」主題。共同形成了獨特的指紋。