Advanced Search
Volume 24 Issue 1
Jan.  2002
Turn off MathJax
Article Contents
Dai Xianhua . Cumulant-bansed blind identification of two-layer feedforward neural networks[J]. Journal of Electronics & Information Technology, 2002, 24(1): 45-53.
Citation: Dai Xianhua . Cumulant-bansed blind identification of two-layer feedforward neural networks[J]. Journal of Electronics & Information Technology, 2002, 24(1): 45-53.

Cumulant-bansed blind identification of two-layer feedforward neural networks

  • Received Date: 1999-09-13
  • Rev Recd Date: 2000-07-07
  • Publish Date: 2002-01-19
  • It is always difficult to train a two-layer Feedforward Neural Networks (FNN) based on the cumulant match criterion because cumulants are nonlinear implicit functions of the FNN parameters. In this work, two new cumulant-based training methods for two-layer FNN are developed. In the first method, the hidden units of two-layer FNN are approximated with multiple linear systems, and further total FNN is modeled with a mixture of experts (ME) architecture. With the ME model, FNN parameters are estimated with expectation-maximization (EM) algorithm. The second method, for simplifying the two-layer FNN statistical model, proposes a simplified two-level hierarchical ME to remodel the FNN, in which hidden variables are introduced such that training total FNN is changed to training a set of single neurons. Based on training single neuron, total FNN is estimated in a simplified version with a faster convergence speed.
  • loading
  • J.M. Mendel, Tutorial on high-order statistics (spectra) in signal processing and system theory,theoretic results and some applications, Proc.[J]. IEEE.1991,79:278-[2]Hames A. Cadzow, Blind deconvolution via cumulant extrema, IEEE Signal Processing Magazine,1996, 13(3), 24-42.[3]D. Hatzinakos, C. L. Nikias, Blind equalization using a tricespectrum-based algorithm, IEEE Trans. on Comm., 1991, COM-39(5), 669-681.[4]B. Port, B. Ftiedlander, Blind equalization of digital communication channels using higher-order moments, IEEE Trans. on ASSP, 1991, ASSP-39(2), 522-526.[5]J.K. Tugnait, Identification of linear stochastic systems via second and fourth-order cumulants matching, IEEE Trans. on Information Theory, 1987, 33(5), 393-407.[6]Jitendra K. Tugnait, Blind equalization and channel estimation with partial response input signals, IEEE Trans. on Comm., 1997, COM-45(9), 1025-1442.[7]Vojin, Zivojnvic, Minimum fisher information of moment-constrained distributions with application to robust blind identification.[J]. Signal Processing.1998,65:297-[8]Michael I. Jordan, Lei Xu, Convergence results for the EM approach to mixtures of experts architectures, Neural Networks, 1995, 8(9), 1409-1431.[9]S.I. Amari, Information geometry of the EM and EM algorithms for neural network, Neural Networks, 1995, 8(9), 1379-1408.[10]Sheng Ma, James Farmer, An efficient EM-based training algorithm for feedforward neural networks, Neural Networks, 1997, 10(2), 243-256.[11]M.I. Jordan, Hierarchical mixtures of experts and EM algorithm, Neural Computation, 1994,6(2), 181-241.[12]R.A. Jacobs, Adaptive mixtures of local experts, Neural Computation, 1991, 3(1), 79-87.[13]B. Widrow, 30 years of adaptive neual networks, perceptron, madaline, and backpropagation,Proc. IEEE, 1990, 78(9), 1415-1442.
  • 加载中

Catalog

    通讯作者: 陈斌, bchen63@163.com
    • 1. 

      沈阳化工大学材料科学与工程学院 沈阳 110142

    1. 本站搜索
    2. 百度学术搜索
    3. 万方数据库搜索
    4. CNKI搜索

    Article Metrics

    Article views (2194) PDF downloads(465) Cited by()
    Proportional views
    Related

    /

    DownLoad:  Full-Size Img  PowerPoint
    Return
    Return