关于前馈多层神经网络多维函数逼近能力的一个定理
A NOVEL THEOREM ON THE MULTI-DIMENSIONAL FUNCTION APPROXIMATION ABILITY OF FEED FORWARD MULTI-LAYER NEURAL NETWORKS
-
摘要: 本文首次证明了前馈神经网络多维函数逼近能力的一个重要定理:当隐层神经元数目足够多时,其多维函数逼近能力与维数无关.也就是说我们只需研究其一维函数逼近能力,所得的结论完全适合于多维情形,该定理大大简化了前馈多层神经网络函数逼近问题的分析难度。本文还给出了该定理的一个应用。Abstract: This paper presents a novel theorem on the multi-dimensional function approximation ability of feed forward multi-layer neural networks (FFMLNN), which states that the function approximation ability of FFMLNN is independent of the dimension of the function to be approximated when the number of the hidden units is sufficiently large. This theorem simplifies greatly the analysis of the function approximation ability of FFMLNN because one needs only to study the one dimensional function approximation ability of FFMLNN. An application of the proposed theorem is given.
-
韦岗,贺前华.神经网络模型学习及应用,北京:电子工业出版社,1994，第三章.[2]Sam Kwong, Wei Gang, Ouyang Jing-zheng. Discrete utterance recognition based on nonlinear[3]model identification with single layer neural networks. Proc. IEEE Int. Conf. Circuits and Systems, USA:1993, 2419-2422.[4]Wei Gang, Ouyang Jing-zheng. On the bound of the approximation capacity of multi-layer neural[5]networks. Proc. Int. Joint. Conf. Neural Networks, Singapore:1991, 2299-2304.[6]Cybenko G. Approximation勿superposition of a sigmoidal function[J].Math. Control, Signals, Syst.1989, 2(4):303-314[7]Hartman E J, Keeler J D, Kowalski J M. Layered neural networks with Gaussian hidden units as universal approximations[J].Neural Comp.1991, 2(3):210-215[8]Hornik K. Approximation capacities of multilayer feedforward networks[J].Neural Networks.1991, 4(3):251-257[9]Park J, Sandberg I W. Universal approximation using radial-basis-function networks[J].Neural Comp.1991, 3(3):246-257[10]Park J, Sanberg I W. Approximation and radial-basis-function networks[J].Neural Comp.1993, 5(4):305-316 -
计量
- 文章访问数: 2442
- HTML全文浏览量: 106
- PDF下载量: 388
- 被引次数: 0
下载:
