期刊文献+

The essential order of approximation for nearly exponential type neural networks 被引量:3

The essential order of approximation for nearly exponential type neural networks
原文传递
导出
摘要 For the nearly exponential type of feedforward neural networks (neFNNs), it is revealed the essential order of their approximation. It is proven that for any continuous function defined on a compact set of Rd, there exists a three-layer neFNNs with fixed number of hidden neurons that attain the essential order. When the function to be approximated belongs to the α-Lipschitz family (0 〈α≤ 2), the essential order of approxi- mation is shown to be O(n^-α) where n is any integer not less than the reciprocal of the predetermined approximation error. The upper bound and lower bound estimations on approximation precision of the neFNNs are provided. The obtained results not only characterize the intrinsic property of approximation of the neFNNs, but also uncover the implicit relationship between the precision (speed) and the number of hidden neurons of the neFNNs. For the nearly exponential type of feedforward neural networks (neFNNs), it is revealed the essential order of their approximation. It is proven that for any continuous function defined on a compact set of Rd, there exists a three-layer neFNNs with fixed number of hidden neurons that attain the essential order. When the function to be approximated belongs to the α-Lipschitz family (0 〈α≤ 2), the essential order of approxi- mation is shown to be O(n^-α) where n is any integer not less than the reciprocal of the predetermined approximation error. The upper bound and lower bound estimations on approximation precision of the neFNNs are provided. The obtained results not only characterize the intrinsic property of approximation of the neFNNs, but also uncover the implicit relationship between the precision (speed) and the number of hidden neurons of the neFNNs.
出处 《Science in China(Series F)》 2006年第4期446-460,共15页 中国科学(F辑英文版)
基金 the National Natural Science Foundation of China (Grant Nos. 10371097 , 70531030).
关键词 nearly exponential type neural networks the essential order of approximation the modulus of smoothness of a multivariate function. nearly exponential type neural networks, the essential order of approximation, the modulus of smoothness of a multivariate function.
  • 相关文献

参考文献3

二级参考文献3

共引文献33

同被引文献34

  • 1陈天平.神经网络及其在系统识别应用中的逼近问题[J].中国科学(A辑),1994,24(1):1-7. 被引量:50
  • 2曹飞龙,张永全,张卫国.单隐层神经网络与最佳多项式逼近[J].数学学报(中文版),2007,50(2):385-392. 被引量:13
  • 3G. Cybenko.Approximation by superpositions of a sigmoidal function[J]. Mathematics of Control, Signals, and Systems . 1989 (4)
  • 4Funahashi K.On the approximate realization of continuous mappings by neural networks. Neural Networks . 1989
  • 5Hornik K,Stinchcombe M,White H.Multilayer feedforward networks are universal approximators. Neural Networks . 1989
  • 6Leshno M,Lin V Y,Pinkus A,et al.Multilayer feedforward networks with a nonpolynomial activation function can approximate any function. IEEE Transactions on Neural Networks . 1993
  • 7Mhaskar H N,Micchelli C A.Approximation by superposition of sigmoidal and radial basis functions. Advances in Applied Mechanics . 1992
  • 8Hornik K.Approximation capabilities of multilayer feedforward network. Neural Networks . 1991
  • 9Chen T,Chen H.Approximation capability to functions of several variables, nonlinear functionals and operators by radial basis function neural networks. IEEE Transactions on Neural Networks . 1995
  • 10Chen T,Chen H.Universal approximation to nonlinear operators by neural networks with arbitrary activation functions and its application to dynamical systems. IEEE Transactions on Neural Networks . 1995

引证文献3

二级引证文献5

相关作者

内容加载中请稍等...

相关机构

内容加载中请稍等...

相关主题

内容加载中请稍等...

浏览历史

内容加载中请稍等...
;
使用帮助 返回顶部