Wyniki wyszukiwania - BazTech

Ograniczanie wyników

1 Journal of Applied Computer Science Methods

1 2016

Znaleziono wyników: 1

Liczba wyników na stronie

Wyniki wyszukiwania

Sortuj według:

Ogranicz wyniki do:

Convergence Analysis of An Improved Extreme Learning Machine Based on Gradient Descent Method

Yusong L., Zhixun S., Bingjie Y., Xiaoling G., Zhaoyang S.

Journal of Applied Computer Science Methods

2016

Vol. 8 No. 1

5--15

Extreme learning machine (ELM) is an efficient algorithm, but it requires more hidden nodes than the BP algorithms to reach the matched performance. Recently, an efficient learning algorithm, the upper-layer-solution-unaware algorithm (USUA), is proposed for the single-hidden layer feed-forward neural network. It needs less number of hidden nodes and testing time than ELM. In this paper, we mainly give the theoretical analysis for USUA. Theoretical results show that the error function monotonously decreases in the training procedure, the gradient of the error function with respect to weights tends to zero (the weak convergence), and the weight sequence goes to a fixed point (the strong convergence) when the iterations approach positive infinity. An illustrated simulation has been implemented on the MNIST database of handwritten digits which effectively verifies the theoretical results.