Wyniki wyszukiwania - BazTech

Ograniczanie wyników

1 Journal of Applied Computer Science Methods

1 2015

Znaleziono wyników: 1

Liczba wyników na stronie

Wyniki wyszukiwania

Wyszukiwano:
w słowach kluczowych: Gradient

Sortuj według:

Ogranicz wyniki do:

Convergence Analysis of Multilayer Feedforward Networks Trained with Penalty Terms: A review

Wang J., Yang G., Liu S., Zurada J. M.

Journal of Applied Computer Science Methods

2015

Vol. 7 No. 2

89--103

Gradient descent method is one of the popular methods to train feedforward neural networks. Batch and incremental modes are the two most common methods to practically implement the gradient-based training for such networks. Furthermore, since generalization is an important property and quality criterion of a trained network, pruning algorithms with the addition of regularization terms have been widely used as an efficient way to achieve good generalization. In this paper, we review the convergence property and other performance aspects of recently researched training approaches based on different penalization terms. In addition, we show the smoothing approximation tricks when the penalty term is non-differentiable at origin.