TY - GEN
T1 - Dynamic optimal training of a three layer neural network with sigmoid function
AU - Wang, Chi-Hsu
AU - Chi, Yu Yi
PY - 2006/12/1
Y1 - 2006/12/1
N2 - This paper proposes a dynamical optimal training algorithm for a three layer neural network (NN) with sigmoid activation functions in the hidden and output layers. This three layer neural network can be used for classification problems, such as the classification of Iris data. The mathematical formulation of this three layer NN is rigorously derived first in this paper, so that the dynamical optimal training of it can be performed. The dynamical optimal training process for this three layer NN is therefore presented which guarantees the convergence of the training in a minimum number of epochs. This dynamical optimal training does not use fixed learning rate for training. Instead, the learning rates are updated for next iteration to guarantee the optimal convergence of the training result. Excellent results have been obtained for XOR and Iris data set.
AB - This paper proposes a dynamical optimal training algorithm for a three layer neural network (NN) with sigmoid activation functions in the hidden and output layers. This three layer neural network can be used for classification problems, such as the classification of Iris data. The mathematical formulation of this three layer NN is rigorously derived first in this paper, so that the dynamical optimal training of it can be performed. The dynamical optimal training process for this three layer NN is therefore presented which guarantees the convergence of the training in a minimum number of epochs. This dynamical optimal training does not use fixed learning rate for training. Instead, the learning rates are updated for next iteration to guarantee the optimal convergence of the training result. Excellent results have been obtained for XOR and Iris data set.
UR - http://www.scopus.com/inward/record.url?scp=34250161332&partnerID=8YFLogxK
U2 - 10.1109/ICNSC.2006.1673178
DO - 10.1109/ICNSC.2006.1673178
M3 - Conference contribution
AN - SCOPUS:34250161332
SN - 1424400651
SN - 9781424400652
T3 - Proceedings of the 2006 IEEE International Conference on Networking, Sensing and Control, ICNSC'06
SP - 392
EP - 397
BT - Proceedings of the 2006 IEEE International Conference on Networking, Sensing and Control, ICNSC'06
Y2 - 23 April 2006 through 25 April 2006
ER -