Meningkatkan Kinerja Backpropagation Neural Network Menggunakan Algoritma Adaptif

Authors

  • Abdul Rahman Bohari Prodi Teknik Industri, Fakultas Teknik dan Informatika, Universitas BSI

DOI:

https://doi.org/10.31294/imtechno.v3i1.1043

Keywords:

Feedforward Neural Network, Backpropagation, Algoritma Adaptif

Abstract

The application of Artificial Neural Networks in various fields of human life is getting wider, especially in the industrial sector. One of the artificial neural network structures that are quite often used is the Feedforward Neural Network with its well-known learning algorithm, namely Backpropagation. However, as reported by several researchers, Backpropagation has several weaknesses such as it takes a long time to converge in the training process, it is quite sensitive to initial weight conditions and is relatively often trapped in a local minima which can thwart the training process. In this study, the Adaptive algorithm is proposed as an alternative to the Backpropagation learning algorithm. The proposed algorithm provides hope in overcoming the weaknesses faced by Bakpropagation. As reported in the test results, compared to Backpropagation, the Adaptive algorithm is much stronger in dealing with variations in the initial weight conditions. From 100 tests in this study for each Backpropagation and Adaptive algorithm, with random variations for the initial weight value, the success rate of the Adaptive algorithm training process reaches 100% compared to Backpropagation which is at the level of 77%. In terms of speed, the Adaptive algorithm has successfully carried out the training process with an average number of iterations of 37 times compared to Backpropagation which requires an average of 162 iterations.

References

Abdul Hamid, N., Mohd Nawi, N., Ghazali, R., & Mohd Salleh, M. N. (2012). A review on improvement of back propagation algorithm. Global Journal on Technology, 1. http://archives.un-pub.eu/index.php/P-ITCS/article/viewFile/742/1024

Cilimkovic, M. (2015). Neural networks and back propagation algorithm. Institute of Technology Blanchardstown, Blanchardstown Road North Dublin, 15(1).

Dasuki, M. (2021). Optimasi Nilai Bobot Algoritma Backpropagation Neural Network Dengan Algoritma Genetika. JUSTINDO (Jurnal Sistem dan Teknologi Informasi Indonesia), 6(1),38-44. http://jurnal.unmuhjember.ac.id/index.php/JUSTINDO/article/download/5280/3297

Ismail, M. I. S., Okamoto, Y., & Okada, A. (2013). Neural Network Modeling for Prediction of Weld Bead Geometry in Laser Microwelding. Advances in Optical Technologies. https://downloads.hindawi.com/archive/2013/415837.pdf

Karayiannis, N.B., Venetsopouloos, A.N. (1992). Artifial Neural Networks. Kluwer Academic Publisher.

Lee, Charles W., (1997). Training Feedforward Neural Networks: An Algorithm Giving Improved Generalization.” Neural Networks 10 (1): 61–68. https://doi.org/10.1016/S08936080(96)00071-8.

Ma, J., Zhu, S. G., Wu, C. X., & Zhang, M. L. (2009). Application of back-propagation neural network technique to high-energy planetary ball milling process for synthesizing nanocomposite WC–MgO powders. Materials & Design, 30(8), 2867-2874.

Ray, S. (2019, February). A quick review of machine learning algorithms. In 2019 International conference on machine learning, big data, cloud and parallel computing (COMITCon) (pp. 35-39). IEEE. https://translateyar.ir/wp-content/uploads/2021/12/A-Quick-Review-of-Machine.pdf

Siregar, Muhammad Noor Hasan, (2017). Neural Network Analysis With Backpropogation In Predicting Human Development Index (HDI) Component by Regency/City In North Sumatera.” IJISTECH (International Journal Of Information System & Technology) 1 (1): 22. https://doi.org/10.30645/ijistech.v1i1.3

Wang, H. S. (2007). Application of BPN with feature-based models on cost estimation of plastic injection products. Computers & Industrial Engineering, 53(1), 79-94.

Yi, X. (2015, August). Selection of initial weights and thresholds based on the genetic algorithm with the optimized back-propagation neural network. In 2015 12th International Conference on Fuzzy Systems and Knowledge Discovery (FSKD) (pp. 173-177). IEEE.

Downloads

Published

2022-02-17