Comparison of Different Optimization Algorithms in the Fashion MNIST Dataset

Authors : Umut Saray, Uğur Çavdar

Pages : 52-58

View : 73 | Download : 52

Publication Date : 2024-12-22

Article Type : Research Paper

Abstract :This study examines the effects of various optimization algorithms used in deep learning models to classify fashion-oriented clothing items. The Fashion MNIST dataset has been chosen as a rich data source. Models developed using Convolutional Neural Networks (CNN) have been trained with various optimization algorithms such as Nadam, Adadelta, Adamax, Adam, Adagrad, SGD, and RMSprop. Understanding the impact of these algorithms on the model\\\'s performance during the training process forms the basis of the study. The findings of the research reveal that optimization algorithms have a significant effect on the accuracy rates of the model. While the Nadam and Adadelta algorithms achieved the highest accuracy rates, the RMSprop algorithm displayed relatively lower performance. These results indicate that different optimization techniques can significantly influence the performance of deep learning-based classification systems.
Keywords : Convolutional Neural Networks (CNN), Fashion MNIST, Optimization Algorithms, Adam, RMSprop