2025· Proceedings of the 1st International Conference on Interdisciplinary Technology & Science Convergence (FusionX Global)· pp. 237-245· 0 citations· 30 references
TL;DR
This study presents a new way to tune hyperparameters that is dynamically adaptive, going beyond static methods, and targets challenges in convergence speed, generalization, and model robustness.
Abstract
: As machine learning applications become more complex, advanced optimization strategies are needed to get the best performance out of neural networks. This study presents a new way to tune hyperparameters that is more flexible than traditional static methods. The growing complexity of modern machine learning applications requires sophisticated optimization techniques to attain peak neural network performance. This study presents a new way to tune hyperparameters that is dynamically adaptive, going beyond static methods. Embracing real-time adjustments during the training process, our methodology targets challenges in convergence speed, generalization, and model robustness. At the forefront of technological developments, our approach will integrate state-of-the-art optimization algorithms to ensure continuous refinement of hyperparameters. As we move into evolving landscapes like edge and quantum computing, this research adds to the continuing discourse on adapting machine learning methodologies to these emerging paradigms. This study reflects not only how the current challenges are being met but also builds a resilient foundation to make the models future-proof for unexpected advances.
Optimization is a critical research area with increasing relevance to machine learning. For a range of machine learning tasks—such as hyperparameter tuning, knowledge transfer, and feature selection—optimization techniques are essential. Hyperparameter tuning, for instance, relies on optimization to identify the ideal...
An improved multi-operator differential evolution algorithm, called NN-IMODE, tailored for comprehensive Feedforward Neural Networks optimization, encompassing the number of hidden layers, neurons per layer, weights, biases, and activation functions, is introduced.
Aridj Ferhat, Farouq Zitouni, Karam M. Sallam et al.· Cluster Computing· 0 citations
This study introduces four strategies to navigate boundary constraints in online optimization algorithms and demonstrates that adopting boundary strategies outperforms the"boundary"strategy.
Deep neural networks are commonly trained using adaptive optimization methods such as Adam because they converge quickly and perform well under stochastic training conditions. Despite these advantages, recent research has revealed several important drawbacks of Adam. In particular, the optimizer tends to converge towar...
Susilo Hariyanto, Siti Khabibah, Retno Putri Dwi Rahmawati et al.· WSEAS Transactions on System...· 0 citations
A comparative analysis of two metaheuristic algorithms — Particle Swarm Optimization and Dwarf Mongoose Optimization — as advanced alternatives for hyperparameter tuning in deep learning models trained on the CIFAR-10 dataset reinforces the potential of metaheuristic-based optimization as a robust framework for hyperpa...
Zulfahmi Syahputra, R. F. Rahmat· JITK (Jurnal Ilmu Pengetahua...· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.