Manufacturing & Industrial Engineering Faculty Publications
Document Type
Article
Publication Date
2021
Abstract
Hyper-parameters tuning is a key step to find the optimal machine learning parameters. Determining the best hyper-parameters takes a good deal of time, especially when the objective functions are costly to determine, or a large number of parameters are required to be tuned. In contrast to the conventional machine learning algorithms, Neural Network requires tuning hyperparameters more because it has to process a lot of parameters together, and depending on the fine tuning, the accuracy of the model can be varied in between 25%-90%. A few of the most effective techniques for tuning hyper-parameters in the Deep learning methods are: Grid search, Random forest, Bayesian optimization, etc. Every method has some advantages and disadvantages over others. For example: Grid search has proven to be an effective technique to tune hyper-parameters, along with drawbacks like trying too many combinations, and performing poorly when it is required to tune many parameters at a time. In our work, we will determine, show and analyze the efficiencies of a real-world synthetic polymer dataset for different parameters and tuning methods.
Recommended Citation
Hossain, Md Riyad, and Douglas Timmer. "Machine learning model optimization with hyper parameter tuning approach." Global Journal of Computer Science and Technology: D Neural & Artificial Intelligence 21, no. 2 (2021): 31.
Creative Commons License
This work is licensed under a Creative Commons Attribution-NonCommercial-No Derivative Works 4.0 International License.
Publication Title
Global Journal of Computer Science and Technology: D Neural & Artificial Intelligence
Comments
© 2021. Md Riyad Hossain & Dr. Douglas Timmer. This research/review article is distributed under the terms of the AttributionNonCommercial-NoDerivatives 4.0 International (CC BY-NC-ND 4.0). You must give appropriate credit to authors and reference this article if parts of the article are reproduced in any manner. Applicable licensing terms are at https://creativecommons.org/licenses/by-nc-nd/4.0/.