Mitigating Overfitting in Extreme Learning Machine Classifier Through Dropout Regularization release_oxjezcbgfngo3jsgb2ajlcracu

by Fateh Alrahman Kamal Qasem Alnagashi, Norasmadi Abdul Rahim, Shazmin Aniza Abdul Shukor, Mohamad Hanif Ab. Hamid

Published in Applied mathematics and computational intelligence by Penerbit Universiti Malaysia Perlis.

2024   Volume 13, Issue No.1, p26-35

Abstract

Achieving optimal machine learning model performance is often hindered by the limited availability of diverse datasets, a challenge exacerbated by small sample sizes in real-world scenarios. In this study, we address this critical issue in classification tasks by integrating the Dropout technique into the Extreme Learning Machine (ELM) classifier. Our research underscores the effectiveness of Dropout-ELM in mitigating overfitting, especially when data is scarce, leading to enhanced generalization capabilities. Through extensive experiments on synthetic and real-world datasets, our findings consistently demonstrate that Dropout-ELM outperforms traditional ELM, yielding significant accuracy improvements ranging from 0.19% to 16.20%. By strategically implementing dropout during training, we promote the development of robust models that reduce reliance on specific features or neurons, resulting in increased adaptability and resilience across diverse datasets. Ultimately, Dropout-ELM emerges as a potent tool to counter overfitting and bolster the performance of ELM-based classifiers, particularly in scenarios with limited data. Its established efficacy positions it as a valuable asset for enhancing the reliability and generalization of machine learning models, providing a robust solution to the challenges posed by constrained training data.
In application/xml+jats format

Archived Files and Locations

application/pdf   377.7 kB
file_kfvajrg7njerdf3uugqwiyeb5m
ejournal.unimap.edu.my (publisher)
web.archive.org (webarchive)
Read Archived PDF
Preserved and Accessible
Type  article-journal
Stage   published
Date   2024-02-14
Container Metadata
Open Access Publication
Not in DOAJ
In ISSN ROAD
Not in Keepers Registry
ISSN-L:  2289-1315
Work Entity
access all versions, variants, and formats of this works (eg, pre-prints)
Catalog Record
Revision: 67d59229-028e-4c7d-8306-52c100f4574c
API URL: JSON