A copy of this work was available on the public web and has been preserved in the Wayback Machine. The capture dates from 2020; you can also visit the original URL.
The file type is application/pdf
.
Filters
Meta-Learning Requires Meta-Augmentation
[article]
2020
arXiv
pre-print
We describe both of these forms of metalearning overfitting, and demonstrate that they appear experimentally in common meta-learning benchmarks. ...
This additional level of learning can be powerful, but it also creates another potential source for overfitting, since we can now overfit in either the model or the base learner. ...
Acknowledgments and Disclosure of Funding We thank Mingzhang Yin and George Tucker for discussion and help in reproducing experimental results for pose regression experiments. ...
arXiv:2007.05549v2
fatcat:ag6nwg3chrbbna2oyqumdgpqdy
Survival Prediction of Heart Failure Patients using Stacked Ensemble Machine Learning Algorithm
[article]
2021
arXiv
pre-print
Advancement in data mining techniques using machine learning (ML) models is paving promising prediction approaches. ...
Moreover, we designed and propose a supervised stacked ensemble learning model that can achieve an accuracy, precision, recall and F1 score of 99.98%. ...
In decision tree-based machine learning techniques, pruning has been shown to be the most effective method of dealing with overfitting [24] . ...
arXiv:2108.13367v1
fatcat:psttoev34rcqnk2le5vlon4lvu
Two Challenges of Correct Validation in Pattern Recognition
2014
Frontiers in Robotics and AI
The core methods for pattern recognition have been developed by machine learning experts but due to their broad success, an increasing number of non-experts are now employing and refining them. ...
In this perspective, I will discuss the challenge of correct validation of supervised pattern recognition systems, in particular when employed by nonexperts. ...
This trend is driven by scientists who are not necessarily experts in machine learning but want to apply machine learning methods in their own application domain. ...
doi:10.3389/frobt.2014.00005
fatcat:fpfzr6ruufdmrk7szm5rhdarqe
Unsupervised Neural Machine Translation for Low-Resource Domains via Meta-Learning
[article]
2021
arXiv
pre-print
To address this issue, this paper presents a novel meta-learning algorithm for unsupervised neural machine translation (UNMT) that trains the model to adapt to another domain by utilizing only a small ...
Hence, we extend the meta-learning algorithm, which utilizes knowledge learned from high-resource domains, to boost the performance of low-resource UNMT. ...
Meta Learning Given a small amount of training data, most of machine learning models are prone to overfitting, thus failing to find a generalizable solution. ...
arXiv:2010.09046v2
fatcat:2iquah5dufgwfdnzl2kvq7gkl4
L2AE-D: Learning to Aggregate Embeddings for Few-shot Learning with Meta-level Dropout
[article]
2019
arXiv
pre-print
(b) We also introduce a simple meta-level dropout technique that reduces meta-level overfitting in several few-shot learning approaches. ...
In our experiments, we find that this simple technique significantly improves the performance of the proposed method as well as various state-of-the-art meta-learning algorithms. ...
Overfitting can easily occur using conventional machine learning algorithms in such few-shot regime. To avoid this, we need a learning approach with a high generalisation ability. ...
arXiv:1904.04339v1
fatcat:36m2yw5gifconji4ad7tyydryu
Current applications of machine learning in the screening and diagnosis of glaucoma: a systematic review and Meta-analysis
2020
International Journal of Ophthalmology
A Meta-analysis of diagnostic accuracy in terms of area under the receiver operating curve (AUROC) was performed. ...
To compare the effectiveness of two well described machine learning modalities, ocular coherence tomography (OCT) and fundal photography, in terms of diagnostic accuracy in the screening and diagnosis ...
DISCUSSION Meta-Analysis The findings of this Meta-analysis have indicated that there is no statistically significant difference with respect to machine learning between fundal photos and OCT images in ...
doi:10.18240/ijo.2020.01.22
pmid:31956584
pmcid:PMC6942952
fatcat:oykjqjtkf5evlc4nwomyfjhltq
Meta-Regularization by Enforcing Mutual-Exclusiveness
[article]
2021
arXiv
pre-print
It is the second objective where meta-learning models fail for non-mutually exclusive tasks due to task overfitting. ...
A direct observable consequence of this memorization is that the meta-learning model simply ignores the task-specific training data in favor of directly classifying based on the test-data input. ...
The primary contribution of our work consists of: 1. Identification and analysis of task-memorization in black-box and optimization based meta learning models. 2. ...
arXiv:2101.09819v1
fatcat:mzhw5agqmfa5zfvgfxq64fmuau
Meta-Learning of Evolutionary Strategy for Stock Trading
2020
Journal of Data Analysis and Information Processing
We found that our meta-learning approach to stock trading earns profits similar to a purely evolutionary algorithm. ...
If achieved, these benefits expand the flexibility of traditional machine learning to areas where there are small windows of time or data available. ...
Conflicts of Interest The authors declare no conflicts of interest regarding the publication of this paper. ...
doi:10.4236/jdaip.2020.82005
fatcat:odgb5p7qbncodk6k2m4l35x2tu
Company bankruptcy prediction framework based on the most influential features using XGBoost and stacking ensemble learning
2021
International Journal of Power Electronics and Drive Systems (IJPEDS)
The prediction analysis process uses the best feature selection and ensemble learning. The best feature selection is selected using feature importance to XGBoost with a weight value filter of 10. ...
The ensemble learning method used is stacking. Stacking is composed of the base model and meta learner. ...
Meta learner is a machine learning algorithm that is used to analyze and combine the results of each base model in order to obtain a better prediction rate from the base model. ...
doi:10.11591/ijece.v11i6.pp5549-5557
fatcat:wikphdxuwjfkri6ietmrg227tq
Special Issue: Regularization Techniques for Machine Learning and Their Applications
2022
Electronics
Its primary goal is to make the machine learning algorithm "learn" and not "memorize" by penalizing the algorithm to reduce its generalization error in order to avoid the risk of overfitting. ...
Regularization is probably the key to address the challenging problem of overfitting, which usually occurs in high-dimensional learning. ...
Conflicts of Interest: The guest editors declare no conflict of interest. ...
doi:10.3390/electronics11040521
doaj:9ffdcf45e0c84dc58f6cdc8ff87c96af
fatcat:zj6cfr2jkngelmu5d4arw3u6yi
Accuracy of Computer-Aided Diagnosis of Melanoma
2019
JAMA dermatology
The recent advances in the field of machine learning have raised expectations that computer-aided diagnosis will become the standard for the diagnosis of melanoma. ...
Studies were heterogeneous and substantial risk of bias was found in all but 4 of the 70 studies included in the quantitative analysis. ...
Overfitting is an inherent problem of machine learning resulting in lack of generalizability, especially if the training set and the test set are different from the group of lesions encountered in clinical ...
doi:10.1001/jamadermatol.2019.1375
pmid:31215969
pmcid:PMC6584889
fatcat:h66li4nmu5hebmazif3bs3twdq
A Fusion Framework for Forecasting Financial Market Direction Using Enhanced Ensemble Models and Technical Indicators
2021
Mathematics
The aim of our study was to propose and select a predictive model whose training and testing accuracy difference was minimal in all stocks. ...
As a result, a proper model selection might allow investors the freedom to invest in a certain stock in order to successfully control risk and create short-term, sustainable profits. ...
Acknowledgments: Jana Shafi would like to thank the Deanship of Scientific Research, Prince Sattam bin Abdul Aziz University, for supporting this work. ...
doi:10.3390/math9212646
fatcat:galxtxhovjfvtcf2b4hkhlslwu
SIAMCAT: user-friendly and versatile machine learning workflows for statistically rigorous microbiome analyses
[article]
2020
bioRxiv
pre-print
Based on a large meta-analysis of gut microbiome studies, we optimized the choice of ML algorithms and preprocessing routines for default workflow settings. ...
Here, we present the SIAMCAT R package, a versatile and user-friendly toolbox for comparative metagenome analyses using machine learning (ML), statistical tests, and visualization. ...
Costea, and Kersten Breuer for helpful discussions and advice on the implementation of SIAMCAT. ...
doi:10.1101/2020.02.06.931808
fatcat:jraubeuycrbt5chykvybdlzzuy
Metappearance: Meta-Learning for Visual Appearance Reproduction
[article]
2022
arXiv
pre-print
We suggest to combine both techniques end-to-end using meta-learning: We over-fit onto a single problem instance in an inner loop, while also learning how to do so efficiently in an outer-loop that builds ...
The second approach does not train a model that generalizes across the data, but overfits to a single instance of a problem, e.g., a flash image of a material. ...
ACKNOWLEDGMENTS This work was supported by Meta Reality Labs, Grant Nr. 5034015. ...
arXiv:2204.08993v1
fatcat:smqkgpmtpfcwzmodzbrlx3tz6u
The rationale for ensemble and meta-algorithmic architectures in signal and information processing
2015
APSIPA Transactions on Signal and Information Processing
Combined, these examples illustrate a new meta-architectural approach to the creation of machine intelligence systems. ...
Starting with the mature field of ensemble methods and moving to the more-recently introduced field of meta-algorithmics, systems can be designed which are by nature to specifically incorporate new machine-learning ...
Regardless, this approach often prevents overfitting, and as the AdaBoost [6, 7] algorithm has certainly proven accurate in a number of machine-learning problems. ...
doi:10.1017/atsip.2015.10
fatcat:7jijiyw3wnch3csp7mvxybzjxy
« Previous
Showing results 1 — 15 out of 12,444 results