Boosting Multi-Task Weak Learners with Applications to Textual and Social Data

Jean Baptiste Faddoul, Boris Chidlovskii, Fabien Torre, Remi Gilleron
2010 2010 Ninth International Conference on Machine Learning and Applications  
Learning multiple related tasks from data simultaneously can improve predictive performance relative to learning these tasks independently. In this paper we propose a novel multi-task learning algorithm called MT-Adaboost: it extends Ada boost algorithm [1] to the multi-task setting; it uses as multi-task weak classifier a multi-task decision stump. This allows to learn different dependencies between tasks for different regions of the learning space. Thus, we relax the conventional hypothesis
more » ... at tasks behave similarly in the whole learning space. Moreover, MT-Adaboost can learn multiple tasks without imposing the constraint of sharing the same label set and/or examples between tasks. A theoretical analysis is derived from the analysis of the original Adaboost. Experiments for multiple tasks over large scale textual data sets with social context (Enron and Tobacco) give rise to very promising results.
doi:10.1109/icmla.2010.61 dblp:conf/icmla/FaddoulCTG10 fatcat:wo7lsfz27nbhlabzzeiyb3bz4m