3,120 Hits in 5.2 sec

An Analysis of a BERT Deep Learning Strategy on a Technology Assisted Review Task

Alexandros Ioannidis
2021 Zenodo  
ranking of the articles with the aforementioned datasets, for the CLEF eHealth Technologically Assisted Reviews in Empirical Medicine Task.  ...  Given the recent advances in DL (Deep Learning) methods applied to IR (Information Retrieval) tasks, I propose a DL document classification approach with BERT (Bidirectional Encoder Representations from  ...  CLEF eHealth Task 2 is the CLEF eHealth Technologically Assisted Reviews in Empirical Medicine Task.  ... 
doi:10.5281/zenodo.4697891 fatcat:w4ks77xkdjfupi47vhsskoh6n4

Fine-tuned BERT Model for Large Scale and Cognitive Classification of MOOCs

Hanane Sebbaq, Nour-eddine El Faddouli
2022 International Review of Research in Open and Distance Learning  
The pedagogical classification of MOOCs is a difficult task, given the variability of MOOCs' content, structure, and designs.  ...  First, we automated the pedagogical annotation of MOOCs on a large scale and based on the cognitive levels of Bloom's taxonomy. Second, we fine-tuned BERT via different architectures.  ...  the assistance of an expert.  ... 
doi:10.19173/irrodl.v23i2.6023 fatcat:vujlpvddg5gsrhwysdrb34ymcm

BERT-Based Sentiment Analysis: A Software Engineering Perspective [article]

Himanshu Batra, Narinder Singh Punn, Sanjay Kumar Sonbhadra, Sonali Agarwal
2021 arXiv   pre-print
The paper presents three different strategies to analyse BERT based model for sentiment analysis, where in the first strategy the BERT based pre-trained models are fine-tuned; in the second strategy an  ...  ensemble model is developed from BERT variants, and in the third strategy a compressed model (Distil BERT) is used.  ...  Acknowledgment We thank our institute, Indian Institute of Information Technology Allahabad (IIITA), India and Big Data Analytics (BDA) lab for allocating the centralised computing facility and other necessary  ... 
arXiv:2106.02581v3 fatcat:grp55d3j3zbf3pg7ri2urechuu

A sentiment analysis model for car review texts based on adversarial training and whole word mask BERT [article]

Xingchen Liu and Yawen Li and Yingxia Shao and Ang Li and Jian Liang
2022 arXiv   pre-print
Based on this, we propose a car review text sentiment analysis model based on adversarial training and whole word mask BERT(ATWWM-BERT).  ...  To overcome these above challenges, we aim at the sentiment analysis task of car review texts.  ...  on the task of car review sentiment analysis.  ... 
arXiv:2206.02389v1 fatcat:f6madd2syvh5zbyxy2nhgd3num

Goldilocks: Just-Right Tuning of BERT for Technology-Assisted Review [article]

Eugene Yang, Sean MacAvaney, David D. Lewis, Ophir Frieder
2022 arXiv   pre-print
Technology-assisted review (TAR) refers to iterative active learning workflows for document review in high recall retrieval (HRR) tasks.  ...  We indeed find that the pre-trained BERT model reduces review cost by 10% to 15% in TAR workflows simulated on the RCV1-v2 newswire collection.  ...  Recently, Ioannidis [21] evaluated BERT and PubMedBERT [17] on CLEF eHealth Technology Assisted Reviews in Empirical Medicine Task [22, 23] .  ... 
arXiv:2105.01044v2 fatcat:sa7mw56p6jahtby2hgnfu4a274

MII: A Novel Text Classification Model Combining Deep Active Learning with BERT

Anman Zhang, Bohan Li, Wenhuan Wang, Shuo Wan, Weitong Chen
2020 Computers Materials & Continua  
In this paper, we proposed a deep active learning model with bidirectional encoder representations from transformers (BERT) for text classification.  ...  As for the process of active learning, we design an instance selection strategy based on posterior probabilities Margin, Intra-correlation and Inter-correlation (MII).  ...  Overall, deep neural network BERT assists sampling strategy MII in obtaining the informative instances. The combination of BERT and MII can provide a better text representation than other methods.  ... 
doi:10.32604/cmc.2020.09962 fatcat:wc7fn6cs4nh3pe3kxsafwelbpi

Machine Learning Technologies for Big Data Analytics

Amir H. Gandomi, Fang Chen, Laith Abualigah
2022 Electronics  
Big data analytics is one high focus of data science and there is no doubt that big data is now quickly growing in all science and engineering fields [...]  ...  This review study employs a quantitative method and structural equation modeling for data analysis. The findings demonstrated a small prevalence range that is more reliant on cyberstalking.  ...  Furthermore, attempts are made in this research to design and create a sentiment analyzer based on deep learning.  ... 
doi:10.3390/electronics11030421 fatcat:edke2kl4sze2vbxg2k7kljhuca

Target-Dependent Sentiment Classification with BERT

Zhengjie Gao, Ao Feng, Xinyu Song, Xi Wu
2019 IEEE Access  
INDEX TERMS Deep learning, neural networks, sentiment analysis, BERT. 154290 This work is licensed under a Creative Commons Attribution 4.0 License.  ...  Research on machine assisted text analysis follows the rapid development of digital media, and sentiment analysis is among the prevalent applications.  ...  We find that DCU and NRC-Canada, although not utilizing any advanced deep learning technology or embedding representation, result in strong performance.  ... 
doi:10.1109/access.2019.2946594 fatcat:2yaywicaxzaglpvuqd53psuudy

Traditional and Deep Learning Approaches for Sentiment Analysis: A Survey

Fatima-Ezzahra Lagrari, Youssfi Elkettani
2021 Advances in Science, Technology and Engineering Systems  
Of late, deep learning algorithms have shown endless promises for a variety of sentiment analysis.  ...  In this paper, we review classical and deep learning approaches that have been applied to various sentiment analysis tasks and their evolution over last years and provide performance analysis of different  ...  We offered an application and performance analysis on a variety of real-world sentiment analysis datasets.  ... 
doi:10.25046/aj060501 fatcat:cus5jwvtj5eitn5c5z7nqkyn5e

Social Influence-based Attentive Mavens Mining and Aggregative Representation Learning for Group Recommendation [article]

Peipei Wang, Lin Li, Yi Yu, Guandong Xu
2019 arXiv   pre-print
In addition, we develop a BERT-based representation method to learn the interaction of group members.  ...  To tackle the issue of preference aggregation for group recommendation, we propose a novel attentive aggregation representation learning method based on sociological theory for group recommendation, namely  ...  A large number of literatures [34, 35, 36] have applied deep learning technology to the recommender systems for different recommendation tasks.  ... 
arXiv:1909.01079v1 fatcat:752a5smw4rboxgoq7antwtbmnm

Transfer Learning for Multi-lingual Tasks – a Survey [article]

Amir Reza Jafari, Behnam Heidary, Reza Farahbakhsh, Mostafa Salehi, Mahdi Jalili
2021 arXiv   pre-print
In this survey, we provide a comprehensive overview of the existing literature with a focus on transfer learning techniques in multilingual tasks.  ...  In this era, understanding cross languages content and multilingualism in natural language processing (NLP) are hot topics, and multiple efforts have tried to leverage existing technologies in NLP to tackle  ...  A year after BERT, Facebook introduced a new optimized method called "RoBERTa" based on the masking strategy used in Bert and changed a number of key parameters in that model.  ... 
arXiv:2110.02052v1 fatcat:42k7enhfynfgbabihvgf5qpa2m

A Review of the Trends and Challenges in Adopting Natural Language Processing Methods for Education Feedback Analysis

Thanveer Shaik, Xiaohui Tao, Yan Li, Christopher Dann, Jacquie McDonald, Petrea Redmond, Linda Galligan
2022 IEEE Access  
This review article presents an overview of AI's impact on education outlining with current opportunities.  ...  Machine learning, deep learning, and natural language processing (NLP) are subsets of AI to tackle different areas of data processing and modelling.  ...  Li, formal analysis: T. Shaik and X. Tao, investigation: T. Shaik, X. Tao, Y.  ... 
doi:10.1109/access.2022.3177752 fatcat:fqc5337phndufia2lofgsg3bzi

Cross-Domain End-To-End Aspect-Based Sentiment Analysis with Domain-Dependent Embeddings

Yingjie Tian, Linrui Yang, Yunchuan Sun, Dalian. Liu, Zhihan Lv
2021 Complexity  
It used to be treated as a group of pipeline tasks but has been proved to be analysed well in an end-to-end model recently.  ...  Among them, aspect-based sentiment analysis plays an important role in subtle opinion mining for online reviews.  ...  Acknowledgments is work was partially supported by grants from the National Natural Science Foundation of China (Nos. 12071458, 71731009).  ... 
doi:10.1155/2021/5529312 fatcat:sqrl7n4oanh3bh46mo3tc3lwiy

A Thousand Words Express a Common Idea? Understanding International Tourists' Reviews of Mt. Huangshan, China, through a Deep Learning Approach

Cheng Chai, Yao Song, Zhenzhen Qin
2021 Land  
Through a state-of-the-art natural language processing network (BERT) analyzing posted reviews across international tourists, our results facilitate relevant landscape development and design decisions.  ...  The motivation of the present study is to understand international tourists' online reviews of Mt. Huangshan in China.  ...  Conflicts of Interest: The authors declare no conflict of interest.  ... 
doi:10.3390/land10060549 doaj:964ca6fbe9da4cd9855d51f69fc23647 fatcat:n7obbxvx5rbkrnxesounmgrj4e

Fake or Genuine? Contextualised Text Representation for Fake Review Detection [article]

Rami Mohawesh, Shuxiang Xu, Matthew Springer, Muna Al-Hawawreh, Sumbal Maqsood
2021 arXiv   pre-print
Online reviews have a significant influence on customers' purchasing decisions for any products or services. However, fake reviews can mislead both consumers and companies.  ...  These models focused only on linguistic features to detect fake reviews and failed to capture the semantic meaning of the reviews.  ...  reviews based on word contexts.  BERT-Base Case [6]: A BERT-trained model is used to pre-train a deep bidirectional representation of the text that is capable of handling unlabelled data by simultaneously  ... 
arXiv:2112.14343v1 fatcat:bj6pwmcaeje4npyvccuozqayeq
« Previous Showing results 1 — 15 out of 3,120 results