2,946 Hits in 3.2 sec

Deep learning based question answering system in Bengali

Tasmiah Tahsin Mayeesha, Abdullah Md Sarwar, Rashedur M. Rahman
2020 Journal of Information and Telecommunication  
Recent advances in the field of natural language processing has improved state-of-the-art performances on many tasks including question answering for languages like English.  ...  Unlike English, there is no benchmark large scale QA dataset collected for Bengali, no pretrained language model that can be modified for Bengali question answering and no human baseline score for QA has  ...  His current research interests are in data science, cloud load characterization, optimization of cloud resource placements, deep learning, etc.  ... 
doi:10.1080/24751839.2020.1833136 fatcat:ltwrsufie5hrrezjtv2tu56fjy

A Hybrid Approach Towards Two Stage Bengali Question Classification Utilizing Smart Data Balancing Technique [article]

Md. Hasibur Rahman, Chowdhury Rafeed Rahman, Ruhul Amin, Md. Habibur Rahman Sifat, Afra Anika
2020 arXiv   pre-print
Question Classification (QC) system classifies the questions in particular classes so that Question Answering (QA) System can provide correct answers for the questions.  ...  Our system categorizes the factoid type questions asked in natural language after extracting features of the questions. We present a two stage QC system for Bengali.  ...  Conclusion We have introduced a two stage approach for Bengali question classificationa deep learning based approach in the first stage and a gradient descent based approach in the second stage.  ... 
arXiv:1912.00127v3 fatcat:z5oxqkakybctnm7o2sz5acwwja

A Comprehensive Comparison of Machine Learning Based Methods Used in Bengali Question Classification [article]

Afra Anika, Md. Hasibur Rahman, Salekul Islam, Abu Shafin Mohammad Mahdee Jameel, Chowdhury Rafeed Rahman
2019 arXiv   pre-print
We present a comprehensive comparison (performance and computational complexity) among some machine learning based approaches used in QC for Bengali language.  ...  QA classification system maps questions asked by humans to an appropriate answer category. A sound question classification (QC) system model is the pre-requisite of a sound QA system.  ...  Future work should aim at developing a richer corpus of Bengali questions which will help in getting better vector representation of words and thus will facilitate deep learning based automatic feature  ... 
arXiv:1911.03059v2 fatcat:lrgmougc6rcjbixsugopvuufhi

Code mixed cross script factoid question classification - A deep learning approach

Somnath Banerjee, Sudip Naskar, Paolo Rosso, Sivaji Bandyopadhyay, David Pinto, Vivek Kumar Singh, Aline Villavicencio, Philipp Mayr-Schlegel, Efstathios Stamatatos
2018 Journal of Intelligent & Fuzzy Systems  
for less-computerized languages to build question answering systems.  ...  We combine deep learning framework with feature engineering to address the question classification task and enhance the state-of-the-art question classification accuracy by over 4% for code-mixed cross-script  ...  In this paper, we studied the question classification task on Bengali-English CMCS data by employing a CNN based deep learning framework.  ... 
doi:10.3233/jifs-169481 fatcat:c4nvgunbqvefhjqtufzh6stpja

Transformer Based Bengali Chatbot Using General Knowledge Dataset [article]

Abu Kaisar Mohammad Masum, Sheikh Abujar, Sharmin Akter, Nushrat Jahan Ria, Syed Akhter Hossain
2021 arXiv   pre-print
In this research, we applied the transformer model for Bengali general knowledge chatbot based on the Bengali general knowledge Question Answer (QA) dataset.  ...  RNN model regularly used for determining the sequence-related problem like a question and it answers. This approach acquainted with everyone as seq2seq learning.  ...  Dataset properties For the research, we used Bengali general knowledge-based question answering dataset. The dataset contains three attributes.  ... 
arXiv:2111.03937v2 fatcat:lqbpqs7tkbhcbeugomeap53ika

Classifier combination approach for question classification for Bengali question answering system

Somnath Banerjee, Sudip Kumar Naskar, Paolo Rosso, Sivaji Bndyopadhyay
2019 Sadhana (Bangalore)  
task in Bengali.  ...  Question classification (QC) is a prime constituent of automated question answering system.  ...  Introduction A Question Answering (QA) system is an automatic system capable of answering natural language questions in a humanlike manner: with a concise, precise answer.  ... 
doi:10.1007/s12046-019-1224-8 fatcat:xlrnw2vwhvaqzoi7rt3ae53lbi

Enhancing the Performance of Semantic Search in Bengali using Neural Net and other Classification Techniques

2020 International Journal of Engineering and Advanced Technology  
This research is extremely useful for the automatic question answering system, semantic similarity analysis, e-governance and m- governance.  ...  However, it can happen that the user query or question and the best available answer or result in the internet domain has no terms in common or ignorable number of terms is common.  ...  ACKNOWLEDGMENT We sincerely express our gratitude to Professor N S Dash of the Language Research Unit (LRU) of ISI Kolkata for providing his valuable time to evaluate the performance of the system.  ... 
doi:10.35940/ijeat.b3566.029320 fatcat:hn455gvovrchhclo7s3nxzflne

Cross-lingual Offensive Language Identification for Low Resource Languages: The Case of Marathi [article]

Saurabh Gaikwad, Tharindu Ranasinghe, Marcos Zampieri, Christopher M. Homan
2021 arXiv   pre-print
in Bengali, English, and Hindi.  ...  The widespread presence of offensive language on social media motivated the development of systems capable of recognizing such content automatically.  ...  In these experiments, however, the transfer learning's base language was English whereas here we use two languages related to Marathi: Bengali and Hindi, in order to evaluate the extent to which language  ... 
arXiv:2109.03552v1 fatcat:bliymnqtgfbgtfa2xwkgxiygzy

SMT vs NMT: A Comparison over Hindi & Bengali Simple Sentences [article]

Sainik Kumar Mahata, Soumil Mandal, Dipankar Das, Sivaji Bandyopadhyay
2018 arXiv   pre-print
We have tried to answer two important questions: 1. Does NMT perform equivalently well with respect to SMT and 2.  ...  All of the systems use English-Hindi and English-Bengali language pairs containing simple sentences as well as sentences of other complexity.  ...  Table 3 : 3 Confusion matrix for deep learning based approach.  ... 
arXiv:1812.04898v1 fatcat:xgo73x6w3vbg5glut77o3hi3j4

MuCoT: Multilingual Contrastive Training for Question-Answering in Low-resource Languages [article]

Gokul Karthik Kumar, Abhishek Singh Gehlot, Sahal Shaji Mullappilly, Karthik Nandakumar
2022 arXiv   pre-print
Accuracy of English-language Question Answering (QA) systems has improved significantly in recent years with the advent of Transformer-based models (e.g., BERT).  ...  However, directly training an mBERT-based QA system for low-resource languages is challenging due to the paucity of training data.  ...  We utilize modern open-source deep learning models to translate the ChAII dataset into different languages from two language families namely, Dravidian, and Indo-Aryan, and use them to improve the question-answering  ... 
arXiv:2204.05814v1 fatcat:xtipucxr5vfqbbsm3l4f6l7di4

Deep Learning-Based Language Identification in English-Hindi-Bengali Code-Mixed Social Media Corpora

Anupam Jamatia, Amitava Das, Björn Gambäck
2018 Journal of Intelligent Systems  
Here, the performance of deep learning on this task is compared to feature-based learning, with two Recursive Neural Network techniques, Long Short Term Memory (LSTM) and bidirectional LSTM, being contrasted  ...  This article addresses language identification at the word level in Indian social media corpora taken from Facebook, Twitter and WhatsApp posts that exhibit code-mixing between English-Hindi, English-Bengali  ...  Deep Learning-Based Approach A recurrent neural network (RNN) is a deep learning approach where the recurrent connections are loops in the network that allow it to maintain a memory based on history information  ... 
doi:10.1515/jisys-2017-0440 fatcat:o6yxge7rzne3lcrgtm7hedrsyi

A Systematic Literature Review on Text Generation Using Deep Neural Network Models

Noureen Fatima, Ali Shariq Imran, Zenun Kastrati, Sher Muhammad Daudpota, Abdullah Soomro, Sarang Shaikh
2022 IEEE Access  
To the best of our knowledge, there is a lack of extensive review and up-to-date body of knowledge of text generation deep learning models.  ...  In the end, we provide some future directions for researchers and guidelines for practitioners based on the findings of this review.  ...  , dataset balancing [6] , [7] , next word prediction & text suggestion in chatting, generation of answers to questions in question answering system, in chatbots [8] , [9] , machine learning translation  ... 
doi:10.1109/access.2022.3174108 fatcat:662z5imliba2zosgrqdhm55dcy

A Novel Approach to Enhance the Performance of Semantic Search in Bengali using Neural Net and other Classification Techniques [article]

Arijit Das, Diganta Saha
2020 arXiv   pre-print
Our system has achieved the efficiency to predict the correct semantics using knowledge base over the time of learning.  ...  An available Bengali repository was chosen to have seven types of semantic properties primarily to develop the system.  ...  He being the renowned linguist also helped in evaluation.  ... 
arXiv:1911.01256v2 fatcat:ui5oscjjc5bgjftpcjdtxijc7e

Ishwar Chandra Vidyasagar's Contribution in the Development of Bengali Language and Literature and Its Relevance in Present Context

Roni Ghosh
2018 Asian Review of Social Sciences  
He is known not only for his contribution in the field of educational and social reformation, but also for his literary works and contribution in the development of modern Bengali language.  ...  So, the researcher aims to find out the literary works of Ishwar Chandra, his contributions in the development of modern Bengali language and its present day relevancy in education.  ...  He has made unforgettable contribution in the social reformation, educational reformation and development of Bengali literature.  ... 
doi:10.51983/arss-2018.7.2.1439 fatcat:c4fhxdgstbaxtei3aa4vg5ahie

SD-QA: Spoken Dialectal Question Answering for the Real World [article]

Fahim Faisal, Sharlina Keshava, Md Mahfuz ibn Alam, Antonios Anastasopoulos
2021 arXiv   pre-print
Question answering (QA) systems are now available through numerous commercial applications for a wide variety of domains, serving millions of users that interact with them via speech interfaces.  ...  in 24 dialects from 255 speakers.  ...  Towards more equitable question answering systems: How much more data do you need?  ... 
arXiv:2109.12072v1 fatcat:pyy66fqphjb3fnw2lsk52eeovq
« Previous Showing results 1 — 15 out of 2,946 results