88,218 Hits in 6.4 sec

Text Mining an Automatic Short Answer Grading (ASAG), Comparison of Three Methods of Cosine Similarity, Jaccard Similarity and Dice's Coefficient

Tri wahyuningsih
2021 Journal of Applied Data Sciences  
This study aims to find correlation assessment of Automatic Short Answer Grading (ASAG) by comparing three methods of Cosine Similarity, Jaccard Similarity and Dice Coefficient by providing one reference  ...  The contribution to this study is the use of three methods in one data, whereas the previous research only used 1 method for 1 data or 2 methods for 1 data.  ...  The purpose of this study was to provide a score against the similarity of short answers in the type of short answer that uses Indonesian by comparing cosine similarity, Jaccard Similarity and Dice's Coefficient  ... 
doi:10.47738/jads.v2i2.31 fatcat:47sykyhwvjfszhmzwvpau3ccqy

Automatic Essay Answer Rating Using the Text Similarity Method

Cokorda Gde Abimanyu, Ngurah Agus Sanjaya ER
2020 Jurnal Elektronik Ilmu Komputer Udayana  
We then measure the similarity between the documents by calculating the cosine similarity of the two vectors. The cosine similarity values are converted back again and used as the final grades.  ...  In this reasearch, we propose an automatic method of assessing essay answers by applying the cosine similarity method.  ...  Until now no one has made an online essay type test (essay), and there are not many methods used for the assessment of item type description.  ... 
doi:10.24843/jlk.2020.v08.i04.p12 fatcat:xnkphynyfjav5hshe5xj2e36bu

A Combination of Text Similarity And Latent Semantic Analysis (LSA) Methods In Automatic Scoring Essay

2019 International Journal of Engineering and Advanced Technology  
Automated essay assessment method used in this study is a combination of Text Similarity and Latent Semantic Analysis (LSA) to look for a match and similarity level student answers with the answer key  ...  Description of type exam (essay) is considered by many experts as the most appropriate test to reap the results of a complex learning activities, because essay writing will involve the student's ability  ...  ACKNOWLEDGEMENT The authors wish to thank for all member of RPL LABS. This work was supported by integrated laboratory Faculty of Computer Science, Universitas Muslim Indonesia.  ... 
doi:10.35940/ijeat.e1206.0585c19 fatcat:rsdkogf7ezbhfclrw5mq5jt3ey

Bug Report Classification based on Vector Space Model

Chen Lele, Huang Song, Sun Jinlei, Hui Zhanwei, Yang Sen
2019 International Journal of Performability Engineering  
The vector space model is used to calculate the similarity between the two, and the correctness of the bug report is detected based on this.  ...  Therefore, this paper proposes an automatic detection modus for bug reports based on the vector space model.  ...  Acknowledgements The project is supported by the National Key Research and Development Program of China (No. 2018YFB1403400).  ... 
doi:10.23940/ijpe.19.08.p6.20712080 fatcat:u347kcishfhb7pjo65757ottxe

Automatic Online Subjective Text Evaluation using Text Mining

2019 International journal of recent technology and engineering  
Similarity technique has used for generate similarity score between test answer and train answer data.  ...  Artificial Neural Network (ANN) has used to generate the similarity score between two features vectors.  ...  The main objectives of this study is to evaluate the student descriptive type answers using the NLP and ANN algorithm and to design a tool for evaluation of the student descriptive type answer using the  ... 
doi:10.35940/ijrte.i8725.078219 fatcat:nz5yp3qmqvhhjffdb2hpu7rzl4

Weighing Students Narrative Answers using NLP-RAKE Algorithm

B. Tharun Kumar
2021 International Journal for Research in Applied Science and Engineering Technology  
But mostly existing portals are designed to conduct tests that contain multiple choice Questions. So, the aim of this project is to evaluate marks for Descriptive Answers.  ...  The Examination portals that are deployed over several servers are used to conduct online Examination for various purposes among which some may include conducting a test for Entrance Examinations, or Olympiads  ...  Figure 1 Two types of text summarization techniques are used for generating the summary.  ... 
doi:10.22214/ijraset.2021.36449 fatcat:kupt2ku2xrbhdczwewjzz4bhrm

Re-evaluating Automatic Metrics for Image Captioning [article]

Mert Kilickaya, Aykut Erdem, Nazli Ikizler-Cinbis, Erkut Erdem
2016 arXiv   pre-print
The task of generating natural language descriptions from images has received a lot of attention in recent years.  ...  Our findings outline the differences and/or similarities between metrics and their relative robustness by means of extensive correlation, accuracy and distraction based evaluations.  ...  This work is supported in part by The Scientific and Technological Research Council of Turkey (TUBITAK), with award no 113E116.  ... 
arXiv:1612.07600v1 fatcat:6hgx53sc7feopnnv2lcr6bkadu

Re-evaluating Automatic Metrics for Image Captioning

Mert Kilickaya, Aykut Erdem, Nazli Ikizler-Cinbis, Erkut Erdem
2017 Proceedings of the 15th Conference of the European Chapter of the Association for Computational Linguistics: Volume 1, Long Papers  
The task of generating natural language descriptions from images has received a lot of attention in recent years.  ...  Our findings outline the differences and/or similarities between metrics and their relative robustness by means of extensive correlation, accuracy and distraction based evaluations.  ...  This work is supported in part by The Scientific and Technological Research Council of Turkey (TUBITAK), with award no 113E116.  ... 
doi:10.18653/v1/e17-1019 dblp:conf/eacl/KilickayaEIE17 fatcat:vjc2thf4ljb5bdpyj75nmj7szq

Comparing Automatic Evaluation Measures for Image Description

Desmond Elliott, Frank Keller
2014 Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers)  
The evaluation of computer-generated text is a notoriously difficult problem, however, the quality of image descriptions has typically been measured using unigram BLEU and human judgements.  ...  The focus of this paper is to determine the correlation of automatic measures with human judgements for this task.  ...  Calen Walshe, and the anonymous reviewers provided valuable feedback on this paper. The research is funded by ERC Starting Grant SYNPROC No. 203427.  ... 
doi:10.3115/v1/p14-2074 dblp:conf/acl/ElliottK14 fatcat:xgofqbu7b5fvfgyjpa6sqhnujm

Application of an Automatic Plagiarism Detection System in a Large-scale Assessment of English Speaking Proficiency

Xinhao Wang, Keelan Evanini, Matthew Mulholland, Yao Qian, James V. Bruno
2019 Proceedings of the Fourteenth Workshop on Innovative Use of NLP for Building Educational Applications  
Classification models were trained to distinguish between plagiarized and nonplagiarized responses with two different types of features: text-to-text content similarity measures, which are commonly used  ...  in an F1-score of 0.761 on the plagiarized class.  ...  1, and then the maximum score across all sources is calculated as a feature to measure the similarity between a test and the set of source materials.  ... 
doi:10.18653/v1/w19-4445 dblp:conf/bea/WangEMQB19 fatcat:gxkx325lyvbt7iicuqknk5n7fm

Identifying Critical Features for Formative Essay Feedback with Artificial Neural Networks and Backward Elimination [chapter]

Mohsin Abbas, Peter van Rosmalen, Marco Kalz
2019 Lecture Notes in Computer Science  
Irrelevant features were eliminated based on the inter-rater agreement between predicted and human scores calculated using Cohen's Kappa (κ).  ...  In this study, the intent was to find a small number of features that exhibit a fair proxy of the scores given by the human raters.  ...  Educational Testing Services (ETS) uses E-rater [12] to automatically score GMAT essays. In order to provide scores, E-rater uses a huge corpus of graded responses to train its system.  ... 
doi:10.1007/978-3-030-29736-7_30 fatcat:th3m62e72bb2bmw4ay4rdlfciy

Text Summarization using QA Corpus for User Interaction Model QA System

Karpagam K., College of Engineering & Technology, Pollachi, Saradha A., Manikandan K., Madusudanan K., Institute of Road Transport and Technology, Erode, Vellore Institute of Technology, Vellore, College of Engineering & Technology, Pollachi
2020 International Journal of Education and Management Engineering  
Results obtained from statistical significance test with hypothesis testing and evaluation with standard metrics proves the significant improvement in generating text summarization using QA corpus.  ...  To reduce the response time summary generation, QA corpus is built for similar questions and answer with help of learning model. It has been trained and tested by Quora duplicate and Yahoo!  ...  Avg-Precision for questions which is used to calculate the average score of all question asked by the user.  ... 
doi:10.5815/ijeme.2020.03.04 fatcat:wokhamjdo5fwvhf5ojtmovntxy

Latent Semantic Based Fuzzy Kernel Support Vector Machine for Automatic Content Summarization

T. Vetriselvi, J. Albert Mayan, K. V. Priyadharshini, K. Sathyamoorthy, S. Venkata Lakshmi, P. Vishnu Raja
2022 Intelligent Automation and Soft Computing  
Content summarization selects and extracts the related sentence depends upon the calculation of the score and rank of the corpus.  ...  Automatic content summarization technique translates from the higher corpus into smaller concise description.  ...  In content summarization, cosine similarity measures are one of the most commonly used similarity measures.  ... 
doi:10.32604/iasc.2022.025235 fatcat:jyvfgvfuajaybop6uuscx4kkh4

The tool for the automatic analysis of text cohesion (TAACO): Automatic assessment of local, global, and text cohesion

Scott A. Crossley, Kristopher Kyle, Danielle S. McNamara
2015 Behavior Research Methods  
This study introduces the Tool for the Automatic Analysis of Cohesion (TAACO), a freely available text analysis tool that is easy to use, works on most operating systems (Windows, Mac, and Linux), is housed  ...  on a user's hard drive (rather than having an Internet interface), allows for the batch processing of text files, and incorporates over 150 classic and recently developed indices related to text cohesion  ...  Author note We thank our expert raters for their assistance in scoring the essays used in this study.  ... 
doi:10.3758/s13428-015-0651-7 pmid:26416138 fatcat:2xjzvhkijfejrnzx63miqocdwe

Automatic Scoring on English Passage Reading Quality [chapter]

Junbo Zhang, Fuping Pan, Yongyong Yan
2012 Lecture Notes in Computer Science  
In this paper we studied the computer automatic scoring for English discourse oral reading.  ...  In the testing of English discourse oral reading for 4000 middle school students, in which the materials of 3200 students were used to train and the rest of 800 students to test, we got a good result that  ...  Acknowledgements This work is partially supported by the National Natural Science Foundation of China (No. 10925419, 90920302, 10874203, 60875014, 61072124, 11074275, 11161140319) .  ... 
doi:10.1007/978-3-642-31020-1_3 fatcat:jq24glkgonhg5hc232nlo6iy2u
« Previous Showing results 1 — 15 out of 88,218 results