115,727 Hits in 4.6 sec

Automatic Sentence Ordering Assessment Based on Similarity

Liana Ermakova
2016 NTCIR Conference on Evaluation of Information Access Technologies  
Therefore, we propose three completely automatic approaches for sentence order assessment where the similarity between adjacent sentences is used as a measure of text coherence.  ...  We showed that the methods based on word and noun similarities have very high agreement with the human-provided judgment.  ...  Thus, we introduce here three methods for sentence ordering assessment based on similarity measures between the sentences adjacent in the text.  ... 
dblp:conf/ntcir/Ermakova16 fatcat:jwpjsgljwjaqxolus6e4rgc6ai

Automatic Scoring System for Evaluating Comprehensive Answers using key Features (ASCA)

2019 International Journal of Engineering and Advanced Technology  
This paper not only aims to evaluate the answer and also takes care of malpractice by implementing plagiarism and also redundant sentences. Redundant sentences may lead to erroneous grades.  ...  Automatic evaluation of learner's skills is the hot research area in the field of Machine learning.  ...  Sentence ordering score is given to each answer based on how much they differ from the answer key [20] , [22] , [24] . F.  ... 
doi:10.35940/ijeat.f1057.0886s219 fatcat:dk6hqyt3izfkrcwsib35wvpcta

A Metric for Sentence Ordering Assessment Based on Topic-Comment Structure

Liana Ermakova, Josiane Mothe, Anton Firsov
2017 Proceedings of the 40th International ACM SIGIR Conference on Research and Development in Information Retrieval - SIGIR '17  
ABSTRACT Sentence ordering (SO) is a key component of verbal ability. It is also crucial for automatic text generation.  ...  In contrast to that, we present a selfsu cient metric for SO assessment based on text topic-comment structure. We show that this metric has high accuracy.  ...  Smaller permutations in sentence order provoke smaller changes in the score. In general noun-based similarity is less accurate than all term based methods.  ... 
doi:10.1145/3077136.3080720 dblp:conf/sigir/ErmakovaMF17 fatcat:2hat7rkpfbhjdm2gmpjkpgi75e

Pazesh: A Graph-Based Approach to Increase Readability of Automatic Text Summaries [chapter]

Nasrin Mostafazadeh, Seyed Abolghassem Mirroshandel, Gholamreza Ghassem-Sani, Omid Bakhshandeh Babarsad
2011 Lecture Notes in Computer Science  
Today, research on automatic text summarization challenges on readability factor as one of the most important aspects of summarizers' performance.  ...  Pazesh accomplishes this task by constructing a special path of salient sentences which passes through topic centroid sentences.  ...  Yahya Tabesh, Ali Moini for igniting the initial motivation on this research. This research is honoured to be supported by a grant from Iran's National Foundation of Elites.  ... 
doi:10.1007/978-3-642-21043-3_38 fatcat:mc6ik2yvhrboplgdesezy2rjpu

A Comparison of Automatic Summarizers of Texts in Brazilian Portuguese [chapter]

Lucia Helena Machado Rino, Thiago Alexandre Salgueiro Pardo, Carlos Nascimento Silla, Celso Antônio Alves Kaestner, Michael Pombo
2004 Lecture Notes in Computer Science  
Automatic Summarization (AS) in Brazil has only recently become a significant research topic.  ...  In the experiment five distinct extractive AS systems have been assessed.  ...  This procedure works as suggested by [14] , i.e., it is based on the premise that ideal extracts should be composed of as many sentences (the most similar ones) as the ones in the corresponding manual  ... 
doi:10.1007/978-3-540-28645-5_24 fatcat:7vjx6wh6g5gozfjalec4ccuo4m

Prototype of Automatic Essay Assessment and Plagiarism Detection on Mobile Learning "Molearn" Application Using GLSA Method

Julianto Lemantara, M. J. Dewiyani Sunarto, Bambang Hariadi, Tri Sagirani, Tan Amelia
2019 2019 International Seminar on Research of Information Technology and Intelligent Systems (ISRITI)  
GLSA was able to detect sentences that had syntactic errors or missing common words. Based on the evaluation results, this study succeeded in producing a prototype with a better display value.  ...  In addition, the study succeeded in using the GLSA method as a substitute for LSA for creating better prototype essay assessment and automatic plagiarism detection.  ...  GLSA considered the order of the sentence words in the document and maintained the closeness of the words in the sentence. It was not based on document vectors with the bag of words approach.  ... 
doi:10.1109/isriti48646.2019.9034652 fatcat:6dxmxiu3lfhjze3z4ioaarq6sm

Modeling local coherence

Regina Barzilay, Mirella Lapata
2005 Proceedings of the 43rd Annual Meeting on Association for Computational Linguistics - ACL '05  
This paper considers the problem of automatic assessment of local coherence.  ...  We present a novel entity-based representation of discourse which is inspired by Centering Theory and can be computed automatically from raw text.  ...  We are grateful to Claire Cardie and Vincent Ng for providing us the results of their system on our data.  ... 
doi:10.3115/1219840.1219858 dblp:conf/acl/BarzilayL05 fatcat:7s4b2fye5vc4piwb5jh4r62lam

A scoring rubric for automatic short answer grading system

Uswatun Hasanah, Adhistya Erna Permanasari, Sri Suning Kusumawardani, Feddy Setio Pribadi
2019 TELKOMNIKA (Telecommunication Computing Electronics and Control)  
This study aims to assess the sentence similarity of short answer to the questions and answers in Indonesian without any language semantic's tool.  ...  These studies focuses on how to make machines are able to help human on assessing students' learning outcomes.  ...  Research on automatic assessment system for Indonesian language that has been done more focused on long essay answers.  ... 
doi:10.12928/telkomnika.v17i2.11785 fatcat:bcu363zxgne4vieiizo76xf72u

Automatic Essay Scoring in E-learning System Using LSA Method with N-Gram Feature for Bahasa Indonesia

Rico Setiadi Citawan, Viny Christanti Mawardi, Bagus Mulyawan, R.H. Setyobudi, E. Alasaarela, F. Pasila, G. Chan, S.-G. Lee
2018 MATEC Web of Conferences  
In this design aims to create an automatic essay scoring feature on e-learning system that can be used to support the learning process.  ...  For exam questions in the form of essays are rarely used in the evaluation process of educational because of the difference in the subjectivity and time consuming in the assessment process.  ...  So that the assessment system will see the completeness of an answer based on each relationship on a term with a sentence whereas in the manual assessment if there is one sentence correct answer then the  ... 
doi:10.1051/matecconf/201816401037 fatcat:55sdwxb6hrakfnteiwnisbd2q4

A Hybrid Method for Query based Automatic Summarization System

R. V.V.MuraliKrishna, S. Y. Pavan Kumar, Ch. Satyananda Reddy
2013 International Journal of Computer Applications  
Assigning the indexes w.r.t query: fox [2]| jumps [1] |dog[0] Calculation of Word Order Similarity for above two sentences:  ...  In this paper a sentence scoring method is defined based on existing sentence scoring methods.  ...  Input Document : Automatic summarization of a text document based on user query.doc Query : what is automatic summarization of a text document Based on a user query?  ... 
doi:10.5120/11587-6925 fatcat:hokd4dblsbho5odfoja2degn4i

The challenging task of summary evaluation: an overview

Elena Lloret, Laura Plaza, Ahmet Aker
2017 Language Resources and Evaluation  
Evaluation is crucial in the research and development of automatic summarization applications, in order to determine the appropriateness of a summary based on different criteria, such as the content it  ...  new ones, overcoming the possible limitations that existing methods may present.  ...  The evaluation of the reports was done according to different evaluation metrics, such as sentence similarity, ROUGE, document similarity, etc., based on the hypothesis that a good similarity metric would  ... 
doi:10.1007/s10579-017-9399-2 fatcat:tduxzlv2hfbfvd6evzoxn5xibu

Automatic Essay Answer Rating Using the Text Similarity Method

Cokorda Gde Abimanyu, Ngurah Agus Sanjaya ER
2020 Jurnal Elektronik Ilmu Komputer Udayana  
In this reasearch, we propose an automatic method of assessing essay answers by applying the cosine similarity method.  ...  Assesments are required in order to evaluate the performance of students. A typical method of learning assesments in class is by examination.  ...  Based on the results of the study that the automatic essay grading system using the cosine similarity method has been running well for essay exams in English.  ... 
doi:10.24843/jlk.2020.v08.i04.p12 fatcat:xnkphynyfjav5hshe5xj2e36bu

CLaC @ QATS: Quality Assessment for Text Simplification [article]

Elnaz Davoodi, Leila Kosseim
2017 arXiv   pre-print
Meaning preservation is predicted using two complementary approaches based on word embedding and WordNet synonyms.  ...  We trained three independent Random Forest classifiers in order to assess the quality of the simplified texts in terms of grammaticality, meaning preservation and simplicity.  ...  This similarity was the first feature we fed to a Random Forest classifier. Cosine Similarity of WordNet Synonyms The second feature we used for meaning preservation was based on WordNet synonyms.  ... 
arXiv:1708.05797v1 fatcat:jxyswzyhgbbnvb4atlcqvsq7ri

An Ensemble Approach for Semantic Assessment of Summary Writings

Yulan He, Siu Cheung Hui, Tho Thanh Quan
2009 2009 International Conference on Computer Engineering and Technology  
This is mainly due to the advances in other areas such as information extraction and natural language processing which have made automatic summary assessment possible.  ...  In this paper, we propose an ensemble approach, that integrates two of the most effective summary evaluation techniques, LSA and n-gram cooccurrence, for improving the accuracy of automatic summary assessment  ...  Summary writings are usually assessed based on two criteria, content and style. In this paper, the proposed ensemble technique focuses mainly on content assessment.  ... 
doi:10.1109/iccet.2009.90 fatcat:yrurlnwoy5axfbke34wjea3lyq

Automatic detection of plagiarized spoken responses

Keelan Evanini, Xinhao Wang
2014 Proceedings of the Ninth Workshop on Innovative Use of NLP for Building Educational Applications  
A corpus of spoken responses containing plagiarized content was collected from a high-stakes assessment of English proficiency for non-native speakers, and several text-to-text similarity metrics were  ...  This paper addresses the task of automatically detecting plagiarized responses in the context of a test of spoken English proficiency for non-native speakers.  ...  detect this type of plagiarism on a large scale, in order to provide fair and valid assessments.  ... 
doi:10.3115/v1/w14-1803 dblp:conf/bea/EvaniniW14 fatcat:mts243jr7jeibgie3ydbwnvvri
« Previous Showing results 1 — 15 out of 115,727 results