2,704 Hits in 7.2 sec

Efficacy of Deep Neural Embeddings based Semantic Similarity in Automatic Essay Evaluation

Manik Hendre, Prasenjit Mukherjee, Raman Preet, Manish Godse
2021 International Journal of Computing and Digital Systems  
Our experimental analysis of semantic similarity score distributions shows that the GSE outperforms other methods by accurately distinguishing essays from the same or different sets.  ...  Semantic similarity calculated using the GSE method is further used for finding the correlation with human-rated essay scores.  ...  METHODOLOGY We have proposed the use of semantic similarity for automated essay scoring.  ... 
doi:10.12785/ijcds/1001122 fatcat:4uctslbreveulca5q2qm766ewq

A Comprehensive Review of Automated Essay Scoring (AES) Research and Development

Chun Then Lim, Chih How Bong, Wee Sian Wong, Nung Kion Lee
2021 Pertanika journal of science & technology  
Automated Essay Scoring (AES) is a service or software that can predictively grade essay based on a pre-trained computational model.  ...  It has gained a lot of research interest in educational institutions as it expedites the process and reduces the effort of human raters in grading the essays as close to humans' decisions.  ...  ACKNOWLEDGEMENTS This study is supported by Kementerian Pendidikan Tinggi Malaysia Prototype Research Grant Scheme PRGS/1/2019/ICT01/UNIMAS/02/1 and Exploratory Research Grant Scheme ERGS/ICT07(01)/1018  ... 
doi:10.47836/pjst.29.3.27 fatcat:plbyexxll5aqxhj7vih6msucge

An Empirical Analysis of BERT Embedding for Automated Essay Scoring

Majdi Beseiso, Saleh Alzahrani
2020 International Journal of Advanced Computer Science and Applications  
We formulate an automated essay scoring problem as a rescaled regression problem and quantized classification problem. We analyzed the performance of AES models for different combinations.  ...  Automated Essay Scoring (AES) is one of the most challenging problems in Natural Language Processing (NLP).  ...  We conduct a set of experiments using word-embedding models along with the manually extracted features and compare their performances for automated scoring of essay using a benchmark dataset.  ... 
doi:10.14569/ijacsa.2020.0111027 fatcat:sidfhgvcpzgafehoslgmi4e2ka

Learning to Identify Sentence Parallelism in Student Essays

Wei Song, Tong Liu, Ruiji Fu, Lizhen Liu, Hanshi Wang, Ting Liu
2016 International Conference on Computational Linguistics  
We propose a machine learning approach for automated sentence parallelism identification in student essays. We build an essay dataset with sentence level parallelism annotated.  ...  Based on this approach, we automatically identify sentence parallelism in more than 2000 student essays and study the correlation between the use of sentence parallelism and the types and quality of essays  ...  The scores ranges from 0 to 60. The distribution of essay scores is shown in Figure 2 (a). We can see the distribution of either narrative or argumentative essays meets the normal distribution.  ... 
dblp:conf/coling/SongLFLWL16 fatcat:efbc7ocbrfayfg37geljzxijte

Contactless Academia – The Case for Automated Essay Scoring (AES) System in COVID 19 Pandemic

Kennedy A. Osakwe, Kunle Ola, Pete Omotosho
2021 Current Journal of Applied Science and Technology  
An invaluable measure worth considering is the inclusion of 'Automated Essay Scoring' (AES) system in the mitigation toolkits for higher institutions of learning.  ...  The outcome of reviewed literatures varied on suitability of AES in scoring essay task in Higher Institution of Learning.  ...  The purpose of the study was to investigate the validity and usefulness of automated essay scoring for large-scale placement tests by comparing the performance of AES with that of human raters in  ... 
doi:10.9734/cjast/2021/v40i431292 fatcat:hu2tfmidrzczrodg5bta7jsaiu

Automated Essay Scoring: A Siamese Bidirectional LSTM Neural Network Architecture

Guoxi Liang, Byung-Won On, Dongwon Jeong, Hyun-Chul Kim, Gyu Choi
2018 Symmetry  
Essay scoring is a critical task in education. Implementing automated essay scoring (AES) helps reduce manual workload and speed up learning feedback.  ...  We use the SBLSTMA model for the task of AES and take the Automated Student Assessment Prize (ASAP) dataset as evaluation.  ...  Conflicts of Interest: The authors declare no conflict of interest.  ... 
doi:10.3390/sym10120682 fatcat:yudbfzqmifdxfjtsroptr36kgm

Coherence Modeling for the Automated Assessment of Spontaneous Spoken Responses

Xinhao Wang, Keelan Evanini, Klaus Zechner
2013 North American Chapter of the Association for Computational Linguistics  
Further experiments indicate that a weighted F-Measure of 73% can be achieved for the automated prediction of the coherence scores.  ...  This study focuses on modeling discourse coherence in the context of automated assessment of spontaneous speech from non-native speakers.  ...  Acknowledgments The authors wish to express our thanks to the discourse annotators Melissa Lopez and Matt Mulholland for their dedicated work and our colleagues Jill Burstein and Slava Andreyev for their  ... 
dblp:conf/naacl/WangEZ13 fatcat:yj66iwkjobexratb4jzp2o3eha

Unsupervised Modeling of Topical Relevance in L2 Learner Text

Ronan Cummins, Helen Yannakoudakis, Ted Briscoe
2016 Proceedings of the 11th Workshop on Innovative Use of NLP for Building Educational Applications  
Finally, we incorporate our prompt-relevance models into a supervised essay scoring system that predicts a holistic score and show that it improves its performance.  ...  The automated scoring of second-language (L2) learner text along various writing dimensions is an increasingly active research area.  ...  Acknowledgements We would like to thank Cambridge English Language Assessment for supporting this research, and the anonymous reviewers for their useful feedback.  ... 
doi:10.18653/v1/w16-0510 dblp:conf/bea/CumminsYB16 fatcat:nw6nupqiwfbsrg75bo6jxf53tu

Formative Assessment Visual Feedback in Computer Graded Essays

Robert Francis Williams, Heinz Dreher
2005 Issues in Informing Science and Information Technology  
In this paper we discuss a simple but comprehensive form of feedback to essay authors, based on a thesaurus and computer graphics, which enables the essay authors to see where essay content is inadequate  ...  Concepts which are inadequately covered are displayed for the information of the author so that the essay can be improved.  ...  The approach used has a need for a semantic representation that does not need substantial hand coding of knowledge structures prior to use, and that can deal with unlimited unseen text.  ... 
doi:10.28945/808 fatcat:7skqdmemknch3hfmantqfx6isa

Automated Pyramid Scoring of Summaries using Distributional Semantics

Rebecca J. Passonneau, Emily Chen, Weiwei Guo, Dolores Perin
2013 Annual Meeting of the Association for Computational Linguistics  
This motivates the development of a more accurate automated method to compute pyramid scores. Of three methods tested here, the one that performs best relies on latent semantics.  ...  The pyramid method for content evaluation of automated summarizers produces scores that are shown to correlate well with manual scores used in educational assessment of students' summaries.  ...  Acknowledgements We thank the reviewers for very valuable insights. Variant µ Recall (std) µ Precision (std) F score Uni, min  ... 
dblp:conf/acl/PassonneauCGP13 fatcat:lrllusrwsnav5bwncltrifx3ni

Individual Fairness Evaluation for Automated Essay Scoring System

Afrizal Doewes, Akrati Saxena, Yulong Pei, Mykola Pechenizkiy, Antonija Mitrovic, Nigel Bosch
2022 Zenodo  
In Automated Essay Scoring (AES) systems, many previous works have studied group fairness using the demographic features of essay writers.  ...  The similarity of essays can be computed using the distance of the text representation of essays.  ...  To study individual fairness extensively in AES, we propose a methodology to assess the performance of automated scoring systems with regard to individual fairness.  ... 
doi:10.5281/zenodo.6853150 fatcat:nyzqx2ash5fcxdatdrkkueqcxm

TDNN: A Two-stage Deep Neural Network for Prompt-independent Automated Essay Scoring

Cancan Jin, Ben He, Kai Hui, Le Sun
2018 Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)  
Existing automated essay scoring (AES) models rely on rated essays for the target prompt as training data.  ...  Evaluation of the proposed TDNN on the standard ASAP dataset demonstrates a promising improvement for the prompt-independent AES task.  ...  Acknowledgments This work is supported in part by the National Natural Science Foundation of China (61472391), and the Project of Beijing Advanced Innovation Center for Language Resources (451122512).  ... 
doi:10.18653/v1/p18-1100 dblp:conf/acl/SunHHJ18 fatcat:jfm7ssqakrcpdjnlcl7lvupmuu

Automated language essay scoring systems: a literature review

Mohamed Abdellatif Hussein, Hesham Hassan, Mohammad Nassef
2019 PeerJ Computer Science  
Methodology We have reviewed the existing literature using Google Scholar, EBSCO and ERIC to search for the terms "AES", "Automated Essay Scoring", "Automated Essay Grading", or "Automatic Essay" for essays  ...  The need for objective and quick scores has raised the need for a computer system that can automatically grade essay questions targeting specific prompts.  ...  Automatic features for essay scoring-an empirical study Dong and Zhang provided in 2016 an empirical study to examine a neural network method to learn syntactic and semantic characteristics automatically  ... 
doi:10.7717/peerj-cs.208 pmid:33816861 pmcid:PMC7924549 fatcat:27zku2x4rrfa5kmiz2c47hglgi

ReaderBench Learns Dutch: Building a Comprehensive Automated Essay Scoring System for Dutch Language [chapter]

Mihai Dascalu, Wim Westera, Stefan Ruseti, Stefan Trausan-Matu, Hub Kurvers
2017 Lecture Notes in Computer Science  
In this paper, we introduce a novel Automatic Essay Scoring method for Dutch language, built within the Readerbench framework, which encompasses a wide range of textual complexity indices, as well as an  ...  Automated Essay Scoring has gained a wider applicability and usage with the integration of advanced Natural Language Processing techniques which enabled in-depth analyses of discourse in order capture  ...  This work was partially funded by the 644187 EC H2020 Realising an Applied Gaming Eco-system (RAGE) project, by the FP7 208-212578 LTfLL project, as well as by University Politehnica of Bucharest through  ... 
doi:10.1007/978-3-319-61425-0_5 fatcat:64dv7cgnrzandp3dhojywfyls4

Automated evaluation of the quality of ideas in compositions based on concept maps

Li-Ping Yang, Tao Xin, Fang Luo, Sheng Zhang, Xue-Tao Tian
2021 Natural Language Engineering  
By utilizing real compositions written by eighth-grade students from a large-scale assessment, the scoring accuracy of the computer evaluation system (named AECC-I: Automated Evaluation for Chinese Compositions—Ideas  ...  This paper proposes a new formulation of graph-based features for concept maps using word embeddings to evaluate the quality of ideas for Chinese compositions.  ...  We also thank the National Assessment Center for Education Quality of Chinese Ministry of Education for the financial support.  ... 
doi:10.1017/s1351324921000103 fatcat:h6qb7jniuzg45hf53nflsunhu4
« Previous Showing results 1 — 15 out of 2,704 results