naa a22 4500 510777457 CHVBK 20180411083235.0 cr unu---uuuuu 180411e20130601xx s 000 0 eng 10.3758/s13428-012-0258-1 doi (NATIONALLICENCE)springer-10.3758/s13428-012-0258-1 Natural language processing in an intelligent writing strategy tutoring system [Elektronische Daten] [Danielle McNamara, Scott Crossley, Rod Roscoe] The Writing Pal is an intelligent tutoring system that provides writing strategy training. A large part of its artificial intelligence resides in the natural language processing algorithms to assess essay quality and guide feedback to students. Because writing is often highly nuanced and subjective, the development of these algorithms must consider a broad array of linguistic, rhetorical, and contextual features. This study assesses the potential for computational indices to predict human ratings of essay quality. Past studies have demonstrated that linguistic indices related to lexical diversity, word frequency, and syntactic complexity are significant predictors of human judgments of essay quality but that indices of cohesion are not. The present study extends prior work by including a larger data sample and an expanded set of indices to assess new lexical, syntactic, cohesion, rhetorical, and reading ease indices. Three models were assessed. The model reported by McNamara, Crossley, and McCarthy (Written Communication 27:57-86, 2010) including three indices of lexical diversity, word frequency, and syntactic complexity accounted for only 6% of the variance in the larger data set. A regression model including the full set of indices examined in prior studies of writing predicted 38% of the variance in human scores of essay quality with 91% adjacent accuracy (i.e., within 1 point). A regression model that also included new indices related to rhetoric and cohesion predicted 44% of the variance with 94% adjacent accuracy. The new indices increased accuracy but, more importantly, afford the means to provide more meaningful feedback in the context of a writing tutoring system. Psychonomic Society, Inc., 2012 Intelligent tutoring systems nationallicence Natural language processing nationallicence Corpus linguistics nationallicence Computational linguistics nationallicence Writing pedagogy nationallicence Automated essay scoring nationallicence McNamara Danielle Learning Sciences Institute, Arizona State University, Phoenix, AZ, USA aut Crossley Scott Department of Applied Linguistics/ESL, Georgia State University, Atlanta, GA, USA aut Roscoe Rod Learning Sciences Institute, Arizona State University, Phoenix, AZ, USA aut Behavior Research Methods Springer-Verlag 45/2(2013-06-01), 499-515 45:2<499 2013 45 13428 https://doi.org/10.3758/s13428-012-0258-1 text/html Onlinezugriff via DOI 1 research-article jats NATIONALLICENCE 856 40 https://doi.org/10.3758/s13428-012-0258-1 text/html Onlinezugriff via DOI NATIONALLICENCE 700 1- McNamara Danielle Learning Sciences Institute, Arizona State University, Phoenix, AZ, USA aut NATIONALLICENCE 700 1- Crossley Scott Department of Applied Linguistics/ESL, Georgia State University, Atlanta, GA, USA aut NATIONALLICENCE 700 1- Roscoe Rod Learning Sciences Institute, Arizona State University, Phoenix, AZ, USA aut NATIONALLICENCE 773 0- Behavior Research Methods Springer-Verlag 45/2(2013-06-01), 499-515 45:2<499 2013 45 13428 Metadata rights reserved Springer special CC-BY-NC licence nationallicence BK010053 XK010053 XK010000 NATIONALLICENCE NATIONALLICENCE NL-springer