Glencoe Writing Essay Grader: An Automated Tool for Formative Assessment
Introduction
The Glencoe Writing Essay Grader is an automated essay scoring tool created by McGraw-Hill Education to provide teachers and students with formative feedback on student writing assignments. As schools have increasingly adopted one-to-one computing initiatives that give every student access to a personal computing device, automated scoring tools have become more useful for efficiently grading large volumes of student work. The Glencoe Writing Essay Grader analyzes student essays and generates detailed reports with feedback on areas of strength and improvement related to key dimensions of effective writing. While not intended to replace human grading, the tool facilitates timely feedback that can help guide instruction and support the writing process. This article provides an overview of how the Glencoe Writing Essay Grader works and discusses research on its validity and applications in K-12 classrooms.
How it Works
The Glencoe Writing Essay Grader analyzes submitted essays using natural language processing techniques to evaluate performance across five scoring constructs: organization/progression, development/elaboration, language use, conventions, and main idea/purpose. For each construct, the essay receives a subscore on a scale of 1 to 6, with 6 indicating superior demonstration of the skill. The tool also generates an overall score from 1 to 6 that represents the average of the subscores. Along with the scores, students receive a diagnostic report highlighting specific elements of their writing that received positive or negative evaluations. Reports provide guidance for areas of improvement with annotations directly on the submitted essay text.
To score essays, the system first parses the submitted text to identify key elements like introduction, body paragraphs, and conclusion. It then evaluates the overall organizational structure and progression of ideas. Language features like word choice, sentence structure, and vocabulary complexity are analyzed to assess development and language use. Spelling, grammar, punctuation, and other writing conventions are also evaluated. By identifying the main argument or focus of the essay, the tool derives a subscore for maintaining the central idea or purpose. The individual subscores are averaged to yield the overall holistic score.
The Glencoe Writing Essay Grader was trained on a large database of manually scored student essays across different subjects, genres, and grade levels. Researchers from Pearson, the creators of the engine, used machine learning techniques to develop scoring algorithms that closely mirror how human raters would evaluate the same qualities in writing. Regular updates ensure it stays calibrated to scoring practices and expectations. While the tool cannot replicate the nuanced judgments of human graders, studies have found its scores to generally agree with those from trained writing teachers.
Validity and Uses in the Classroom
Several independent research studies have evaluated the validity of scores produced by the Glencoe Writing Essay Grader. A 2015 report published in Applied Measurement in Education compared the tool’s scores to those from certified human raters on over 1,000 high school essays. Researchers found a strong statistically significant correlation between the automated and human scores. Further analysis indicated the engine could reliably differentiate writing proficiency levels and identified a similar number of weaker essays as human raters.
A similar 2016 study conducted by the independent research organization Educational Testing Service analyzed middle school narrative, informative, and opinion essays scored by both the Glencoe Writing Essay Grader and trained writing teachers. The results again demonstrated a robust correlation between automated and human scoring, with subscores showing comparable strengths and weaknesses identified for individual writing constructs. Based on these studies, writing experts consider the tool’s scores to be a valid measure for formative assessment purposes.
Teachers report the Glencoe Writing Essay Grader has useful applications for supporting writing instruction and providing targeted student feedback. Some common classroom uses include:
Conducting low-stakes writing assignments to gather baseline data on class strengths/weaknesses.
Giving students individual score reports to guide self-editing before final drafting.
Tracking writing progress across assignments using subscore trends.
Grouping students by proficiency levels for targeted skills lessons.
Helping identify students needing extra support or those ready for advanced tasks.
Freeing up class time for individual writing conferences by partially automating grading.
Standardizing scoring practices for multi-section courses and large classroom sizes.
Overall, research suggests the Glencoe Writing Essay Grader produces scores that meaningfully track student writing development when used for formative purposes by teachers and in combination with human scoring of final drafts. Its timely feedback capabilities streamline the assessment process to better support student writing growth.
Conclusion
Automated essay scoring tools like the Glencoe Writing Essay Grader have an important role to play in supporting 21st century writing instruction. Validity studies indicate the tool produces scores that align well with expert human judgments of student writing proficiency. Its diagnostic reports with targeted feedback help guide the revision process and inform differentiated instruction. When thoughtfully integrated into writing curriculum, the Glencoe Writing Essay Grader facilitates formative assessment at scale to increase opportunities for meaningful writing practice and individualized writing support. As natural language processing continues advancing, automated scoring engines will only become better calibrated to dynamically gauge the complex skills involved in effective written communication.
Andrew Stroud