ASSESSING STUDENT LEARNING WITH AUTOMATED TEXT PROCESSING TECHNIQUES release_5t7mywfeyjcqlji3o7vfvzm4ly

by Yi-fang Brook Wu, Xin Chen

Published in Online Learning by The Online Learning Consortium.

2019  

Abstract

Research on distance learning and computer-aided grading has been developed in parallel. Little work has been done in the past to join the two areas to solve the problem of automated learning assessment in virtual classrooms. This paper presents a model for learning assessment using an automated text processing technique to analyze class messages with an emphasis on course topics produced in an online class. It is suggested that students should be evaluated on many dimensions, including the learning artifacts such as course work submitted and class participation. Taking all these grading criteria into consideration, we design a model which combines three grading factors: the quality of course work, the quantity of efforts, and the activeness of participation, for evaluating the performance of students in the class. These three main items are measured on the basis of keyword contribution, message length, and message count, and a score is derived from the class messages to evaluate students' performance. An assessment model is then constructed from these three measures to compute a performance indicator score for each student. The experiment shows that there is a high correlation between the performance indicator scores and the actual grades assigned by instructors. The rank orders of students by performance indicator scores and by the actual grades are highly correlated as well. Evidence from the experiment shows that the computer grader can be a great supplementary teaching and grading tool for distance learning instructors.
In application/xml+jats format

Archived Files and Locations

application/pdf  105.2 kB
file_djy6kuwaurbdxe3llisb7vqtoa
web.archive.org (webarchive)
olj.onlinelearningconsortium.org (web)
Read Archived PDF
Preserved and Accessible
Type  article-journal
Stage   published
Date   2019-03-19
Container Metadata
Open Access Publication
In DOAJ
In Keepers Registry
ISSN-L:  2472-5730
Work Entity
access all versions, variants, and formats of this works (eg, pre-prints)
Catalog Record
Revision: 152230b8-0881-4eb8-9f97-132522623e1e
API URL: JSON