Exams and Student Feedback: An experiment in Marking Efficiencies release_nayxbctx2ratlfebkan5boa2mq

by Denard Lynch, Andrew Kostiuk

Published in Proceedings of the Canadian Engineering Education Association (CEEA) by Queen's University Library.

2018  

Abstract

Providing summative feedback to studentsin a timely fashion, and managing the associated markingin larger classes has been a perpetual challenge in aneducation environment, and is even more so in a resourcechallenged environment. This paper discusses the resultsof an experiment in evaluation in an engineering courseby implementing a modified evaluation and gradingapproach. The objectives were to i) provide timelyfeedback to students, ii) improve engagement and reduceoverall course loading for students, and iii) reducemarking effort for instructors, all without negativelyaffecting student grade performance. The results showthat improvements over traditional methods can be madein two of the three areas.The course in question, (redacted), covers basicelectrical concepts and devices for non-electricalengineering students. The course had been offered in fourprevious years using a traditional evaluative approach:weekly assignments (submitted, marked and returned),laboratory exercises (comprehensive reporting orexercises submitted, marked and returned), midterm(s)(graded and returned), and a final examination. Themodified approach was implemented over the past twoyears and included the same learning strategies, but witha potentially lower resource commitment for students andinstructors. Modifications to the strategy wereimplemented the first and second years. The experimentintroduced procedural and administrative modificationsin assignments, laboratories and examinations, and theaddition of short weekly quizzes to improve engagementin an active learning environment.Approximately ten assignments were offered to helpstudents test and improve their understanding andknowledge. In the first year, assignments and solutionswere posted simultaneously; no submission was requiredand there was no grade contribution offered. Therationale for this strategy was that students would receivevirtually instant feedback by having solutions immediatelyavailable, and the freedom to judge the quantity and levelof completion required to meet their individual learningneeds. In the second year, assignments wereadministered through an online assignment system formark credit. This was intended to reinstate the incentiveof mark credit to improve student engagement while stillproviding instantaneous feedback on correctness.The course has always included a critical "hands-on"laboratory component which was traditionally timeintensive for both students and instructors. While thelaboratory submissions were still required for markcredit, the reporting requirement was reduced to aminimal, specified sampling of results to provide evidencethat the practical work was addressed. Expectedoutcomes were again provided for students to providerelevant and timely feedback. In the second year, a 3-bingrading system was adopted to improve the granularity ofthe marks while still requiring considerably less markingeffort.Examinations were also modified to improve timelinessof feedback and reduce marking effort. In the first year,three "midterm" examinations were distributed throughthe term to monitor student learning and verify studentparticipation in the self-directed parts of the course.Each of these exams consisted of 12 questions and weresimply graded on a correct response (no "partial marks)to reduce marking effort. In the second year, two midtermexaminations were deemed sufficient, but were gradedusing a 3-bin approach, thus allowing for "partialmarks". Exams were returned to students in the nextlecture period in both cases. The Final examination inthe first year was designed using a 3-bin scheme to allowfor partial marks while still reducing marking effort. Inthe second year, this was increased to a 4-bin scheme toimproved granularity. The increase in granularity hadvery little effect on marking effort for both the midtermand final.One additional modification was made in the secondyear with the addition of brief weekly quizzes, for markcredit, to encourage students to complete assigned prereadingexercises and keep up with course work. Thequizzes consisted of two brief questions: one on assignedreading for the coming week and one on the previousweek's material. These quizzes were administered andgraded using a classroom response system and automatically integrated with the learning managementsystem.Analysis consisted of comparison of grades withprevious years, anecdotal evidence and observations onstudent effort, course evaluation data and survey results.Preliminary results indicate student load and instructormarking effort were significantly reduced. While graderesults were approximately the same. A direct objectivecomparison with previous years is not significant due tovariations in course content and cohort.
In application/xml+jats format

Archived Files and Locations

application/pdf  1.0 MB
file_47wxtoypbjbmhfbqxe4af3xp2e
ojs.library.queensu.ca (publisher)
web.archive.org (webarchive)
Read Archived PDF
Preserved and Accessible
Type  article-journal
Stage   published
Date   2018-12-03
Proceedings Metadata
Open Access Publication
Not in DOAJ
In ISSN ROAD
Not in Keepers Registry
ISSN-L:  2371-5243
Work Entity
access all versions, variants, and formats of this works (eg, pre-prints)
Catalog Record
Revision: de152ac4-cbf6-4e9c-b093-2005892f3a18
API URL: JSON