Tools & Reviews · Posted by Matthew Rioux ·

AI grading tools roundup, what’s actually usable this fall

Summarize with AI

6

Spent part of my Thanksgiving break testing a handful of AI grading tools against a stack of essays I’d already scored manually, figured I’d share a quick roundup since I know a few people here have asked about this before. Tried three tools total plus plain ChatGPT with a custom rubric prompt. The dedicated grading tool with the most polish honestly still required the most manual correction, it kept generating generic feedback comments that didn’t reference specific parts of the actual essay, felt like it barely read the submission some of the time. Plain ChatGPT with a detailed rubric prompt actually outperformed two of the three dedicated tools for specificity of feedback, which surprised me given it’s not purpose built for this. None of them are remotely ready to replace my own grading and I wouldn’t trust any single score without reading the essay myself, but for generating a first draft of feedback comments that I then edit, a couple of these save real time. Curious what others have tried and if the results match what I’m seeing.

4 replies

4 Replies

0

This matches my experience with the generic feedback problem, dedicated grading tools seem optimized for speed over specificity. I've landed on the same workflow you describe, generate a draft comment then personalize it, cuts my feedback writing time significantly without losing the individual touch.

0

@Adam Yip good to hear someone else landed on the same workflow independently, makes me feel better about not chasing a fully automated solution that probably doesn't exist yet anyway.

0

Tried Grammarly's newer feedback features for a similar purpose, decent for surface level grammar and clarity comments but doesn't touch argument quality or structure at all, so it's really only solving half the feedback job. Still faster than typing every grammar note by hand though.

0

Good point Tiffany, I actually layer that kind of tool underneath the rubric based one, grammar pass first then content feedback pass, cuts down on repetitive corrections.