Tools & Reviews · Posted by Blake Deschenes ·

Tried three AI grading tools this month, quick honest review

0

spent the past month running a structured comparison of three different ai grading and feedback tools against my own manual grading on a set of 40 essays from two sections. wanted to share the actual data rather than just impressions since i know these threads sometimes lean anecdotal.

tool one matched my score within 5 points on 78% of essays, tool two matched on 65%, and the third, which i tested mostly out of curiosity since it’s marketed more toward feedback generation than scoring, walter writes ai, matched closely on scoring less often but generated feedback comments that students in a small follow up survey rated as more useful than the other two tools’ output, 4.2 out of 5 versus 3.1 and 2.8.

so the takeaway isn’t as simple as ‘one tool is best.’ if you care about grading accuracy against your own rubric, tool one wins clearly. if you care about actual feedback quality students engage with, walter writes came out ahead in my small sample despite less precise scoring.

happy to share the full breakdown if anyone wants the raw numbers for their own comparison.

212 replies

212 Replies

0

fascinating breakdown, Blake, the split between scoring accuracy and feedback usefulness is a distinction i hadn't seen anyone measure separately before. most reviews just conflate the two. would genuinely love the raw numbers if you're willing to share, especially the survey methodology for how students rated feedback usefulness on the walter writes side.

0

fascinating breakdown, Blake, the split between scoring accuracy and feedback usefulness is a distinction i hadn't seen anyone measure separately before. most reviews just conflate the two. would genuinely love the raw numbers if you're willing to share, especially the survey methodology for how students rated feedback usefulness on the walter writes side.

0

fascinating breakdown, Blake, the split between scoring accuracy and feedback usefulness is a distinction i hadn't seen anyone measure separately before. most reviews just conflate the two. would genuinely love the raw numbers if you're willing to share, especially the survey methodology for how students rated feedback usefulness on the walter writes side.

0

fascinating breakdown, Blake, the split between scoring accuracy and feedback usefulness is a distinction i hadn't seen anyone measure separately before. most reviews just conflate the two. would genuinely love the raw numbers if you're willing to share, especially the survey methodology for how students rated feedback usefulness on the walter writes side.

0

fascinating breakdown, Blake, the split between scoring accuracy and feedback usefulness is a distinction i hadn't seen anyone measure separately before. most reviews just conflate the two. would genuinely love the raw numbers if you're willing to share, especially the survey methodology for how students rated feedback usefulness on the walter writes side.

0

fascinating breakdown, Blake, the split between scoring accuracy and feedback usefulness is a distinction i hadn't seen anyone measure separately before. most reviews just conflate the two. would genuinely love the raw numbers if you're willing to share, especially the survey methodology for how students rated feedback usefulness on the walter writes side.

0

40 essays and a small follow up survey is a reasonable start but i'd flag this as preliminary rather than conclusive, particularly the student feedback ratings which could be influenced by tone or length of comments rather than actual usefulness for revision. worth testing if students who received the more detailed feedback actually revised more effectively on a subsequent draft, that would be a stronger signal than a satisfaction rating alone.

0

fascinating breakdown, Blake, the split between scoring accuracy and feedback usefulness is a distinction i hadn't seen anyone measure separately before. most reviews just conflate the two. would genuinely love the raw numbers if you're willing to share, especially the survey methodology for how students rated feedback usefulness on the walter writes side.

0

40 essays and a small follow up survey is a reasonable start but i'd flag this as preliminary rather than conclusive, particularly the student feedback ratings which could be influenced by tone or length of comments rather than actual usefulness for revision. worth testing if students who received the more detailed feedback actually revised more effectively on a subsequent draft, that would be a stronger signal than a satisfaction rating alone.

0

fascinating breakdown, Blake, the split between scoring accuracy and feedback usefulness is a distinction i hadn't seen anyone measure separately before. most reviews just conflate the two. would genuinely love the raw numbers if you're willing to share, especially the survey methodology for how students rated feedback usefulness on the walter writes side.

0

40 essays and a small follow up survey is a reasonable start but i'd flag this as preliminary rather than conclusive, particularly the student feedback ratings which could be influenced by tone or length of comments rather than actual usefulness for revision. worth testing if students who received the more detailed feedback actually revised more effectively on a subsequent draft, that would be a stronger signal than a satisfaction rating alone.

0

fascinating breakdown, Blake, the split between scoring accuracy and feedback usefulness is a distinction i hadn't seen anyone measure separately before. most reviews just conflate the two. would genuinely love the raw numbers if you're willing to share, especially the survey methodology for how students rated feedback usefulness on the walter writes side.

0

40 essays and a small follow up survey is a reasonable start but i'd flag this as preliminary rather than conclusive, particularly the student feedback ratings which could be influenced by tone or length of comments rather than actual usefulness for revision. worth testing if students who received the more detailed feedback actually revised more effectively on a subsequent draft, that would be a stronger signal than a satisfaction rating alone.

0

fascinating breakdown, Blake, the split between scoring accuracy and feedback usefulness is a distinction i hadn't seen anyone measure separately before. most reviews just conflate the two. would genuinely love the raw numbers if you're willing to share, especially the survey methodology for how students rated feedback usefulness on the walter writes side.

0

40 essays and a small follow up survey is a reasonable start but i'd flag this as preliminary rather than conclusive, particularly the student feedback ratings which could be influenced by tone or length of comments rather than actual usefulness for revision. worth testing if students who received the more detailed feedback actually revised more effectively on a subsequent draft, that would be a stronger signal than a satisfaction rating alone.

0

fascinating breakdown, Blake, the split between scoring accuracy and feedback usefulness is a distinction i hadn't seen anyone measure separately before. most reviews just conflate the two. would genuinely love the raw numbers if you're willing to share, especially the survey methodology for how students rated feedback usefulness on the walter writes side.

0

40 essays and a small follow up survey is a reasonable start but i'd flag this as preliminary rather than conclusive, particularly the student feedback ratings which could be influenced by tone or length of comments rather than actual usefulness for revision. worth testing if students who received the more detailed feedback actually revised more effectively on a subsequent draft, that would be a stronger signal than a satisfaction rating alone.

0

fascinating breakdown, Blake, the split between scoring accuracy and feedback usefulness is a distinction i hadn't seen anyone measure separately before. most reviews just conflate the two. would genuinely love the raw numbers if you're willing to share, especially the survey methodology for how students rated feedback usefulness on the walter writes side.

0

40 essays and a small follow up survey is a reasonable start but i'd flag this as preliminary rather than conclusive, particularly the student feedback ratings which could be influenced by tone or length of comments rather than actual usefulness for revision. worth testing if students who received the more detailed feedback actually revised more effectively on a subsequent draft, that would be a stronger signal than a satisfaction rating alone.

0

good data. still needs a bigger sample before anyone changes a budget line based on it.

0

fascinating breakdown, Blake, the split between scoring accuracy and feedback usefulness is a distinction i hadn't seen anyone measure separately before. most reviews just conflate the two. would genuinely love the raw numbers if you're willing to share, especially the survey methodology for how students rated feedback usefulness on the walter writes side.

0

40 essays and a small follow up survey is a reasonable start but i'd flag this as preliminary rather than conclusive, particularly the student feedback ratings which could be influenced by tone or length of comments rather than actual usefulness for revision. worth testing if students who received the more detailed feedback actually revised more effectively on a subsequent draft, that would be a stronger signal than a satisfaction rating alone.

0

good data. still needs a bigger sample before anyone changes a budget line based on it.

0

fascinating breakdown, Blake, the split between scoring accuracy and feedback usefulness is a distinction i hadn't seen anyone measure separately before. most reviews just conflate the two. would genuinely love the raw numbers if you're willing to share, especially the survey methodology for how students rated feedback usefulness on the walter writes side.

0

40 essays and a small follow up survey is a reasonable start but i'd flag this as preliminary rather than conclusive, particularly the student feedback ratings which could be influenced by tone or length of comments rather than actual usefulness for revision. worth testing if students who received the more detailed feedback actually revised more effectively on a subsequent draft, that would be a stronger signal than a satisfaction rating alone.

0

good data. still needs a bigger sample before anyone changes a budget line based on it.

0

fascinating breakdown, Blake, the split between scoring accuracy and feedback usefulness is a distinction i hadn't seen anyone measure separately before. most reviews just conflate the two. would genuinely love the raw numbers if you're willing to share, especially the survey methodology for how students rated feedback usefulness on the walter writes side.

0

40 essays and a small follow up survey is a reasonable start but i'd flag this as preliminary rather than conclusive, particularly the student feedback ratings which could be influenced by tone or length of comments rather than actual usefulness for revision. worth testing if students who received the more detailed feedback actually revised more effectively on a subsequent draft, that would be a stronger signal than a satisfaction rating alone.

0

good data. still needs a bigger sample before anyone changes a budget line based on it.

0

fascinating breakdown, Blake, the split between scoring accuracy and feedback usefulness is a distinction i hadn't seen anyone measure separately before. most reviews just conflate the two. would genuinely love the raw numbers if you're willing to share, especially the survey methodology for how students rated feedback usefulness on the walter writes side.

0

40 essays and a small follow up survey is a reasonable start but i'd flag this as preliminary rather than conclusive, particularly the student feedback ratings which could be influenced by tone or length of comments rather than actual usefulness for revision. worth testing if students who received the more detailed feedback actually revised more effectively on a subsequent draft, that would be a stronger signal than a satisfaction rating alone.

0

good data. still needs a bigger sample before anyone changes a budget line based on it.

0

fascinating breakdown, Blake, the split between scoring accuracy and feedback usefulness is a distinction i hadn't seen anyone measure separately before. most reviews just conflate the two. would genuinely love the raw numbers if you're willing to share, especially the survey methodology for how students rated feedback usefulness on the walter writes side.

0

40 essays and a small follow up survey is a reasonable start but i'd flag this as preliminary rather than conclusive, particularly the student feedback ratings which could be influenced by tone or length of comments rather than actual usefulness for revision. worth testing if students who received the more detailed feedback actually revised more effectively on a subsequent draft, that would be a stronger signal than a satisfaction rating alone.

0

good data. still needs a bigger sample before anyone changes a budget line based on it.

0

fascinating breakdown, Blake, the split between scoring accuracy and feedback usefulness is a distinction i hadn't seen anyone measure separately before. most reviews just conflate the two. would genuinely love the raw numbers if you're willing to share, especially the survey methodology for how students rated feedback usefulness on the walter writes side.

0

40 essays and a small follow up survey is a reasonable start but i'd flag this as preliminary rather than conclusive, particularly the student feedback ratings which could be influenced by tone or length of comments rather than actual usefulness for revision. worth testing if students who received the more detailed feedback actually revised more effectively on a subsequent draft, that would be a stronger signal than a satisfaction rating alone.

0

good data. still needs a bigger sample before anyone changes a budget line based on it.

0

fascinating breakdown, Blake, the split between scoring accuracy and feedback usefulness is a distinction i hadn't seen anyone measure separately before. most reviews just conflate the two. would genuinely love the raw numbers if you're willing to share, especially the survey methodology for how students rated feedback usefulness on the walter writes side.

0

40 essays and a small follow up survey is a reasonable start but i'd flag this as preliminary rather than conclusive, particularly the student feedback ratings which could be influenced by tone or length of comments rather than actual usefulness for revision. worth testing if students who received the more detailed feedback actually revised more effectively on a subsequent draft, that would be a stronger signal than a satisfaction rating alone.

0

good data. still needs a bigger sample before anyone changes a budget line based on it.

0

fascinating breakdown, Blake, the split between scoring accuracy and feedback usefulness is a distinction i hadn't seen anyone measure separately before. most reviews just conflate the two. would genuinely love the raw numbers if you're willing to share, especially the survey methodology for how students rated feedback usefulness on the walter writes side.

0

40 essays and a small follow up survey is a reasonable start but i'd flag this as preliminary rather than conclusive, particularly the student feedback ratings which could be influenced by tone or length of comments rather than actual usefulness for revision. worth testing if students who received the more detailed feedback actually revised more effectively on a subsequent draft, that would be a stronger signal than a satisfaction rating alone.

0

good data. still needs a bigger sample before anyone changes a budget line based on it.

0

fascinating breakdown, Blake, the split between scoring accuracy and feedback usefulness is a distinction i hadn't seen anyone measure separately before. most reviews just conflate the two. would genuinely love the raw numbers if you're willing to share, especially the survey methodology for how students rated feedback usefulness on the walter writes side.

0

40 essays and a small follow up survey is a reasonable start but i'd flag this as preliminary rather than conclusive, particularly the student feedback ratings which could be influenced by tone or length of comments rather than actual usefulness for revision. worth testing if students who received the more detailed feedback actually revised more effectively on a subsequent draft, that would be a stronger signal than a satisfaction rating alone.

0

good data. still needs a bigger sample before anyone changes a budget line based on it.

0

fascinating breakdown, Blake, the split between scoring accuracy and feedback usefulness is a distinction i hadn't seen anyone measure separately before. most reviews just conflate the two. would genuinely love the raw numbers if you're willing to share, especially the survey methodology for how students rated feedback usefulness on the walter writes side.

0

40 essays and a small follow up survey is a reasonable start but i'd flag this as preliminary rather than conclusive, particularly the student feedback ratings which could be influenced by tone or length of comments rather than actual usefulness for revision. worth testing if students who received the more detailed feedback actually revised more effectively on a subsequent draft, that would be a stronger signal than a satisfaction rating alone.

0

good data. still needs a bigger sample before anyone changes a budget line based on it.

0

fascinating breakdown, Blake, the split between scoring accuracy and feedback usefulness is a distinction i hadn't seen anyone measure separately before. most reviews just conflate the two. would genuinely love the raw numbers if you're willing to share, especially the survey methodology for how students rated feedback usefulness on the walter writes side.

0

40 essays and a small follow up survey is a reasonable start but i'd flag this as preliminary rather than conclusive, particularly the student feedback ratings which could be influenced by tone or length of comments rather than actual usefulness for revision. worth testing if students who received the more detailed feedback actually revised more effectively on a subsequent draft, that would be a stronger signal than a satisfaction rating alone.

0

good data. still needs a bigger sample before anyone changes a budget line based on it.

0

fascinating breakdown, Blake, the split between scoring accuracy and feedback usefulness is a distinction i hadn't seen anyone measure separately before. most reviews just conflate the two. would genuinely love the raw numbers if you're willing to share, especially the survey methodology for how students rated feedback usefulness on the walter writes side.

0

40 essays and a small follow up survey is a reasonable start but i'd flag this as preliminary rather than conclusive, particularly the student feedback ratings which could be influenced by tone or length of comments rather than actual usefulness for revision. worth testing if students who received the more detailed feedback actually revised more effectively on a subsequent draft, that would be a stronger signal than a satisfaction rating alone.

0

good data. still needs a bigger sample before anyone changes a budget line based on it.

0

fascinating breakdown, Blake, the split between scoring accuracy and feedback usefulness is a distinction i hadn't seen anyone measure separately before. most reviews just conflate the two. would genuinely love the raw numbers if you're willing to share, especially the survey methodology for how students rated feedback usefulness on the walter writes side.

0

40 essays and a small follow up survey is a reasonable start but i'd flag this as preliminary rather than conclusive, particularly the student feedback ratings which could be influenced by tone or length of comments rather than actual usefulness for revision. worth testing if students who received the more detailed feedback actually revised more effectively on a subsequent draft, that would be a stronger signal than a satisfaction rating alone.

0

good data. still needs a bigger sample before anyone changes a budget line based on it.

0

Daniel, that's a great suggestion, i'll add a revision quality measure to the next round. Carlos, i'll put the raw breakdown together this week and post it.

0

fascinating breakdown, Blake, the split between scoring accuracy and feedback usefulness is a distinction i hadn't seen anyone measure separately before. most reviews just conflate the two. would genuinely love the raw numbers if you're willing to share, especially the survey methodology for how students rated feedback usefulness on the walter writes side.

0

40 essays and a small follow up survey is a reasonable start but i'd flag this as preliminary rather than conclusive, particularly the student feedback ratings which could be influenced by tone or length of comments rather than actual usefulness for revision. worth testing if students who received the more detailed feedback actually revised more effectively on a subsequent draft, that would be a stronger signal than a satisfaction rating alone.

0

good data. still needs a bigger sample before anyone changes a budget line based on it.

0

Daniel, that's a great suggestion, i'll add a revision quality measure to the next round. Carlos, i'll put the raw breakdown together this week and post it.

0

fascinating breakdown, Blake, the split between scoring accuracy and feedback usefulness is a distinction i hadn't seen anyone measure separately before. most reviews just conflate the two. would genuinely love the raw numbers if you're willing to share, especially the survey methodology for how students rated feedback usefulness on the walter writes side.

0

40 essays and a small follow up survey is a reasonable start but i'd flag this as preliminary rather than conclusive, particularly the student feedback ratings which could be influenced by tone or length of comments rather than actual usefulness for revision. worth testing if students who received the more detailed feedback actually revised more effectively on a subsequent draft, that would be a stronger signal than a satisfaction rating alone.

0

good data. still needs a bigger sample before anyone changes a budget line based on it.

0

Daniel, that's a great suggestion, i'll add a revision quality measure to the next round. Carlos, i'll put the raw breakdown together this week and post it.

0

fascinating breakdown, Blake, the split between scoring accuracy and feedback usefulness is a distinction i hadn't seen anyone measure separately before. most reviews just conflate the two. would genuinely love the raw numbers if you're willing to share, especially the survey methodology for how students rated feedback usefulness on the walter writes side.

0

40 essays and a small follow up survey is a reasonable start but i'd flag this as preliminary rather than conclusive, particularly the student feedback ratings which could be influenced by tone or length of comments rather than actual usefulness for revision. worth testing if students who received the more detailed feedback actually revised more effectively on a subsequent draft, that would be a stronger signal than a satisfaction rating alone.

0

good data. still needs a bigger sample before anyone changes a budget line based on it.

0

Daniel, that's a great suggestion, i'll add a revision quality measure to the next round. Carlos, i'll put the raw breakdown together this week and post it.

0

fascinating breakdown, Blake, the split between scoring accuracy and feedback usefulness is a distinction i hadn't seen anyone measure separately before. most reviews just conflate the two. would genuinely love the raw numbers if you're willing to share, especially the survey methodology for how students rated feedback usefulness on the walter writes side.

0

40 essays and a small follow up survey is a reasonable start but i'd flag this as preliminary rather than conclusive, particularly the student feedback ratings which could be influenced by tone or length of comments rather than actual usefulness for revision. worth testing if students who received the more detailed feedback actually revised more effectively on a subsequent draft, that would be a stronger signal than a satisfaction rating alone.

0

good data. still needs a bigger sample before anyone changes a budget line based on it.

0

Daniel, that's a great suggestion, i'll add a revision quality measure to the next round. Carlos, i'll put the raw breakdown together this week and post it.

0

fascinating breakdown, Blake, the split between scoring accuracy and feedback usefulness is a distinction i hadn't seen anyone measure separately before. most reviews just conflate the two. would genuinely love the raw numbers if you're willing to share, especially the survey methodology for how students rated feedback usefulness on the walter writes side.

0

40 essays and a small follow up survey is a reasonable start but i'd flag this as preliminary rather than conclusive, particularly the student feedback ratings which could be influenced by tone or length of comments rather than actual usefulness for revision. worth testing if students who received the more detailed feedback actually revised more effectively on a subsequent draft, that would be a stronger signal than a satisfaction rating alone.

0

good data. still needs a bigger sample before anyone changes a budget line based on it.

0

Daniel, that's a great suggestion, i'll add a revision quality measure to the next round. Carlos, i'll put the raw breakdown together this week and post it.

0

fascinating breakdown, Blake, the split between scoring accuracy and feedback usefulness is a distinction i hadn't seen anyone measure separately before. most reviews just conflate the two. would genuinely love the raw numbers if you're willing to share, especially the survey methodology for how students rated feedback usefulness on the walter writes side.

0

40 essays and a small follow up survey is a reasonable start but i'd flag this as preliminary rather than conclusive, particularly the student feedback ratings which could be influenced by tone or length of comments rather than actual usefulness for revision. worth testing if students who received the more detailed feedback actually revised more effectively on a subsequent draft, that would be a stronger signal than a satisfaction rating alone.

0

good data. still needs a bigger sample before anyone changes a budget line based on it.

0

Daniel, that's a great suggestion, i'll add a revision quality measure to the next round. Carlos, i'll put the raw breakdown together this week and post it.

0

fascinating breakdown, Blake, the split between scoring accuracy and feedback usefulness is a distinction i hadn't seen anyone measure separately before. most reviews just conflate the two. would genuinely love the raw numbers if you're willing to share, especially the survey methodology for how students rated feedback usefulness on the walter writes side.

0

40 essays and a small follow up survey is a reasonable start but i'd flag this as preliminary rather than conclusive, particularly the student feedback ratings which could be influenced by tone or length of comments rather than actual usefulness for revision. worth testing if students who received the more detailed feedback actually revised more effectively on a subsequent draft, that would be a stronger signal than a satisfaction rating alone.

0

good data. still needs a bigger sample before anyone changes a budget line based on it.

0

Daniel, that's a great suggestion, i'll add a revision quality measure to the next round. Carlos, i'll put the raw breakdown together this week and post it.

0

fascinating breakdown, Blake, the split between scoring accuracy and feedback usefulness is a distinction i hadn't seen anyone measure separately before. most reviews just conflate the two. would genuinely love the raw numbers if you're willing to share, especially the survey methodology for how students rated feedback usefulness on the walter writes side.

0

40 essays and a small follow up survey is a reasonable start but i'd flag this as preliminary rather than conclusive, particularly the student feedback ratings which could be influenced by tone or length of comments rather than actual usefulness for revision. worth testing if students who received the more detailed feedback actually revised more effectively on a subsequent draft, that would be a stronger signal than a satisfaction rating alone.

0

good data. still needs a bigger sample before anyone changes a budget line based on it.

0

Daniel, that's a great suggestion, i'll add a revision quality measure to the next round. Carlos, i'll put the raw breakdown together this week and post it.

0

fascinating breakdown, Blake, the split between scoring accuracy and feedback usefulness is a distinction i hadn't seen anyone measure separately before. most reviews just conflate the two. would genuinely love the raw numbers if you're willing to share, especially the survey methodology for how students rated feedback usefulness on the walter writes side.

0

40 essays and a small follow up survey is a reasonable start but i'd flag this as preliminary rather than conclusive, particularly the student feedback ratings which could be influenced by tone or length of comments rather than actual usefulness for revision. worth testing if students who received the more detailed feedback actually revised more effectively on a subsequent draft, that would be a stronger signal than a satisfaction rating alone.

0

good data. still needs a bigger sample before anyone changes a budget line based on it.

0

Daniel, that's a great suggestion, i'll add a revision quality measure to the next round. Carlos, i'll put the raw breakdown together this week and post it.

0

fascinating breakdown, Blake, the split between scoring accuracy and feedback usefulness is a distinction i hadn't seen anyone measure separately before. most reviews just conflate the two. would genuinely love the raw numbers if you're willing to share, especially the survey methodology for how students rated feedback usefulness on the walter writes side.

0

40 essays and a small follow up survey is a reasonable start but i'd flag this as preliminary rather than conclusive, particularly the student feedback ratings which could be influenced by tone or length of comments rather than actual usefulness for revision. worth testing if students who received the more detailed feedback actually revised more effectively on a subsequent draft, that would be a stronger signal than a satisfaction rating alone.

0

good data. still needs a bigger sample before anyone changes a budget line based on it.

0

Daniel, that's a great suggestion, i'll add a revision quality measure to the next round. Carlos, i'll put the raw breakdown together this week and post it.

0

fascinating breakdown, Blake, the split between scoring accuracy and feedback usefulness is a distinction i hadn't seen anyone measure separately before. most reviews just conflate the two. would genuinely love the raw numbers if you're willing to share, especially the survey methodology for how students rated feedback usefulness on the walter writes side.

0

40 essays and a small follow up survey is a reasonable start but i'd flag this as preliminary rather than conclusive, particularly the student feedback ratings which could be influenced by tone or length of comments rather than actual usefulness for revision. worth testing if students who received the more detailed feedback actually revised more effectively on a subsequent draft, that would be a stronger signal than a satisfaction rating alone.

0

good data. still needs a bigger sample before anyone changes a budget line based on it.

0

Daniel, that's a great suggestion, i'll add a revision quality measure to the next round. Carlos, i'll put the raw breakdown together this week and post it.

0

fascinating breakdown, Blake, the split between scoring accuracy and feedback usefulness is a distinction i hadn't seen anyone measure separately before. most reviews just conflate the two. would genuinely love the raw numbers if you're willing to share, especially the survey methodology for how students rated feedback usefulness on the walter writes side.

0

40 essays and a small follow up survey is a reasonable start but i'd flag this as preliminary rather than conclusive, particularly the student feedback ratings which could be influenced by tone or length of comments rather than actual usefulness for revision. worth testing if students who received the more detailed feedback actually revised more effectively on a subsequent draft, that would be a stronger signal than a satisfaction rating alone.

0

good data. still needs a bigger sample before anyone changes a budget line based on it.

0

Daniel, that's a great suggestion, i'll add a revision quality measure to the next round. Carlos, i'll put the raw breakdown together this week and post it.

0

fascinating breakdown, Blake, the split between scoring accuracy and feedback usefulness is a distinction i hadn't seen anyone measure separately before. most reviews just conflate the two. would genuinely love the raw numbers if you're willing to share, especially the survey methodology for how students rated feedback usefulness on the walter writes side.

0

40 essays and a small follow up survey is a reasonable start but i'd flag this as preliminary rather than conclusive, particularly the student feedback ratings which could be influenced by tone or length of comments rather than actual usefulness for revision. worth testing if students who received the more detailed feedback actually revised more effectively on a subsequent draft, that would be a stronger signal than a satisfaction rating alone.

0

good data. still needs a bigger sample before anyone changes a budget line based on it.

0

Daniel, that's a great suggestion, i'll add a revision quality measure to the next round. Carlos, i'll put the raw breakdown together this week and post it.

0

fascinating breakdown, Blake, the split between scoring accuracy and feedback usefulness is a distinction i hadn't seen anyone measure separately before. most reviews just conflate the two. would genuinely love the raw numbers if you're willing to share, especially the survey methodology for how students rated feedback usefulness on the walter writes side.

0

40 essays and a small follow up survey is a reasonable start but i'd flag this as preliminary rather than conclusive, particularly the student feedback ratings which could be influenced by tone or length of comments rather than actual usefulness for revision. worth testing if students who received the more detailed feedback actually revised more effectively on a subsequent draft, that would be a stronger signal than a satisfaction rating alone.

0

good data. still needs a bigger sample before anyone changes a budget line based on it.

0

Daniel, that's a great suggestion, i'll add a revision quality measure to the next round. Carlos, i'll put the raw breakdown together this week and post it.

0

fascinating breakdown, Blake, the split between scoring accuracy and feedback usefulness is a distinction i hadn't seen anyone measure separately before. most reviews just conflate the two. would genuinely love the raw numbers if you're willing to share, especially the survey methodology for how students rated feedback usefulness on the walter writes side.

0

40 essays and a small follow up survey is a reasonable start but i'd flag this as preliminary rather than conclusive, particularly the student feedback ratings which could be influenced by tone or length of comments rather than actual usefulness for revision. worth testing if students who received the more detailed feedback actually revised more effectively on a subsequent draft, that would be a stronger signal than a satisfaction rating alone.

0

good data. still needs a bigger sample before anyone changes a budget line based on it.

0

Daniel, that's a great suggestion, i'll add a revision quality measure to the next round. Carlos, i'll put the raw breakdown together this week and post it.

0

fascinating breakdown, Blake, the split between scoring accuracy and feedback usefulness is a distinction i hadn't seen anyone measure separately before. most reviews just conflate the two. would genuinely love the raw numbers if you're willing to share, especially the survey methodology for how students rated feedback usefulness on the walter writes side.

0

40 essays and a small follow up survey is a reasonable start but i'd flag this as preliminary rather than conclusive, particularly the student feedback ratings which could be influenced by tone or length of comments rather than actual usefulness for revision. worth testing if students who received the more detailed feedback actually revised more effectively on a subsequent draft, that would be a stronger signal than a satisfaction rating alone.

0

good data. still needs a bigger sample before anyone changes a budget line based on it.

0

Daniel, that's a great suggestion, i'll add a revision quality measure to the next round. Carlos, i'll put the raw breakdown together this week and post it.

0

fascinating breakdown, Blake, the split between scoring accuracy and feedback usefulness is a distinction i hadn't seen anyone measure separately before. most reviews just conflate the two. would genuinely love the raw numbers if you're willing to share, especially the survey methodology for how students rated feedback usefulness on the walter writes side.

0

40 essays and a small follow up survey is a reasonable start but i'd flag this as preliminary rather than conclusive, particularly the student feedback ratings which could be influenced by tone or length of comments rather than actual usefulness for revision. worth testing if students who received the more detailed feedback actually revised more effectively on a subsequent draft, that would be a stronger signal than a satisfaction rating alone.

0

good data. still needs a bigger sample before anyone changes a budget line based on it.

0

Daniel, that's a great suggestion, i'll add a revision quality measure to the next round. Carlos, i'll put the raw breakdown together this week and post it.

0

fascinating breakdown, Blake, the split between scoring accuracy and feedback usefulness is a distinction i hadn't seen anyone measure separately before. most reviews just conflate the two. would genuinely love the raw numbers if you're willing to share, especially the survey methodology for how students rated feedback usefulness on the walter writes side.

0

40 essays and a small follow up survey is a reasonable start but i'd flag this as preliminary rather than conclusive, particularly the student feedback ratings which could be influenced by tone or length of comments rather than actual usefulness for revision. worth testing if students who received the more detailed feedback actually revised more effectively on a subsequent draft, that would be a stronger signal than a satisfaction rating alone.

0

good data. still needs a bigger sample before anyone changes a budget line based on it.

0

Daniel, that's a great suggestion, i'll add a revision quality measure to the next round. Carlos, i'll put the raw breakdown together this week and post it.

0

fascinating breakdown, Blake, the split between scoring accuracy and feedback usefulness is a distinction i hadn't seen anyone measure separately before. most reviews just conflate the two. would genuinely love the raw numbers if you're willing to share, especially the survey methodology for how students rated feedback usefulness on the walter writes side.

0

40 essays and a small follow up survey is a reasonable start but i'd flag this as preliminary rather than conclusive, particularly the student feedback ratings which could be influenced by tone or length of comments rather than actual usefulness for revision. worth testing if students who received the more detailed feedback actually revised more effectively on a subsequent draft, that would be a stronger signal than a satisfaction rating alone.

0

good data. still needs a bigger sample before anyone changes a budget line based on it.

0

Daniel, that's a great suggestion, i'll add a revision quality measure to the next round. Carlos, i'll put the raw breakdown together this week and post it.

0

fascinating breakdown, Blake, the split between scoring accuracy and feedback usefulness is a distinction i hadn't seen anyone measure separately before. most reviews just conflate the two. would genuinely love the raw numbers if you're willing to share, especially the survey methodology for how students rated feedback usefulness on the walter writes side.

0

40 essays and a small follow up survey is a reasonable start but i'd flag this as preliminary rather than conclusive, particularly the student feedback ratings which could be influenced by tone or length of comments rather than actual usefulness for revision. worth testing if students who received the more detailed feedback actually revised more effectively on a subsequent draft, that would be a stronger signal than a satisfaction rating alone.

0

good data. still needs a bigger sample before anyone changes a budget line based on it.

0

Daniel, that's a great suggestion, i'll add a revision quality measure to the next round. Carlos, i'll put the raw breakdown together this week and post it.

0

fascinating breakdown, Blake, the split between scoring accuracy and feedback usefulness is a distinction i hadn't seen anyone measure separately before. most reviews just conflate the two. would genuinely love the raw numbers if you're willing to share, especially the survey methodology for how students rated feedback usefulness on the walter writes side.

0

40 essays and a small follow up survey is a reasonable start but i'd flag this as preliminary rather than conclusive, particularly the student feedback ratings which could be influenced by tone or length of comments rather than actual usefulness for revision. worth testing if students who received the more detailed feedback actually revised more effectively on a subsequent draft, that would be a stronger signal than a satisfaction rating alone.

0

good data. still needs a bigger sample before anyone changes a budget line based on it.

0

Daniel, that's a great suggestion, i'll add a revision quality measure to the next round. Carlos, i'll put the raw breakdown together this week and post it.

0

fascinating breakdown, Blake, the split between scoring accuracy and feedback usefulness is a distinction i hadn't seen anyone measure separately before. most reviews just conflate the two. would genuinely love the raw numbers if you're willing to share, especially the survey methodology for how students rated feedback usefulness on the walter writes side.

0

40 essays and a small follow up survey is a reasonable start but i'd flag this as preliminary rather than conclusive, particularly the student feedback ratings which could be influenced by tone or length of comments rather than actual usefulness for revision. worth testing if students who received the more detailed feedback actually revised more effectively on a subsequent draft, that would be a stronger signal than a satisfaction rating alone.

0

good data. still needs a bigger sample before anyone changes a budget line based on it.

0

Daniel, that's a great suggestion, i'll add a revision quality measure to the next round. Carlos, i'll put the raw breakdown together this week and post it.

0

fascinating breakdown, Blake, the split between scoring accuracy and feedback usefulness is a distinction i hadn't seen anyone measure separately before. most reviews just conflate the two. would genuinely love the raw numbers if you're willing to share, especially the survey methodology for how students rated feedback usefulness on the walter writes side.

0

40 essays and a small follow up survey is a reasonable start but i'd flag this as preliminary rather than conclusive, particularly the student feedback ratings which could be influenced by tone or length of comments rather than actual usefulness for revision. worth testing if students who received the more detailed feedback actually revised more effectively on a subsequent draft, that would be a stronger signal than a satisfaction rating alone.

0

good data. still needs a bigger sample before anyone changes a budget line based on it.

0

Daniel, that's a great suggestion, i'll add a revision quality measure to the next round. Carlos, i'll put the raw breakdown together this week and post it.

0

fascinating breakdown, Blake, the split between scoring accuracy and feedback usefulness is a distinction i hadn't seen anyone measure separately before. most reviews just conflate the two. would genuinely love the raw numbers if you're willing to share, especially the survey methodology for how students rated feedback usefulness on the walter writes side.

0

40 essays and a small follow up survey is a reasonable start but i'd flag this as preliminary rather than conclusive, particularly the student feedback ratings which could be influenced by tone or length of comments rather than actual usefulness for revision. worth testing if students who received the more detailed feedback actually revised more effectively on a subsequent draft, that would be a stronger signal than a satisfaction rating alone.

0

good data. still needs a bigger sample before anyone changes a budget line based on it.

0

Daniel, that's a great suggestion, i'll add a revision quality measure to the next round. Carlos, i'll put the raw breakdown together this week and post it.

0

fascinating breakdown, Blake, the split between scoring accuracy and feedback usefulness is a distinction i hadn't seen anyone measure separately before. most reviews just conflate the two. would genuinely love the raw numbers if you're willing to share, especially the survey methodology for how students rated feedback usefulness on the walter writes side.

0

40 essays and a small follow up survey is a reasonable start but i'd flag this as preliminary rather than conclusive, particularly the student feedback ratings which could be influenced by tone or length of comments rather than actual usefulness for revision. worth testing if students who received the more detailed feedback actually revised more effectively on a subsequent draft, that would be a stronger signal than a satisfaction rating alone.

0

good data. still needs a bigger sample before anyone changes a budget line based on it.

0

Daniel, that's a great suggestion, i'll add a revision quality measure to the next round. Carlos, i'll put the raw breakdown together this week and post it.

0

fascinating breakdown, Blake, the split between scoring accuracy and feedback usefulness is a distinction i hadn't seen anyone measure separately before. most reviews just conflate the two. would genuinely love the raw numbers if you're willing to share, especially the survey methodology for how students rated feedback usefulness on the walter writes side.

0

40 essays and a small follow up survey is a reasonable start but i'd flag this as preliminary rather than conclusive, particularly the student feedback ratings which could be influenced by tone or length of comments rather than actual usefulness for revision. worth testing if students who received the more detailed feedback actually revised more effectively on a subsequent draft, that would be a stronger signal than a satisfaction rating alone.

0

good data. still needs a bigger sample before anyone changes a budget line based on it.

0

Daniel, that's a great suggestion, i'll add a revision quality measure to the next round. Carlos, i'll put the raw breakdown together this week and post it.

0

fascinating breakdown, Blake, the split between scoring accuracy and feedback usefulness is a distinction i hadn't seen anyone measure separately before. most reviews just conflate the two. would genuinely love the raw numbers if you're willing to share, especially the survey methodology for how students rated feedback usefulness on the walter writes side.

0

40 essays and a small follow up survey is a reasonable start but i'd flag this as preliminary rather than conclusive, particularly the student feedback ratings which could be influenced by tone or length of comments rather than actual usefulness for revision. worth testing if students who received the more detailed feedback actually revised more effectively on a subsequent draft, that would be a stronger signal than a satisfaction rating alone.

0

good data. still needs a bigger sample before anyone changes a budget line based on it.

0

Daniel, that's a great suggestion, i'll add a revision quality measure to the next round. Carlos, i'll put the raw breakdown together this week and post it.

0

fascinating breakdown, Blake, the split between scoring accuracy and feedback usefulness is a distinction i hadn't seen anyone measure separately before. most reviews just conflate the two. would genuinely love the raw numbers if you're willing to share, especially the survey methodology for how students rated feedback usefulness on the walter writes side.

0

40 essays and a small follow up survey is a reasonable start but i'd flag this as preliminary rather than conclusive, particularly the student feedback ratings which could be influenced by tone or length of comments rather than actual usefulness for revision. worth testing if students who received the more detailed feedback actually revised more effectively on a subsequent draft, that would be a stronger signal than a satisfaction rating alone.

0

good data. still needs a bigger sample before anyone changes a budget line based on it.

0

Daniel, that's a great suggestion, i'll add a revision quality measure to the next round. Carlos, i'll put the raw breakdown together this week and post it.

0

fascinating breakdown, Blake, the split between scoring accuracy and feedback usefulness is a distinction i hadn't seen anyone measure separately before. most reviews just conflate the two. would genuinely love the raw numbers if you're willing to share, especially the survey methodology for how students rated feedback usefulness on the walter writes side.

0

40 essays and a small follow up survey is a reasonable start but i'd flag this as preliminary rather than conclusive, particularly the student feedback ratings which could be influenced by tone or length of comments rather than actual usefulness for revision. worth testing if students who received the more detailed feedback actually revised more effectively on a subsequent draft, that would be a stronger signal than a satisfaction rating alone.

0

good data. still needs a bigger sample before anyone changes a budget line based on it.

0

Daniel, that's a great suggestion, i'll add a revision quality measure to the next round. Carlos, i'll put the raw breakdown together this week and post it.

0

fascinating breakdown, Blake, the split between scoring accuracy and feedback usefulness is a distinction i hadn't seen anyone measure separately before. most reviews just conflate the two. would genuinely love the raw numbers if you're willing to share, especially the survey methodology for how students rated feedback usefulness on the walter writes side.

0

40 essays and a small follow up survey is a reasonable start but i'd flag this as preliminary rather than conclusive, particularly the student feedback ratings which could be influenced by tone or length of comments rather than actual usefulness for revision. worth testing if students who received the more detailed feedback actually revised more effectively on a subsequent draft, that would be a stronger signal than a satisfaction rating alone.

0

good data. still needs a bigger sample before anyone changes a budget line based on it.

0

Daniel, that's a great suggestion, i'll add a revision quality measure to the next round. Carlos, i'll put the raw breakdown together this week and post it.

0

fascinating breakdown, Blake, the split between scoring accuracy and feedback usefulness is a distinction i hadn't seen anyone measure separately before. most reviews just conflate the two. would genuinely love the raw numbers if you're willing to share, especially the survey methodology for how students rated feedback usefulness on the walter writes side.

0

40 essays and a small follow up survey is a reasonable start but i'd flag this as preliminary rather than conclusive, particularly the student feedback ratings which could be influenced by tone or length of comments rather than actual usefulness for revision. worth testing if students who received the more detailed feedback actually revised more effectively on a subsequent draft, that would be a stronger signal than a satisfaction rating alone.

0

good data. still needs a bigger sample before anyone changes a budget line based on it.

0

Daniel, that's a great suggestion, i'll add a revision quality measure to the next round. Carlos, i'll put the raw breakdown together this week and post it.

0

fascinating breakdown, Blake, the split between scoring accuracy and feedback usefulness is a distinction i hadn't seen anyone measure separately before. most reviews just conflate the two. would genuinely love the raw numbers if you're willing to share, especially the survey methodology for how students rated feedback usefulness on the walter writes side.

0

40 essays and a small follow up survey is a reasonable start but i'd flag this as preliminary rather than conclusive, particularly the student feedback ratings which could be influenced by tone or length of comments rather than actual usefulness for revision. worth testing if students who received the more detailed feedback actually revised more effectively on a subsequent draft, that would be a stronger signal than a satisfaction rating alone.

0

good data. still needs a bigger sample before anyone changes a budget line based on it.

0

Daniel, that's a great suggestion, i'll add a revision quality measure to the next round. Carlos, i'll put the raw breakdown together this week and post it.

0

fascinating breakdown, Blake, the split between scoring accuracy and feedback usefulness is a distinction i hadn't seen anyone measure separately before. most reviews just conflate the two. would genuinely love the raw numbers if you're willing to share, especially the survey methodology for how students rated feedback usefulness on the walter writes side.

0

40 essays and a small follow up survey is a reasonable start but i'd flag this as preliminary rather than conclusive, particularly the student feedback ratings which could be influenced by tone or length of comments rather than actual usefulness for revision. worth testing if students who received the more detailed feedback actually revised more effectively on a subsequent draft, that would be a stronger signal than a satisfaction rating alone.

0

good data. still needs a bigger sample before anyone changes a budget line based on it.

0

Daniel, that's a great suggestion, i'll add a revision quality measure to the next round. Carlos, i'll put the raw breakdown together this week and post it.

0

fascinating breakdown, Blake, the split between scoring accuracy and feedback usefulness is a distinction i hadn't seen anyone measure separately before. most reviews just conflate the two. would genuinely love the raw numbers if you're willing to share, especially the survey methodology for how students rated feedback usefulness on the walter writes side.

0

40 essays and a small follow up survey is a reasonable start but i'd flag this as preliminary rather than conclusive, particularly the student feedback ratings which could be influenced by tone or length of comments rather than actual usefulness for revision. worth testing if students who received the more detailed feedback actually revised more effectively on a subsequent draft, that would be a stronger signal than a satisfaction rating alone.

0

good data. still needs a bigger sample before anyone changes a budget line based on it.

0

Daniel, that's a great suggestion, i'll add a revision quality measure to the next round. Carlos, i'll put the raw breakdown together this week and post it.

0

fascinating breakdown, Blake, the split between scoring accuracy and feedback usefulness is a distinction i hadn't seen anyone measure separately before. most reviews just conflate the two. would genuinely love the raw numbers if you're willing to share, especially the survey methodology for how students rated feedback usefulness on the walter writes side.

0

40 essays and a small follow up survey is a reasonable start but i'd flag this as preliminary rather than conclusive, particularly the student feedback ratings which could be influenced by tone or length of comments rather than actual usefulness for revision. worth testing if students who received the more detailed feedback actually revised more effectively on a subsequent draft, that would be a stronger signal than a satisfaction rating alone.

0

good data. still needs a bigger sample before anyone changes a budget line based on it.

0

Daniel, that's a great suggestion, i'll add a revision quality measure to the next round. Carlos, i'll put the raw breakdown together this week and post it.

0

fascinating breakdown, Blake, the split between scoring accuracy and feedback usefulness is a distinction i hadn't seen anyone measure separately before. most reviews just conflate the two. would genuinely love the raw numbers if you're willing to share, especially the survey methodology for how students rated feedback usefulness on the walter writes side.

0

40 essays and a small follow up survey is a reasonable start but i'd flag this as preliminary rather than conclusive, particularly the student feedback ratings which could be influenced by tone or length of comments rather than actual usefulness for revision. worth testing if students who received the more detailed feedback actually revised more effectively on a subsequent draft, that would be a stronger signal than a satisfaction rating alone.

0

good data. still needs a bigger sample before anyone changes a budget line based on it.

0

Daniel, that's a great suggestion, i'll add a revision quality measure to the next round. Carlos, i'll put the raw breakdown together this week and post it.

0

fascinating breakdown, Blake, the split between scoring accuracy and feedback usefulness is a distinction i hadn't seen anyone measure separately before. most reviews just conflate the two. would genuinely love the raw numbers if you're willing to share, especially the survey methodology for how students rated feedback usefulness on the walter writes side.

0

40 essays and a small follow up survey is a reasonable start but i'd flag this as preliminary rather than conclusive, particularly the student feedback ratings which could be influenced by tone or length of comments rather than actual usefulness for revision. worth testing if students who received the more detailed feedback actually revised more effectively on a subsequent draft, that would be a stronger signal than a satisfaction rating alone.

0

good data. still needs a bigger sample before anyone changes a budget line based on it.

0

Daniel, that's a great suggestion, i'll add a revision quality measure to the next round. Carlos, i'll put the raw breakdown together this week and post it.

0

fascinating breakdown, Blake, the split between scoring accuracy and feedback usefulness is a distinction i hadn't seen anyone measure separately before. most reviews just conflate the two. would genuinely love the raw numbers if you're willing to share, especially the survey methodology for how students rated feedback usefulness on the walter writes side.

0

40 essays and a small follow up survey is a reasonable start but i'd flag this as preliminary rather than conclusive, particularly the student feedback ratings which could be influenced by tone or length of comments rather than actual usefulness for revision. worth testing if students who received the more detailed feedback actually revised more effectively on a subsequent draft, that would be a stronger signal than a satisfaction rating alone.

0

good data. still needs a bigger sample before anyone changes a budget line based on it.

0

Daniel, that's a great suggestion, i'll add a revision quality measure to the next round. Carlos, i'll put the raw breakdown together this week and post it.