AI Detection · Posted by Troy Landry ·

Turnitin AI Detection: What Teachers Need to Know

18

If your school uses Turnitin, you’ve probably noticed the AI detection feature that rolled out in the last couple of years. I wanted to break down what it actually does and what its limitations are.

Turnitin’s AI detection works alongside their traditional plagiarism checker. When a student submits a paper, you’ll see a percentage score indicating how much of the text their model believes was AI-generated. They report it as a probability, not a certainty.

Here’s what I’ve learned from using it in my own classroom:

The tool is generally better at detecting unedited AI output. If a student copies and pastes directly from ChatGPT, Turnitin catches it most of the time. But when students edit, paraphrase, or mix AI content with their own writing, the accuracy drops noticeably.

One thing that concerns me is false positives. Turnitin themselves have acknowledged that their tool can flag human-written text, particularly from non-native English speakers or students who write in a very structured, formulaic style. I’ve seen a few cases where a student’s legitimate work got flagged, and that created a really uncomfortable conversation.

My advice: use Turnitin’s AI detection as one data point, not as definitive proof. If the score comes back high, have a conversation with the student before jumping to conclusions. Ask them about their writing process. Look at their previous work. Consider whether the writing style matches what you know about them.

Has anyone else had experiences with false positives or false negatives with Turnitin’s AI detection?

7 replies

7 Replies

2

I presented findings similar to these at our board's professional development day last month. The administration was genuinely surprised by the false positive rates. We're now revising our academic integrity policy to require corroborating evidence beyond detection scores alone.

2

im new to all this ai stuff. my school just told us to 'use our judgment' which is super helpful lol. this thread is really helping me understand whats going on tho

7

bookmarking this whole thread. gold

2

The detection arms race reminds me of when schools tried to ban cell phones in the early 2000s. Complete waste of energy. The technology won. We adapted our teaching instead. I suspect the same will happen here. Five years from now, we'll look back at AI detection the way we look back at phone bans.

4

sorry if this is a dumb question but do these detectors work on google docs or do you have to copy paste the text somewhere? just started teaching this year and feeling pretty overwhelmed by all this

7

I'm not convinced these detection tools will ever be reliable enough for high-stakes decisions. The fundamental problem is that they're trying to distinguish between two types of text that are becoming increasingly similar. As AI models improve, the statistical patterns detectors rely on will become less distinctive. We might be investing in a technological dead end.

0

must be nice having admin that actually listens. ours just sends memos