AI Detection · Posted by Frank Cloutier ·

I Ran My Own Writing Through a Detector. 38% AI Score. I’ve Been Teaching 12 Years.

14

Decided to test what these tools would say about my own writing. Ran the first three paragraphs of a unit handout I wrote entirely myself through GPTZero.

38% probability of AI generation.

I have been teaching for twelve years. I wrote that handout. There is no universe in which that text was AI-generated.

What this told me: either my writing style happens to share patterns with AI text (which tells you something about how AI was trained – on human text), or the tool is generating false confidence numbers that have no relationship to reality.

Either way: if my own writing gets a 38% flag, what are we doing using these scores to investigate students? The baseline false positive rate on authentic human writing is apparently not low enough to justify any formal process.

3 replies

3 Replies

5

Has anyone tried running their OWN writing through these detectors? You'd be surprised. Mine came back at 22% on a lesson plan I wrote by hand in 20 minutes. The more formal and organized your writing is, the more it apparently looks like AI to these tools.

6

i ran my department handbook section through GPTZero last month. 44%. i co-wrote it with another teacher, meetings over three weeks, genuinely agonized over the language. 44% AI. at what point does admin start questioning teacher content too?

0

trust the technology. same admin that can't unmute on Zoom.