WASHINGTON: Feed an Iranian news dispatch or a literary classic into some text detectors, and they return the same verdict: AI-generated. Then comes the pitch: pay to “humanize” the writing, a pattern experts say bears the hallmarks of a scam.
As AI falsehoods explode across social media, often outpacing the capacity of professional fact-checkers, bogus detectors risk adding another layer of deception to an already fractured information ecosystem.
While even reliable AI detectors can produce false results, researchers say a crop of fraudulent tools has emerged online, easily weaponized to discredit authentic content and tarnish reputations.
AFP’s fact-checkers identified three such text detectors that claim to estimate what percentage is AI-generated. The tools — prompted in four languages — not only misidentified authentic text as AI-generated but also attempted to monetize those errors.
One detector, JustDone AI, processed a human-written report about the US-Iran war and wrongly concluded it contained “88% AI content.” It then offered to scrub any trace of AI for a fee.
“Your AI text is humanizing,” the site claimed, leading to a page where “100% unique text” was locked behind a paywall charging up to $9.99.
Two other tools — TextGuard and Refinely — produced similar false positives and sought to monetize them.
‘Scams’
AFP presented its findings to all three detectors.
“Our system operates using modern AI models, and the results it provides are considered accurate within our technology,” TextGuard’s support team told AFP.
“At the same time, we cannot guarantee or compare results with other systems.”
JustDone also reiterated that “no AI detector can guarantee 100 percent accuracy.”
It acknowledged the free version of its AI detector “may provide less precise results” due to “high demand and the use of a lighter model designed for quick access.”
Echoing AFP’s findings, one user on a review platform complained that “even with 100% human-written material, JustDone still flags it as AI.”
AFP fed the tools multiple human-written samples — in Dutch, Greek, Hungarian, and English.
All were wrongly flagged as having high AI content, including passages from an acclaimed 1916 Hungarian classic.
The tools returned AI flags regardless of input — even for nonsensical text.
JustDone and Refinely appeared to operate even without an internet connection, suggesting their results may be scripted rather than genuine technical analysis.
“These are not AI detectors but scams to sell a ‘humanizing’ tool that will often return what we call ‘tortured phrases’” — unrelated jargon or nonsensical alternatives — Debora Weber-Wulff, a Germany-based academic who has researched detection tools, told AFP.