arXiv Bans Researchers After AI Fabricates Fake Scientific Citations
By 813 Staff
Under the hood, a significant change is emerging — arXiv Bans Researchers After AI Fabricates Fake Scientific Citations, according to Elias Al (@iam_elias1) (in the last 24 hours).
Source: https://x.com/iam_elias1/status/2065860700472529395
If you submitted a paper to arXiv this week and got an immediate rejection, it might not be your science that’s the problem—it could be that an AI model falsely flagged your work as fraudulent. Internal documents and chatter among researchers on X, first amplified by tech analyst Elias Al (@iam_elias1), confirm that the preprint repository—which hosts over 2.4 million scientific papers—has begun banning researchers for what it calls “AI hallucinations.” The rollout has been anything but smooth.
Engineers close to the project say arXiv deployed a new automated screening tool designed to catch papers that appear to be generated by large language models. The system, trained on patterns of known AI-generated text, is now flagging legitimate submissions that contain statistically improbable phrasing—what the tool’s algorithm misidentifies as “hallucinated” content. In some cases, entire research accounts have been suspended without prior warning. The trigger? A single sentence that the model deemed too syntactically consistent with LLM output. The result: multiple established physicists and computer scientists can no longer upload new preprints, and their existing papers are listed as “withdrawn” without explanation.
Al’s thread, which has since been shared thousands of times, includes screenshots of arXiv’s automated rejection emails. They cite violations of a “Synthetic Content Policy” that, according to sources who have seen internal arXiv memos, was quietly implemented late last month. The policy bans “papers substantially generated by AI without transparent disclosure,” but the enforcement mechanism is clearly over-aggressive. Several researchers who corrected GPT-generated abstracts in their drafts—after using the tool for grammar—are now under review.
Why this matters immediately: arXiv is the backbone of rapid scientific communication in physics, mathematics, computer science, and increasingly biology. If the platform’s moderation bot is punishing legitimate work, the signal-to-noise problem it aimed to solve becomes a crisis of false positives. The repository has not issued a public statement as of this morning, though Al reports that a private channel among arXiv moderators indicates a patch is being tested. What remains uncertain is whether suspended accounts will be reinstated retroactively—or if the trust researchers place in the platform has already been quietly eroded.
