This paper is just...glorious. It's the distilled, concentrated version of the decay of academia.
It's actually the tip of darker iceberg, but I need more time to put that together.
For now, let's enjoy the following:
First, the calculated I² for their included studies was...96%. That's...insane. I would not expect anyone to submit a meta-analysis with this level of heterogeneity. If someone did, I would expect a desk rejection and/or peer review rejection.
It also doesn't tell us anything about the effect size or direction. Simply put: the reason this value is so high is because the most modern and well-designed LDRT trial included (Fazilat-panah et al, 2025) showed a massive/significant benefit to LDRT, which washed out the older/poorly designed studies.
(My charitable hypothesis here is that the meta-analysis was submitted in March 2025 but not accepted till July 2025. The Fazilat-panah paper was published online in March 2025 and could not have been included in the original submission. My assumption is that the original version of the meta-analysis had a much lower/more reasonable I². When undergoing peer review, someone asked for this new study to be included. Of course, the question then becomes why the meta-analysis was accepted after revision, but I only have non-charitable hypotheses for that explanation.)
Second, while I don't think this meta-analysis was ENTIRELY crafted using an AI ChatBot, I suspect AI was...heavily relied on.
The most glaring evidence is in the "References" section.
The McAlindon JAMA paper is given a publication year of 1967 and a page number of 2017.
In reality, this paper was published in 2017 on page number 1967.
This is a classic, super annoying LLM problem called "metadata transposition hallucination".
LLMs see everything as tokens, and knows (predicts) what tokens are likely to (or should) occur together. In this case, an LLM "knows" that the McAlindon paper citation string contains "2017" and "1967".
But it doesn't understand the MEANING of these numbers (tokens), so it swapped them.
I would bet a lot of money that this wouldn't have happened if the page number was 3004, for example, because that would be a date a thousand years in the future, and the LLM would therefore be unlikely to predict that token in that location.
Of course, it's possible for a human to make an error like this but...unlikely.
Anyway, this paper is a beautiful example of the collapse of civilization.
I have questions about basic math skills in this paper, considering the body of the text states multiple times their pool had 1,750 patients but Table 1 only sums to...1,665 patients.
Hilariously, that discrepancy is a p value ≤ 0.05...strong work kids!