# Fourth-round corrections

Generated 2026-07-31 07:00.

## Exact citation attrition
| Step | Pairs |
|---|---|
| Pairs formed 1:1 without replacement | 8594 |
| Pairs lost: machine member not returned by OpenAlex | -92 |
| Pairs lost: control member not returned by OpenAlex | -49 |
| Pairs lost: neither member returned | -5 |
| Complete pairs analysed | 8448 |
| Duplicate retrieved records collapsed (records, not pairs) | 143 |
| Distinct DOIs affected by duplication | 143 |

## Paired binary outcomes (McNemar)
| Outcome | Pairs | Machine % | Control % | Discordant M-only | Discordant C-only | Paired difference pp (95% CI) | McNemar chi-square | p |
|---|---|---|---|---|---|---|---|---|
| Cited in any post-retraction calendar year | 8407 | 55.44 | 64.98 | 1545 | 2347 | -9.54 (-10.98 to -8.1) | 164.85 | < 1e-15 |
| Cited in the first post-retraction calendar year | 8407 | 46.41 | 55.86 | 1673 | 2467 | -9.44 (-10.93 to -7.96) | 151.9 | < 1e-15 |
| Cited in the first two post-retraction calendar years | 7259 | 59.9 | 65.39 | 1510 | 1909 | -5.5 (-7.07 to -3.92) | 46.33 | 1.0e-11 |
| Cited in the first three post-retraction calendar years | 5854 | 63.99 | 67.05 | 1232 | 1411 | -3.06 (-4.78 to -1.34) | 11.99 | 5.4e-4 |
| Flagged as retracted in OpenAlex | 8448 | 98.39 | 97.86 | 168 | 123 | 0.53 (0.14 to 0.93) | 6.65 | 0.010 |

## Paired citation rates (Wilcoxon signed-rank and paired bootstrap)
Pairs with exposure in both members: 8407; non-zero within-pair differences: 6403.
Median within-pair difference 0 citations per article-year (paired bootstrap 95% CI 0 to 0); mean -0.4224.
Wilcoxon signed-rank z = -16.095, p < 1e-15.

## Paper-mill flag in the machine-attributed cohort before 2023
| Retraction period | Machine records | With paper-mill flag | Paper mill % |
|---|---|---|---|
| 2010-2019 | 28 | 0 | 0 |
| 2020 | 39 | 0 | 0 |
| 2021 | 481 | 0 | 0 |
| 2022 | 383 | 0 | 0 |

## Notice identifier quality
Machine records 9161; valid retraction DOI 9152; blank 0; literal 'unavailable' 9; other malformed 0; treated as singleton clusters 9.

