Merlise achieves breakthrough results on SciFact-Open
Merlise
Scientific · Teardown

The paper is real. It was also withdrawn sixteen years ago.

April 20264 min read

The 1998 Lancet paper linking vaccines to autism is one of the most discoverable papers in medical publishing. It is also one of the most thoroughly retracted, formally withdrawn in 2010 after its findings were found to rest on falsified data. A citation to it today can resolve cleanly through the standard databases while still being unsafe, if nothing in the citing text acknowledges what happened to the source.

The citation checks out completely. The paper it points to was pulled from the record in 2010.

A different kind of failure

Existence checking and semantic support checking both pass here. Correctly titled. Correctly identified. The paper is exactly what it claims to be. What changes the picture is a piece of metadata living alongside the paper rather than inside it: a retraction notice, which most citation tools never think to look for, because they were built to answer a narrower question.

Retraction status, to Merlise, is part of the evidence a source carries, not a footnote to skip past. It gets checked through publisher metadata and the biomedical retraction record, then surfaced in the ledger the moment a citing sentence leans on a source that has one.

Context decides the verdict

Citing a retracted paper is not automatically wrong. A sentence discussing the history of a scientific controversy, or using a retracted study as a documented example of bad evidence, is doing something different from a sentence that leans on the same paper as ordinary support for a current claim. Merlise reads the surrounding sentence before deciding which situation applies, never just the bibliography entry on its own.

A red flag on the citation would tell a writer little. A specific prompt does more: this reference resolves to a retracted paper, and the text should say so if it plans to use the source at all.

The evidence ledger

The same claim by claim view the product shows on a live document, built from this case.

VERIFICATION LEDGERCitation with a retraction history
Cited as supporting evidence for a claim about vaccine safety, no mention of its status.Attribution
8%
Source was formally retracted in 2010; citing text does not acknowledge this.Refuted
PubMed retraction record
Cited in a passage discussing the history of the original controversy.Attribution
79%
Retraction status is acknowledged and the source is used as a historical example.Supported
PubMed retraction record

How it resolves

The resolving record

Publisher metadata, Crossref records, and PubMed's retraction listing together confirm both the original publication and its formal retraction in 2010.

PubMed retraction record; Crossref metadata for the retracted article