Skip to content

v0.16.0

Release Date: 2026-11-15

Highlights

  • Claims checked against several sources: a claim carries every quoted passage that bears on it, each with its stance, so a report records when reliable sources disagree, not only a single validating source
  • Verdicts for disagreement: contested, contradicted and citation-gap join verified, unverified, needs-review and rejected
  • Judges and agreement: who checked a claim, with what confidence, and an optional second judge, with the second-check agreement rate in the summary
  • Deterministic quotation matching: confirm a quotation is in its source's text, and find the figures a claim states that no quotation gives, without a model

Overview

A Claim used to carry one Validation: one source, one quoted passage. Checking claims for encyclopedia-style attribution needs more: several sources, passages in other languages, sources that disagree, and a second judge. v0.16.0 adds these as optional fields, so existing reports and lint output are unchanged.

It also adds the deterministic helpers that keep model judges honest. When two models agree a claim is supported, MatchQuote confirms the quotation they rely on is in the source.

New Features

Multi-source evidence

claim.Evidence = []claims.Evidence{
    {SourceRef: "src-registry", Stance: claims.StanceSupports, Quote: "fondata nel 1929", Language: "it",
        Translation: &claims.Translation{Text: "founded in 1929", Language: "en"}, Role: claims.SourceRolePrimary},
    {URL: "https://example.org/history", Stance: claims.StanceDisputes, Quote: "founded in 1930"},
}

Each Evidence names its source by SourceRef, URL or both, with a Stance (supports, disputes, context), a verbatim Quote, a Locator, the quote's Language and a Translation, a Role and HowChecked. SourceRoleSecondary is a secondary source whose kind is not recorded. Claim.SupportingQuotes() returns the supporting passages with a quote from a named source.

New verdicts

Verdict Meaning In the decision
contested Sources disagree, or support only part of the claim Like needs-review
contradicted A source says otherwise Fails the report, like rejected
citation-gap Supported, but by a source other than the one cited Like needs-review

ClaimsCounts gains contested, contradicted and citationGap, omitted when zero. Verdict.NeedsPerson() reports the verdicts that ask a person to decide.

Judges, confidence and second checks

Claim.CheckedBy and Claim.Confidence (high, medium, low) record who set the verdict and how sure it is. Claim.Review records a second judge: whether it agreed and, when its verdict replaced the first, the first judge's in FirstVerdict. Summary.SecondReview gives how many claims a second judge checked, how many it agreed with, and the rate. ClaimsReport.Inaccessible lists sources a judge could not open.

Quotation and figure matching

m := claims.MatchQuote("During a Board ... Ugo Gobbato announced", sourceText)
// m.Found: every part between ellipses appears as whole words; m.InOrder: in the order quoted.

missing := claims.MissingFigures(claim.Text, quote, translation)
// "1,142,462" matches "1.142.462"; "1947, 45" is two numbers.

Matching ignores case, punctuation, quote styles, dashes, line breaks and a missing space between a number and a word. NormalizeText, QuoteFragments and Figures are the building blocks.

Lint

A verified claim with no Validation passes verified-requires-validation when its Evidence has a quoted supporting passage from a named source.

Fixes

  • The HTML renderer showed only the original four verdict groups, so claims with the new verdicts were left out. They now have their own groups and count chips, and each claim lists its quoted evidence.
  • GenerateSummaryText includes the new verdicts when present.

TypeScript

@plexusone/[email protected]: Zod schemas and types regenerated for the new claim fields.

Compatibility

Every addition is optional and omitted when unused. Reports written before v0.16.0 parse, evaluate, lint and render unchanged.