v0.16.0¶
Release Date: 2026-11-15
Highlights¶
- Claims checked against several sources: a claim carries every quoted passage that bears on it, each with its stance, so a report records when reliable sources disagree, not only a single validating source
- Verdicts for disagreement:
contested,contradictedandcitation-gapjoin verified, unverified, needs-review and rejected - Judges and agreement: who checked a claim, with what confidence, and an optional second judge, with the second-check agreement rate in the summary
- Deterministic quotation matching: confirm a quotation is in its source's text, and find the figures a claim states that no quotation gives, without a model
Overview¶
A Claim used to carry one Validation: one source, one quoted passage. Checking claims for encyclopedia-style
attribution needs more: several sources, passages in other languages, sources that disagree, and a second judge.
v0.16.0 adds these as optional fields, so existing reports and lint output are unchanged.
It also adds the deterministic helpers that keep model judges honest. When two models agree a claim is supported,
MatchQuote confirms the quotation they rely on is in the source.
New Features¶
Multi-source evidence¶
claim.Evidence = []claims.Evidence{
{SourceRef: "src-registry", Stance: claims.StanceSupports, Quote: "fondata nel 1929", Language: "it",
Translation: &claims.Translation{Text: "founded in 1929", Language: "en"}, Role: claims.SourceRolePrimary},
{URL: "https://example.org/history", Stance: claims.StanceDisputes, Quote: "founded in 1930"},
}
Each Evidence names its source by SourceRef, URL or both, with a Stance (supports, disputes, context),
a verbatim Quote, a Locator, the quote's Language and a Translation, a Role and HowChecked.
SourceRoleSecondary is a secondary source whose kind is not recorded. Claim.SupportingQuotes() returns the
supporting passages with a quote from a named source.
New verdicts¶
| Verdict | Meaning | In the decision |
|---|---|---|
contested |
Sources disagree, or support only part of the claim | Like needs-review |
contradicted |
A source says otherwise | Fails the report, like rejected |
citation-gap |
Supported, but by a source other than the one cited | Like needs-review |
ClaimsCounts gains contested, contradicted and citationGap, omitted when zero. Verdict.NeedsPerson()
reports the verdicts that ask a person to decide.
Judges, confidence and second checks¶
Claim.CheckedBy and Claim.Confidence (high, medium, low) record who set the verdict and how sure it is.
Claim.Review records a second judge: whether it agreed and, when its verdict replaced the first, the first judge's
in FirstVerdict. Summary.SecondReview gives how many claims a second judge checked, how many it agreed with, and
the rate. ClaimsReport.Inaccessible lists sources a judge could not open.
Quotation and figure matching¶
m := claims.MatchQuote("During a Board ... Ugo Gobbato announced", sourceText)
// m.Found: every part between ellipses appears as whole words; m.InOrder: in the order quoted.
missing := claims.MissingFigures(claim.Text, quote, translation)
// "1,142,462" matches "1.142.462"; "1947, 45" is two numbers.
Matching ignores case, punctuation, quote styles, dashes, line breaks and a missing space between a number and a
word. NormalizeText, QuoteFragments and Figures are the building blocks.
Lint¶
A verified claim with no Validation passes verified-requires-validation when its Evidence has a quoted
supporting passage from a named source.
Fixes¶
- The HTML renderer showed only the original four verdict groups, so claims with the new verdicts were left out. They now have their own groups and count chips, and each claim lists its quoted evidence.
GenerateSummaryTextincludes the new verdicts when present.
TypeScript¶
@plexusone/[email protected]: Zod schemas and types regenerated for the new claim fields.
Compatibility¶
Every addition is optional and omitted when unused. Reports written before v0.16.0 parse, evaluate, lint and render unchanged.