Transparent by design

How SemanticRisk measures AI interpretation

SemanticRisk observes how AI systems interpret public website content, compares those interpretations over time, supports cross-model comparison where multiple model observations are available, and separates meaningful semantic differences from simple wording variation.

Interpretation

What models say

We extract structured claims from model outputs so that observations can be compared consistently rather than judged from summaries alone.

Agreement

How models differ

Where multiple model observations are available, claims may be equivalent, possibly equivalent, narrower, broader, contradictory or unrelated. Shared vocabulary by itself is not treated as proof of equivalence.

Change

What changes over time

Repeated observations identify interpretation drift, including cases where model interpretation changes even when normalized source content appears unchanged.

Difference assessment

Not every extracted difference is material

A rewritten paragraph can preserve the same proposition, while one changed number, industry label, attribution or scope qualifier can alter the meaning. SemanticRisk considers the type and context of a difference, not only how many words changed.

Likely equivalent

Different wording appears to preserve the same central proposition.

Potentially meaningful

The difference may affect attribution, specificity, scope, classification or a verifiable fact, but the available evidence does not support a firm material verdict.

Material difference

The evidence supports a meaningful change in the proposition, its boundaries or its factual content.

Measurement pipeline

From website to evidence

Collect
Retrieve publicly accessible website content and record crawl conditions.
Interpret
Generate model observations using a controlled evaluation workflow.
Normalize
Convert model outputs into comparable claims, families and evidence records.
Compare
Measure agreement where comparable observations exist, plus scope differences, contradictions and time-based drift.
Review
Use conservative thresholds and human review where token evidence cannot establish semantic direction safely.
Important boundary

Model interpretations are not verified company facts

SemanticRisk reports how AI systems interpret available public content. It does not independently certify every extracted statement as legally, commercially or factually complete. The distinction is central to the product.

Versioning

Methods evolve with evidence

Calibration results are dated and based on the reviewed sample available at that time. New reviewed examples may change thresholds, classifications and published performance statistics.

Current public methodology snapshot: 31 July 2026.