Methodology
How a verdict is reached
Every check follows the same nine steps. A verdict is about a statement, as it was worded on the day it was made. It is not a judgement of a person, an organisation or anyone's motives.
The nine steps
-
1 Find a public claim
A claim is checked when it is public, attributable to a named body or person, checkable against evidence, and about quality of life or the environment in Malta. Every side is held to the same standard.
You can see it: Candidate claims are listed openly, with their status, before any verdict.
-
2 Record the exact words
We quote the speaker, not a headline. The original statement is archived so that the record survives later edits. No report starts until the verbatim wording is found.
You can see it: Each claim page links the original and its archived copy.
-
3 Split it into checkable parts
A sentence often carries several claims, such as a number, a comparison and a cause. Each part is tested on its own, and the wording's conditions are kept.
You can see it: The report lists every part with its own finding.
-
4 Search the evidence, in order
Peer-reviewed research comes first, then independent datasets, then regulator and EU reports. News and advocacy material locate claims; they are never the only evidence for a finding.
You can see it: Every source is listed on the claim page, with an archived copy where one exists.
-
5 Grade the evidence
Each source gets a grade from A (controlled experiment) to D (assertion with no data). Where studies disagree, both sides are shown, with why they may differ.
You can see it: Grades appear beside the sources in each report.
-
6 Recompute the numbers
Figures are recalculated by scripts from data saved with its source and retrieval date, not checked by eye.
You can see it: The data and scripts are in the public repository.
-
7 Weigh it and give a verdict
One verdict on a five-point scale, with a confidence level. Misleading and Contradicted need documents or data that can be shown; inference alone is not enough.
You can see it: The documents behind a strong verdict are listed on the claim page.
-
8 Offer a right of reply
When the verdict is Not substantiated, Misleading or Contradicted, the body concerned receives the draft and a deadline, and its response is published alongside the check. Until then the check is labelled a draft. A check that finds a claim supported needs no reply.
You can see it: Each claim page shows where the reply stands.
-
9 Publish, then keep it current
Every check carries a version number and a change log. Errors are corrected openly, and each check records when its evidence was last reviewed.
You can see it: Anyone can contest a check, with evidence.
Where the evidence comes from
Sources are searched in this order. Higher tiers carry more weight when sources disagree.
- 1Peer-reviewed literature and systematic reviews.
- 2Independent datasets (Eurostat, EEA, NSO, WHO, Copernicus, national monitoring networks).
- 3Regulator and EU reports (for example the Commission's Environmental Implementation Review).
- 4News reports and advocacy material: used to find leads and quote what was said, never as the only evidence for a finding.
Evidence grades
- AControlled or randomised experiment
- BObservational study with a control or gradient
- CReview, professional guidance or official statistics summary
- DAssertion or anecdote with no data
A source known only through another paper's summary is marked as second-hand and is not presented as having been read.
The verdict scale
From the strongest support to the strongest evidence against. Not substantiated sits in the middle: the claim may be true, but it has not been shown.
- SupportedEvidence consistently backs the claim as stated.
- Largely supportedBacked by the evidence, with minor caveats that do not change the substance.
- Not substantiatedStated more strongly than the evidence offered or available allows. May be true in some conditions but has not been shown.
- MisleadingOmits material facts so that the overall impression is inaccurate, even if individual statements are defensible.
- ContradictedThe available evidence points against the claim.
Rules that apply to every verdict
- Misleading and Contradicted require documents or data that can be shown (
evidence_shownin the claim record). Inference alone is not enough. - A verdict applies to the claim as the speaker worded it, not to a headline or paraphrase of it. Where a headline drops a condition, say so.
- A verdict is not a judgement of motive. Nothing here says anyone acted in bad faith unless documents show it.
Confidence
- High: multiple independent lines of evidence agree.
- Moderate: evidence is relevant but incomplete or indirect.
- Low: evidence is thin, second-hand or conflicting.
An illustrative example
Invented to show the method. This is not a real claim.
- The claim. A local council says its new park now has “over 500 trees”.
- The parts. (a) Were more than 500 trees planted? (b) Are more than 500 trees there now? The wording “now has” makes (b) the claim being tested.
- The evidence. The council's planting invoices, which show trees bought rather than trees standing, and an independent survey that counts the living trees on the site.
- The numbers. The survey's tree count is recomputed from its published table.
Largely supported
If the survey counts about 480–520 living trees: the substance holds, with a minor caveat on “over”.
Not substantiated
If only invoices exist: planting is shown, but not that the trees are there now.
If the check found the claim Not substantiated, the council would be offered a right of reply before publication. Either way, a later survey would update the check with a new version.
More detail
- What a check represents, and what it does not
- The full methodology in the repository (verdict scale, evidence grades, standards, pattern tags)
- Corrections policy