Get started
Security & GovernanceEvidenceProofTesting

How a Quox proof case earns the word verified

The Evidence Explorer now lists 241 verified proof cases, up from 220 yesterday. A case earns that word only when its newest run passed and it has passed on two separate days, on every kind of install it has been tested on.

Adam Cowles16 November 20263 min read
Two glowing blue calendar day markers joined by a thin line, leading to a violet seal with a check mark, over near-black

This morning the Evidence Explorer lists 241 verified proof cases. Yesterday it was 220, and on Saturday it was 175.

Those cases did not get easier. They ran again, overnight, and passed again on a new day. That second day is most of what the word verified means.

The rule

A proof case is listed as verified only when three things are true.

Its newest run passed. Not its best run. If a case passed last week and failed this morning, it is not verified, however good last week looked.

It has passed on two or more separate UTC days, on the same checks. One good afternoon is not enough. If the checks change, the count starts again.

It holds on every kind of install it has been tested on. Quox proves cases on its own install, and some of them on a clean install built from a release. If a case was ever tested on a clean install, it has to pass there too. A pass on one kind of install cannot cover for a failure or a skip on another.

Runs made from the owner's own account do not count toward any of this. Only the proof accounts do.

Why some cases wait

That third rule is why some cases that pass on Quox's own install every day are not yet on the verified list. They were also tested on a clean install some weeks ago, and that run did not pass. Until they pass on a fresh clean install, they wait.

We could make the number bigger by ignoring the clean install. We will not. A case that only works on the machine it was built on is not proven, so the fix is a fresh clean-install run, not a softer rule.

A journey that crossed the line

One of today's new verified cases is a full journey: Brain2: what did we decide, and why. Quox is asked about a past decision, answers from the recorded decision, and cites it. It passed on 9 November, then again on 15 and 16 November, on the same checks.

Its page now links the evidence bundle for the newest run, with a small verifier you can run yourself.

The email alerts journey page also says plainly how its run was driven: the proof engine talked to Quox through the chat API, a real person answered the approval card, and the transcript is copied word for word from the recorded run.

What this does not prove

  • This is Quox checking itself. Every item on the Explorer says so: checked by Quox's own proof engine, not an independent audit.
  • Verified means the checks held on those runs. It does not promise the next run will pass. If it fails, the case comes off the list until it passes again on two days.
  • The number is a count of cases, not of features. A case is one question with its checks; some features have many cases and some have none yet.