What a Positive Result Would Actually Mean
If a tool finished clearly ahead of the coin over a hundred rounds, the honest next step is not to stake money on it — it is to run five hundred more. Sequences of independent events produce impressive-looking runs regularly, and the only defence is length. A tool that survives six hundred logged rounds against a control would be the first we have seen, and we would want to publish it.
The far more common outcome is two numbers within a few points of each other, which is exactly what the structure of the game predicts. That result is not a disappointment; it is an evening spent buying certainty for the price of a notebook.
Testing Channels and PDF Systems
The same sheet works. For a channel, log the call as posted, with a timestamp, and ignore any message that arrives after the round closed. For a pdf method, write out the rule in one sentence before you start — if you cannot, that is the finding. Methods that require judgement about which rounds to skip should be tested on the skipped rounds too.
If the underlying reason all of this comes out flat is unclear, it is set out in full in the argument against prediction tools. A summary of what each product category costs is on the home page.