When should an experiment commit to stopping?
https://github.com/research-farm/construct/blob/main/notes/walkthrough/14_GREENREACH_CLOSE.md
A stop rule written after the result can explain almost any outcome. The same rule written before contact with the result constrains what the researcher may call success.
Precommitment
An experiment can name the conditions that stop a run, confound a claim, require a retraction, or move the work into a different result class. These conditions should be attached to evidence the result cannot rewrite.
Precommitment does not make the instrument correct. It makes later discretion visible. This matters most when an attractive result arrives with a defect that would be easy to excuse.
Questions to carry forward
Which failure should stop the line? Which defect requires repair and a fresh run? What evidence makes the result uninterpretable? Who is allowed to override the stop, and where is that override recorded?
The useful rule is the one already waiting when judgment becomes tempted.