Verification and repair
Answer verification
Answer verification is checking a completed result against success conditions agreed at brief time, reporting hard and soft constraints separately.
Control sits with the agent
When to use it
Any task whose conditions can be stated in advance, which is often part of operational work.
What it prevents
Results that look complete but satisfy none of the constraints the person set in the brief.
Result checked1 soft miss
Against the conditions set before the run
MetEvery figure has a source. Hard condition.
MetNo competitor named without a public filing. Hard.
MissedUnder two pages. Soft condition, came to three.
Hard and soft reported separately, so one does not hide the other.
Where it is used
- Microsoft Magentic-UI: answer verification is one of its interaction mechanisms
- OrchVis: grounds goals to machine-checkable predicates, and scores hard and soft constraints separately
Sources
Related patterns: Goal and task separation · Artifacts as receipts