Verification and repair
Answer verification
Answer verification is checking a completed result against success conditions agreed at brief time, reporting hard and soft constraints separately.
Control sits with the agent
When to use it
Any task with conditions that can be stated in advance, which is most operational work and little creative work.
What it prevents
Results that look complete and satisfy none of the constraints the person actually cared about.
Result checked1 soft miss
Against the conditions set before the run
MetEvery figure carries a source. Hard condition.
MetNo competitor named without a public filing. Hard.
MissedUnder two pages. Soft condition, came to three.
Hard and soft reported separately, so one does not hide the other.
Who ships it
- Microsoft Magentic-UI: answer verification is one of its interaction mechanisms
- OrchVis: grounds goals to machine-checkable predicates, and scores hard and soft constraints separately
Sources
Related patterns: Goal and task separation · Artifacts as receipts