What AI worker taught us about acceptance
Evaluate completeness and accepted outputs, not fluent completion messages.
A result needs a reference
On an extraction task, a worker can return valid-looking JSON while omitting required items. Judge coverage, evidence links and invalid additions against a preregistered reference. A cheaper response can be expensive when review and retries are ignored.
Model names are not the verdict
Record the requested route, observed response, attempts and accounting. An interrupted response stays incomplete. Review marketing drafts for invented delivery times, support terms or performance: a worker proposal is not a product commitment.