Skip to content

Check whether the result was any good

Keep agent-reported success separate from human acceptance with an explicit outcome review record.

A run can succeed and still produce the wrong thing

A run can finish successfully and still produce an incomplete report, an irrelevant summary, or a result that needs correction. Make the quality decision visible.

The agent reported
CompletedReconciled 42 invoices against the ledger
Outcome review
Priya A.FinanceRejected

Reviewed at 10:42

The agent's claim and the review are recorded separately, so neither is mistaken for the other.

Illustration with sample data
  1. Review the actual deliverable

    Open the reported artifact in its source system. Compare it with the task brief, check supporting evidence, and confirm the output is usable before accepting the outcome.

  2. Record a human decision

    Accept or reject the reported outcome with review context. Keep the agent’s completion claim and the reviewer’s judgement distinct so neither is mistaken for the other.

  3. Use rejected work to improve the next run

    Look for repeated missing sources, formatting problems, or unsupported conclusions. Feed those specific observations back into the workflow you own.

Why a successful run needs a second question

An agent reports success when its code finished without an exception. That says nothing about whether the brief was met: the report might cover four competitors out of five, cite a source that does not support the claim, or answer a slightly different question. The only reliable check for work like this is a person who knows what good looks like, and that decision deserves its own record.

How an outcome reaches a reviewer

At the end of a run, the agent reports what it produced: a label, a status (succeeded, failed or unknown) and, optionally, a SHA-256 digest of the artifact so the reviewer can confirm they are looking at the same file.

client.outcome("weekly market brief", status="succeeded", artifact_digest=digest)
Python, inside the run

The outcome appears in the workspace as unreviewed. A reviewer opens the actual deliverable where it lives, compares it with the brief, and accepts or rejects it.

Two records that never overwrite each other

The agent’s report and the person’s decision are stored separately and neither can change the other.

  • The reported status is immutable once received. A later report with different wording does not rewrite it.
  • The review decision records who made it and when.
  • The history keeps every change, so you can see that an outcome was accepted, then rejected after a second look.

Using rejections to improve the agent

A single rejection is a bad result. A pattern of them is a specification problem. Look at what rejected outcomes have in common (missing sources, the wrong format, unsupported conclusions) and change the workflow you own: the prompt, the retrieval step or the definition of done. Then watch the acceptance rate for the next few runs rather than assuming the fix worked.

What review does not do

Toolcaise records the review. It does not open your documents, judge their accuracy or confirm they reached a client. Those checks stay with the reviewer and the systems the deliverable lives in.

Frequently asked questions

How do I review AI agent output?

Report an outcome at the end of each run, open the deliverable where it lives, compare it with the brief, and accept or reject it in Toolcaise. Keep the agent’s success claim and your decision as separate records so a finished run is never mistaken for an accepted result.

Can the agent change an outcome after it has been reviewed?

No. The reported status is stored once and later reports cannot overwrite it, and the review decision can only be changed by a person, with the change recorded in the outcome’s history.

Does Toolcaise store the files my agent produces?

No. The agent reports a label and, optionally, a digest of the artifact. The file stays in your own systems; the digest lets a reviewer confirm the file they opened is the one the run produced.

Connect your first agent

Create a free workspace, connect the agent you already run, and watch its next run arrive. Free covers 3 agents, with no card required.