Skip to content

PRACTICAL GUIDE / 2 min read

A practical checklist for your first supervised agent

Define the task, verify the reports, test a failure, and prove the review path before expanding.

Conceptual illustration of pink activity signals passing through a smoked-glass review checkpoint
Conceptual artwork created for Toolcaise. Product examples are illustrative.

THE PRACTICAL TAKEAWAY

Define the task, verify the reports, test a failure, and prove the review path before expanding.

Put it into practice with the pilot checklist →

1. Write down what done means

Name one workflow and its owner. Describe the expected artifact, where it will live, when it should arrive, and who will review it. If those answers are unclear, an integration alone will not make the workflow accountable.

2. Confirm the basic reporting path

Register an agent and store its scoped credential securely in the runner environment. Send a heartbeat, start a test run, report a meaningful step, and finish with an outcome. Confirm the events belong to the expected workspace. Do not include secrets, private prompts, or unnecessary personal data in free text.

3. Test a controlled failure

In a safe test environment, let one instrumented step fail. Inspect the history and ask a teammate to identify the failing step from the available evidence. Report a schedule where appropriate and verify that missing work can be distinguished from an agent that is offline.

4. Review an imperfect result

Create a sample output with a deliberate, harmless omission. Have the reviewer reject it with a specific reason, then review a corrected result. This tests the human process rather than only the success path.

5. Exercise the control boundary

If the workflow needs approval, use a harmless test action. Check that it waits, that rejection prevents the integrated action, and that the approved authorization is consumed once. Test cooperative pause and cancellation at actual checkpoints. Do not assume they stop an external operation already underway.

6. Agree the pilot measures

Track expected versus received runs, reviewed versus unreviewed outcomes, and investigation time. Record your starting point. Review the evidence after a representative operating period and decide whether to expand, revise, or stop the pilot.

KEEP EXPLORING

Continue the field guide.

START WITH ONE WORKFLOW

Put your next run
under supervision.

Connect the agent you already run. Build confidence from the work you can actually review.