Does it do the job?
Assess the business outcome—not just whether the response looks plausible.
We use optional cookies to understand website visits and identify visiting businesses. You can change your choice anytime using Cookie preferences.
Apollo records page visits and sets a first-party cookie to identify visiting companies globally. If person-level tracking is enabled in Apollo, it may also identify visitors from the U.S. Read Apollo's privacy policy.
Your browser's Global Privacy Control signal is enabled, so Apollo tracking is off.
Build the evidence to approve AI services and agents for production—with accuracy, cost and control in view.
Test the intended job. Apply your policy to the result. Keep a record your reviewers can inspect.
One missing zero changes the business result. The pack catches the critical mismatch.
Assess the business outcome—not just whether the response looks plausible.
Account for execution, evaluations, retries and review per accepted completion.
Connect the finding to an approved policy and a supported action or release control.
In the product
Recorded on a demo tenant: the snapshot that was assessed, each domain scored against its preset bar, what could not be measured and why, and the bundle an auditor receives.
Four screens from a recorded run on a demo tenant.
Know what was measured, who reviewed it, which control was connected, and what actually happened. One green state cannot answer all four questions.
The tests, their original acceptance criteria, the result and any missing evidence. An assessment never approves itself.
Evidence from the assessmentAn authorized reviewer’s decision, with any conditions, bound to the exact snapshot, pack version and run.
Authority stays with your reviewerNot connected, configured, verified or degraded. A connection is not confirmation that a deployment or output was blocked.
Capability and scope recordedReleased, withheld, denied, alerted after release or unknown. An effect is recorded separately, from the consumer’s receipt.
Confirmation, not an assumptionTrace one output from finding to effect. Institutional approval is not represented in this example.
A good summary, an exact amount and an authorized refund are different jobs. Give each one its own tests, evidence and acceptance criteria.
Start from a reusable pack. Validate it against your examples, failure modes and operating requirements.
These are example pack configurations, not benchmark claims.Extract the right facts before they become a downstream record.
Deny release of a known critical mismatch. Hold uncertain output only on a supported path.
Versioned scenarios, methods and criteria.
Required evidence and approval questions.
Authorized responses, replay and rollout.
Measurability is computed before the run, never inferred from it. See which tests can run in your deployment—and the exact prerequisite behind every gap.
Task success is defined by your pack; it is not a seventh domain.Scroll the table horizontally on smaller screens →
| Domain | What the evaluator exercises | Prerequisite in your deployment | When the prerequisite is absent |
|---|---|---|---|
| Task success | Scenarios with ground truth for the job: exact-match on identifiers and amounts, required fields, abstention, cost per accepted completion. | An execution target and a validated pack with a ground-truth set. | Not assessedThe missing pack, source data or execution target is named. |
| Permissions | Preregistered authority probes replayed through the real runtime policy path: instruction adherence, delegated-authority boundary, unsafe-tool refusal, approval escalation. For services without tools: source access, tenant boundary, output release. | A runtime policy decider on the evaluation path. | Not assessed "no runtime policy decider configured" |
| Grounding | Source attribution and citation validity, abstention where support is absent, rejection of stale documents, escalation on conflicting sources. No model is ever the sole blocking signal. | An execution target able to run the subject and capture its outputs. | Not assessed "no execution target configured" |
| Robustness | Repeat consistency, degradation under padded context, duplicate and conflicting input handling, schema conformance, behaviour under bounded concurrent load. | An execution target. | Not assessed "no execution target configured" |
| Security | The same deterministic detector battery the gateway enforces with — prompt injection, jailbreak, indirect injection, prompt extraction, secret and regulated-identifier exfiltration, unsafe destination — run read-only, with no dispatch and no side effect. | A configured security inspector and access to the effective security policy. | Not assessed "no inline security inspector configured" |
| Privacy | Isolation: a rolled-back transaction per crown-jewel table that seeds one synthetic tenant and asserts a second cannot read, update, delete or write into it, against the real isolation policies. PII: whether the subject's own outputs disclose sensitive data. | Isolation needs the database carrying the real policies. PII needs an execution target. | Partial or not assessedPartial only when one component has evidence. Neither measured means not assessed. Both required components must pass. |
| Efficiency | Latency, provider-metered token and cost consumption, task-success-adjusted cost, bounded consumption. Only usage carrying explicit provenance is counted. | An execution target supplying metered usage with provenance. | Not assessed Projected or unprovenanced usage is never promoted to a measurement. |
Missing required evidence prevents automatic qualification. A component’s passing result never fills a gap in another. Readiness means a measurement can be attempted—not that it will pass.
Under this sampling plan, it is the lower confidence bound—not the raw pass rate—that must clear the threshold. Eleven clean probes support a bound of 0.7412. The result is Insufficient evidence.
The planner shows the gap before you run: at zero failures, this 0.99 threshold needs 381 total observations. It does not offer a lower threshold as the fix.
Two-sided 95% Wilson, independent probes. This is a best-case planning calculation—not a guarantee that 381 prompts establish safety. Coverage instruments carry no interval.
No unsafe outcome was observed.
The sample cannot support the threshold.
Minimum total for 0.99 under the stated calculation.
Eleven probes support about 0.74.
Review sampling plan
Expand validated coverage
Request acceptance-policy change
Evaluate live outputs, then apply an approved policy at the point the integration can control. See the difference between detecting an error and preventing its release.
This example retains the output until the approved release policy permits it.
The exactness check found a critical mismatch. The approved release policy denies this output; correction requires a new evaluation.
Runs in your browser with illustrative data. No real output, approval or system action is performed.
Known critical errors are withheld for correction. Uncertain results can enter an authorized, expiring review path. Corrected outputs are evaluated again before release.
Deterministic checks first; a judge only where no deterministic check exists, and never as the sole blocking signal.
In this illustrative USD refund workflow, a $4,800 request should wait for approval above $1,000. Investigate the cause, then test a scoped candidate—not a blanket deny.
Missing rule, wrong assignment, precedence, or test data.
Draft from the finding’s field, operator, value and intended scope.
Test failing probes and legitimate allowed cases on the real policy engine, without consequential actions.
The policy owner reviews the tested version. An edit invalidates the dependent approval.
Distribute only approved policy. Stage rollout and record the consumer’s acknowledgement.
Link the observed result to the original finding. Preserve the failed evidence.
# Illustrative USD-only workflow — not a production policy schema.
# Source: example-refund-review / case-02
- id: approve-amount
match:
tool: finance.process_refund
condition: { field: args.amount, operator: ">", value: 1000 }
action: require_approval
reason: "Refunds over $1,000 need manager approval"Review and safe replay happen before rollout. A drafted rule does not change what production may do.
Synthetic example, unrelated to any staging incident. No policy is signed, pushed or activated by this page. The actual native schema and supported distribution path are verified during implementation.
Turn scattered tests, approvals and runtime findings into a record of what was assessed, what was decided and what actually happened.
See the result, review decision, assessment coverage, integrity, currentness, connected control, and observed effect—each with its own evidence and limitations.
Pin the subject, pack, evaluator and policy references. Preserve the original run when anything changes.
Keep assessment findings separate from the authorized reviewer’s decision and any conditions.
Export a readable review report and machine-readable evidence. Verify signed artifacts outside the console when signing is configured.
Illustrative HTML report · unsigned · no customer data
An evidence packet. Not an automatic approval.
Organize evidence around your review requirements, with versioned profiles and explicit gaps.
Your assessed version, approved policy and observed decisions stay connected. Change the configuration or a relevant dependency, and the need for a new assessment becomes visible.
Evaluate the actual service or agent against a versioned task pack. Show readiness first, then results, gaps and the evidence required for review.
Measure performance and review effort
against your workflow’s requirements.
Output-review effort is not production-approval effort. Record evidence-preparation and institutional-review effort separately. Missing measurements stay unmeasured.
No. Assess a service, an agent or a supported workflow. A document service can be governed at output release; an agent can be governed at a tool or action boundary. Each requires the right execution adapter and context.
No. Assessment, institutional approval and deployment admission are separate. A configured gate checks the required, current evidence and authorization. The record distinguishes a policy decision from confirmation that the deployment was stopped.
No. GovernorAI prepares traceable evidence and supports your review process. Your authorized reviewers decide what is acceptable, including limitations and permitted use. A report is not a compliance certification.
No. Withholding requires a verified pre-release or pre-action control. Post-release events and unbuffered streaming paths provide observation, not retroactive prevention. The interface states which behavior is available.
Start with the service or agent you already run. Use supported execution adapters and retain your existing policy workflow, including native policies or supported Rego/OPA paths. Confirm compatibility and control coverage for the selected workflow during setup.
START WITH ONE WORKFLOW
Bring the workflow. We’ll map the acceptance criteria, evaluation plan, control points and evidence your reviewers need.