Quick Start

Submit your first audit in under a minute.

Step 1: Submit a URL

Go to converra.ai/eval and paste the URL where your agent lives — usually the chat widget on your site, or a hosted demo page.

The URL needs to be publicly reachable. Anything behind login, IP allowlist, or paywall won't audit cleanly.

TIP

Foundation-model URLs (chat.openai.com, claude.ai, etc.) are blocked at submit — those aren't agents you control.

Step 2: Wait for the report

The audit runs through a scenario battery against your agent and scores the responses. You'll be redirected to a queued page that auto-advances when the report is ready.

Most audits finish in 60–90 seconds.

Step 3: Read the report

Reports render at /eval/r/[token] — a public, shareable URL. The token is unguessable, but anyone with the link can view the report unless you've explicitly made it private.

The report has four sections:

1. Hero score — single number, verdict, eval set used
2. Findings — what failed, with severity and a transcript snippet for each
3. Strengths — what passed, grouped by category
4. Custom metrics — agent-specific rubric (if applicable)

Step 4 (optional): Save to a Converra account

Click Save on the report. Enter your email — you'll get a magic link. No password setup.

Once saved, the report shows up in your dashboard and you can re-audit it later to see what's changed.

If you submitted reports anonymously before signing up, they auto-attach to your new account by browser attribution.

Step 5 (optional): Re-audit

Hit Re-audit on any saved report. The new run is compared against the previous one — score deltas, scenarios that flipped pass/fail, and a verdict-shift banner at the top of the report.

See Re-auditing for details.

What if my URL fails to load?

A few common reasons:

• Behind authentication — the audit runner can't log in
• Aggressive bot protection — Cloudflare turnstile, hCaptcha, etc. block the runner
• Foundation model — chat.openai.com, claude.ai, gemini.google.com are blocked by policy
• Placeholder URL — example.com, localhost, etc. are blocked by policy

If the audit fails, you're not charged.