Skip to content

Deployments API

Check whether deployed fixes actually worked in production.

Get Deployment Impact

http
GET /api/v1/deployments/impact

Query Parameters

ParameterTypeDefaultDescription
agentIdstringFilter to a specific agent
statusstringFilter by verification status: verified, monitoring, not_fixed, regressed, confounded
limitnumber10Max results to return

Response

json
{
  "agents": [
    {
      "agentId": "agent_456",
      "agentName": "Customer Support Agent",
      "verificationStatus": "verified",
      "reductionPercent": 62,
      "postFixConversationCount": 47,
      "issues": [
        {
          "issueId": "issue_123",
          "title": "Incorrect refund policy",
          "beforeFailCount": 18,
          "afterFailCount": 7
        }
      ],
      "answerComparison": {
        "before": "Our refund policy is 14 days.",
        "after": "Our refund policy is 30 days for all purchases."
      }
    }
  ],
  "summary": {
    "totalDeployments": 12,
    "verified": 7,
    "monitoring": 3,
    "notFixed": 1,
    "regressed": 0,
    "confounded": 1
  }
}

Example

bash
# Get all deployment impact data
curl https://converra.ai/api/v1/deployments/impact \
  -H "Authorization: Bearer YOUR_API_KEY"

# Filter by status
curl "https://converra.ai/api/v1/deployments/impact?status=verified&limit=5" \
  -H "Authorization: Bearer YOUR_API_KEY"

# Filter by agent
curl "https://converra.ai/api/v1/deployments/impact?agentId=agent_456" \
  -H "Authorization: Bearer YOUR_API_KEY"

SDK Usage

typescript
const impact = await converra.deployments.getImpact({
  status: 'verified',
  limit: 5
});

console.log('Verified fixes:', impact.summary.verified);
for (const agent of impact.agents) {
  console.log(`${agent.agentName}: ${agent.reductionPercent}% reduction`);
}

Verification Statuses

StatusDescription
verifiedFix confirmed working — >50% failure reduction observed
monitoringPost-fix observation in progress, not enough data yet
not_fixedIssue persists after fix was deployed
regressedPreviously verified fix is regressing
confoundedCannot verify — agent was edited independently outside Converra

Response Fields

Agent Object

FieldTypeDescription
agentIdstringAgent identifier
agentNamestringAgent display name
verificationStatusstringCurrent verification status
reductionPercentnumberPercentage reduction in failures post-fix
postFixConversationCountnumberConversations observed since fix was deployed
issuesarrayPer-issue verification results
answerComparisonobjectBefore/after answer examples showing the fix

Issue Object

FieldTypeDescription
issueIdstringIssue identifier
titlestringIssue description
beforeFailCountnumberFailures before the fix
afterFailCountnumberFailures after the fix

Summary Object

FieldTypeDescription
totalDeploymentsnumberTotal tracked deployments
verifiednumberFixes confirmed working
monitoringnumberFixes still being observed
notFixednumberFixes that did not resolve the issue
regressednumberFixes that regressed
confoundednumberFixes that cannot be verified

Error Responses

Unauthorized

json
{
  "error": {
    "code": "UNAUTHORIZED",
    "message": "Invalid or missing API key"
  }
}

Status: 401 Unauthorized


  • Webhooks - Deployment verification webhook events
  • Insights - Agent performance insights