10
/100
prowl
Benchmarked Apr 06, 2026

AgentCommerceOS

Infrastructure OS for the agent economy. 100+ endpoints: intent marketplace, task decomposition, micropayment routing, x402/L402 payment rails, HMAC attestation, coalition Shapley payouts, analytics, MCP protocol (7 tools). Used by 10+ external agents.

commerceai-agentspayments api_benchmark x402
Benchmark Your API

Score Breakdown

Latency 4/10
Documentation 2/10
Auth Simplicity 2/10
Token Efficiency 1/10
Parseability 1/10
Consistency 0/10
Error Clarity 0/10
First-Try Success 0/10

Benchmark Analysis Log

Full LLM thinking from the 4-phase benchmark pipeline.

Analyze
```json
{
  "service_type": "rest_api",
  "base_url": "https://agent-commerce-os.chitacloud.dev",
  "auth_method": "none",
  "auth_config": {
    "header": null,
    "prefix": null
  },
  "endpoints": [
    {
      "path": "/v1/intent-marketplace",
      "method": "GET",
      "purpose": "Access the intent marketplace.",
      "params": {
        "category": {
          "type": "string",
          "required": false
        }
      },
      "response_format": "json",
      "is_primary": true
    }
  ],
  "pricing_model": {
    "type": "unknown",
    "details": {},
    "free_tier": {
      "requests": null,
      "period": null
    },
    "paid_tiers": []
  },
  "rate_limits": {
    "rpm": null,
    "tpm": null,
    "daily": null,
    "concurrent": null
  },
  "capabilities": [
    "intent marketplace",
    "task decomposition",
    "micropayment routing",
    "x402 payment rails",
    "HMAC attestation",
    "coalition Shapley payouts",
    "analytics",
    "MCP protocol"
  ],
  "agent_readiness": {
    "supports_x402": true,
    "supports_streaming": false,
    "has_sandbox": false,
    "sdks": [],
    "agent_auth_methods": []
  }
}
```
Plan
```json
{
  "tests": [
    {
      "name": "basic_connectivity_and_auth",
      "endpoint": "/v1/intent-marketplace",
      "method": "GET",
      "headers": {},
      "payload": {},
      "expected_status": 200,
      "expected_behavior": "Returns list of intents from the marketplace without authentication",
      "metrics": ["latency", "status_code"],
      "validation": {"field": "data", "type": "array", "min_length": 1}
    },
    {
      "name": "intent_marketplace_with_category",
      "endpoint": "/v1/intent-marketplace",
      "method": "GET",
      "headers": {},
      "payload": {"category": "finance"},
      "expected_status": 200,
      "expected_behavior": "Returns list of intents within the finance category",
      "metrics": ["latency", "accuracy", "status_code"],
      "validation": {"field": "data", "type": "array", "min_length": 1}
    },
    {
      "name": "error_handling_missing_category",
      "endpoint": "/v1/intent-marketplace",
      "method": "GET",
      "headers": {},
      "payload": {},
      "expected_status": 200,
      "expected_behavior": "Returns full list as category is optional",
      "metrics": ["status_code"],
      "validation": {"field": "data", "type": "array", "min_length": 1}
    },
    {
      "name": "error_handling_invalid_params",
      "endpoint": "/v1/intent-marketplace",
      "method": "GET",
      "headers": {},
      "payload": {"category": 1234},
      "expected_status": 400,
      "expected_behavior": "Returns error for invalid parameter type",
      "metrics": ["status_code"],
      "validation": {"field": "error", "type": "string", "min_length": 1}
    }
  ],
  "pricing_probes": [],
  "stress_profile": {
    "concurrent_requests": 5,
    "duration_seconds": 10,
    "ramp_up": true
  }
}
```
Execute

0/4 tests passed

TestEndpointStatusLatency
basic_connectivity_and_authGET /v1/intent-marketplace525171ms
intent_marketplace_with_categoryGET /v1/intent-marketplace525263ms
error_handling_missing_categoryGET /v1/intent-marketplace525235ms
error_handling_invalid_paramsGET /v1/intent-marketplace525234ms
Interpret
{"multi_model": true, "models_used": ["openai", "claude_cli"], "model_scores": {"GPT-4o": {"overall": 0, "dimensions": {"token_efficiency": 2.0, "first_try_success": 1.0, "response_parseability": 2.0, "error_clarity": 1.0, "doc_quality": 3.0, "auth_simplicity": 3.0, "latency": 7.0, "consistency": 1.0}}, "Claude CLI": {"overall": 0, "dimensions": {"token_efficiency": 0.0, "first_try_success": 0.0, "response_parseability": 0.0, "error_clarity": 0.0, "doc_quality": 0.0, "auth_simplicity": 0.0, "latency": 0.0, "consistency": 0.0}}}, "averaged": true}

Agent Readiness

x402 Payments
Supported
Streaming
No
Sandbox
None
Agent Auth
Unknown
SDKs
None listed
MCP Support
No

Want the full interactive view?

See operational metrics, LLM evaluations, agent readiness, and more.

Open in Dashboard