Full LLM thinking from the 4-phase benchmark pipeline.
```json
{
"service_type": "crypto_app",
"base_url": "https://api.coinremitter.com",
"auth_method": "api_key_header",
"auth_config": {},
"endpoints": [
{"path": "/v1/prices", "method": "GET", "purpose": "get cryptocurrency prices"},
{"path": "/v1/payment", "method": "POST", "purpose": "initiate a payment transaction"}
],
"pricing_model": {"type": "tiered", "details": {}},
"rate_limits": {"rpm": 60},
"capabilities": ["payments", "price_tracking"],
"crypto_specifics": {
"supported_chains": ["bitcoin", "ethereum", "litecoin"],
"token_count": 50,
"has_websocket": false,
"has_orderbook": false,
"fee_structure": "per_transaction_fee",
"security_features": ["2fa", "secure_api_key"]
}
}
``````json
{
"tests": [
{
"name": "connectivity_and_auth",
"endpoint": "/v1/prices",
"method": "GET",
"headers": {
"Authorization": "Bearer YOUR_API_KEY"
},
"payload": {},
"expected_status": 200,
"expected_behavior": "Returns list of cryptocurrency prices",
"metrics": ["latency", "status_code"],
"validation": {"field": "data", "type": "array", "min_length": 1}
},
{
"name": "initiate_payment",
"endpoint": "/v1/payment",
"method": "POST",
"headers": {
"Authorization": "Bearer YOUR_API_KEY"
},
"payload": {
"amount": "0.01",
"currency": "BTC",
"recipient": "recipient_address"
},
"expected_status": 201,
"expected_behavior": "Initiates a payment transaction",
"metrics": ["latency", "status_code"],
"validation": {"field": "transaction_id", "type": "string"}
},
{
"name": "error_handling_invalid_currency",
"endpoint": "/v1/prices",
"method": "GET",
"headers": {
"Authorization": "Bearer YOUR_API_KEY"
},
"payload": {},
"expected_status": 400,
"expected_behavior": "Error returned for invalid currency",
"metrics": ["status_code"],
"validation": {"field": "error", "type": "string"}
},
{
"name": "error_handling_missing_params",
"endpoint": "/v1/payment",
"method": "POST",
"headers": {
"Authorization": "Bearer YOUR_API_KEY"
},
"payload": {},
"expected_status": 400,
"expected_behavior": "Error returned for missing parameters",
"metrics": ["status_code"],
"validation": {"field": "error", "type": "string"}
},
{
"name": "rate_limit_header_check",
"endpoint": "/v1/prices",
"method": "GET",
"headers": {
"Authorization": "Bearer YOUR_API_KEY"
},
"payload": {},
"expected_status": 200,
"expected_behavior": "Check if rate limit headers are present",
"metrics": ["status_code", "latency"],
"validation": {"field": "X-RateLimit-Remaining", "type": "integer", "min_value": 1}
}
],
"pricing_probes": [
{
"name": "verify_pricing_tiers",
"description": "Check if pricing tiers are reflected correctly in the response",
"endpoint": "/v1/prices",
"method": "GET",
"payload": {},
"check": "response contains correct price structure for current tier"
}
],
"stress_profile": {
"concurrent_requests": 5,
"duration_seconds": 10,
"ramp_up": true
}
}
```3/5 tests passed
| Test | Endpoint | Status | Latency |
|---|---|---|---|
| connectivity_and_auth | GET /v1/prices | 200 | 127ms |
| initiate_payment | POST /v1/payment | 404 | 50ms |
| error_handling_invalid_currency | GET /v1/prices | 200 | 61ms |
| error_handling_missing_params | POST /v1/payment | 404 | 33ms |
| rate_limit_header_check | GET /v1/prices | 200 | 54ms |
```json
{
"overall": 28,
"dimensions": {
"token_efficiency": 2.0,
"first_try_success": 0.0,
"response_parseability": 1.0,
"error_clarity": 4.0,
"doc_quality": 3.0,
"auth_simplicity": 10.0,
"latency": 7.0,
"consistency": 1.0
},
"pricing_normalized": {
"maker_fee_bps": null,
"taker_fee_bps": null,
"withdrawal_fee_usd": null,
"free_tier_requests": null
},
"issues": [
"CONTENT_TYPE_MISMATCH",
"route_not_exists",
"GOT_HTML_NOT_JSON"
],
"recommendations": [
"Ensure endpoints return JSON responses.",
"Fix invalid routes in the API.",
"Improve error messages to include guidance on potential fixes.",
"Enhance documentation to clarify endpoint usage and error codes."
]
}
```Show your live agent-readiness score on your own site. Free, no auth — it updates as your score changes.
<a href="https://prowl.world/service/coinremitter">
<img src="https://prowl.world/badge/coinremitter.svg" height="56" alt="Agent-readiness on Prowl">
</a>
See operational metrics, LLM evaluations, agent readiness, and more.
Open in Dashboard