Full LLM thinking from the 4-phase benchmark pipeline.
```json
{
"service_type": "crypto_app",
"base_url": "https://coinmarketcap.com/api",
"auth_method": "api_key_header",
"auth_config": {},
"endpoints": [
{"path": "/v1/cryptocurrency/listings/latest", "method": "GET", "purpose": "list cryptocurrencies with data"},
{"path": "/v1/cryptocurrency/quotes/latest", "method": "GET", "purpose": "current price data"}
],
"pricing_model": {"type": "tiered", "details": {"tiers": [{"name": "Free", "limit": 10}, {"name": "Basic", "limit": 30}, {"name": "Pro", "limit": 60}]}},
"rate_limits": {"rpm": 60},
"capabilities": ["price_tracking", "market_data", "historical_data"],
"crypto_specifics": {
"supported_chains": ["ethereum", "bitcoin", "solana", "binance smart chain", "ripple"],
"token_count": 10000,
"has_websocket": false,
"has_orderbook": false,
"fee_structure": "none for data access",
"security_features": ["api_key_protection"]
}
}
``````json
{
"tests": [
{
"name": "verify_connectivity_and_auth",
"endpoint": "/v1/cryptocurrency/listings/latest",
"method": "GET",
"headers": {
"Authorization": "Bearer YOUR_API_KEY"
},
"payload": {},
"expected_status": 200,
"expected_behavior": "Returns list of cryptocurrencies",
"metrics": ["latency", "status_code"],
"validation": {
"field": "data",
"type": "array",
"min_length": 1
}
},
{
"name": "test_cryptocurrency_quotes",
"endpoint": "/v1/cryptocurrency/quotes/latest",
"method": "GET",
"headers": {
"Authorization": "Bearer YOUR_API_KEY"
},
"payload": {
"symbol": "BTC,ETH"
},
"expected_status": 200,
"expected_behavior": "Returns current price data for specified symbols",
"metrics": ["latency", "accuracy", "status_code"],
"validation": {
"field": "data.BTC",
"type": "object",
"min_length": 1
}
},
{
"name": "test_error_handling_missing_params",
"endpoint": "/v1/cryptocurrency/quotes/latest",
"method": "GET",
"headers": {
"Authorization": "Bearer YOUR_API_KEY"
},
"payload": {},
"expected_status": 400,
"expected_behavior": "Returns error for missing parameters",
"metrics": ["status_code"],
"validation": {
"field": "error",
"type": "string",
"min_length": 1
}
},
{
"name": "test_invalid_trading_pair",
"endpoint": "/v1/cryptocurrency/quotes/latest",
"method": "GET",
"headers": {
"Authorization": "Bearer YOUR_API_KEY"
},
"payload": {
"symbol": "INVALIDPAIR"
},
"expected_status": 400,
"expected_behavior": "Returns error for invalid trading pair",
"metrics": ["status_code"],
"validation": {
"field": "error",
"type": "string",
"min_length": 1
}
}
],
"pricing_probes": [],
"stress_profile": {
"concurrent_requests": 5,
"duration_seconds": 10,
"ramp_up": true
}
}
```0/4 tests passed
| Test | Endpoint | Status | Latency |
|---|---|---|---|
| verify_connectivity_and_auth | GET /v1/cryptocurrency/listings/latest | 301 | 72ms |
| test_cryptocurrency_quotes | GET /v1/cryptocurrency/quotes/latest | 301 | 43ms |
| test_error_handling_missing_params | GET /v1/cryptocurrency/quotes/latest | 301 | 28ms |
| test_invalid_trading_pair | GET /v1/cryptocurrency/quotes/latest | 301 | 16ms |
```json
{
"overall": 20,
"dimensions": {
"token_efficiency": 5.0,
"first_try_success": 0.0,
"response_parseability": 0.0,
"error_clarity": 3.0,
"doc_quality": 4.0,
"auth_simplicity": 10.0,
"latency": 8.0,
"consistency": 0.0
},
"pricing_normalized": {
"maker_fee_bps": null,
"taker_fee_bps": null,
"withdrawal_fee_usd": null,
"free_tier_requests": null
},
"issues": [
"All API calls return 301 redirects instead of JSON data",
"Expected JSON but received HTML indicating configuration issues",
"Endpoint paths or base_url may be incorrect or outdated"
],
"recommendations": [
"Verify and correct the endpoint paths or base URL for API requests",
"Ensure API server is correctly configured to handle requests as an API service",
"Improve error messaging to reflect specific misconfigurations or required corrections"
]
}
```Show your live agent-readiness score on your own site. Free, no auth — it updates as your score changes.
<a href="https://prowl.world/service/coinmarketcap">
<img src="https://prowl.world/badge/coinmarketcap.svg" height="56" alt="Agent-readiness on Prowl">
</a>
See operational metrics, LLM evaluations, agent readiness, and more.
Open in Dashboard