Finage — Prowl Score: 18/100

Score Breakdown

Auth Simplicity 10/10

Latency 4/10

Error Clarity 2/10

Token Efficiency 2/10

Documentation 1/10

Parseability 1/10

Consistency 0/10

First-Try Success 0/10

Benchmark Analysis Log

Full LLM thinking from the 4-phase benchmark pipeline.

Analyze

```json
{
  "service_type": "crypto_app",
  "base_url": "https://api.finage.co.uk",
  "auth_method": "api_key_header",
  "auth_config": {},
  "endpoints": [
    {"path": "/v1/markets", "method": "GET", "purpose": "list trading pairs"},
    {"path": "/v1/ticker", "method": "GET", "purpose": "price data"}
  ],
  "pricing_model": {"type": "tiered", "details": {}},
  "rate_limits": {"rpm": 120},
  "capabilities": ["spot_trading", "portfolio", "price_data"],
  "crypto_specifics": {
    "supported_chains": ["ethereum", "bitcoin", "solana"],
    "token_count": 500,
    "has_websocket": true,
    "has_orderbook": false,
    "fee_structure": "maker/taker",
    "security_features": ["2fa", "withdrawal_whitelist"]
  }
}
```

Plan

```json
{
  "tests": [
    {
      "name": "connectivity_and_auth_verification",
      "endpoint": "/v1/markets",
      "method": "GET",
      "headers": {
        "Authorization": "Bearer YOUR_API_KEY"
      },
      "payload": {},
      "expected_status": 200,
      "expected_behavior": "Returns list of trading pairs",
      "metrics": ["latency", "status_code"],
      "validation": {"field": "data.pairs", "type": "array", "min_length": 1}
    },
    {
      "name": "fetch_ticker_data",
      "endpoint": "/v1/ticker?symbol=BTCUSD",
      "method": "GET",
      "headers": {
        "Authorization": "Bearer YOUR_API_KEY"
      },
      "payload": {},
      "expected_status": 200,
      "expected_behavior": "Returns price data for BTC/USD",
      "metrics": ["latency", "status_code"],
      "validation": {"field": "data.price", "type": "number"}
    },
    {
      "name": "fetch_unsupported_trading_pair",
      "endpoint": "/v1/ticker?symbol=INVALID_PAIR",
      "method": "GET",
      "headers": {
        "Authorization": "Bearer YOUR_API_KEY"
      },
      "payload": {},
      "expected_status": 404,
      "expected_behavior": "Returns error for unsupported trading pair",
      "metrics": ["status_code"],
      "validation": {"field": "error", "type": "string"}
    },
    {
      "name": "verify_security_headers",
      "endpoint": "/v1/markets",
      "method": "GET",
      "headers": {
        "Authorization": "Bearer YOUR_API_KEY"
      },
      "payload": {},
      "expected_status": 200,
      "expected_behavior": "Returns list of trading pairs",
      "metrics": ["security_headers"],
      "validation": {"field": "headers.Strict-Transport-Security", "type": "string", "min_length": 1}
    }
  ],
  "pricing_probes": [],
  "stress_profile": {
    "concurrent_requests": 5,
    "duration_seconds": 10,
    "ramp_up": true
  }
}
```

Execute

0/4 tests passed

Test	Endpoint	Status	Latency
connectivity_and_auth_verification	GET /v1/markets	404	429ms
fetch_ticker_data	GET /v1/ticker?symbol=BTCUSD	404	117ms
fetch_unsupported_trading_pair	GET /v1/ticker?symbol=INVALID_PAIR	404	115ms
verify_security_headers	GET /v1/markets	404	111ms

Interpret

```json
{
  "overall": 15,
  "dimensions": {
    "token_efficiency": 2.0,
    "first_try_success": 0.0,
    "response_parseability": 1.0,
    "error_clarity": 2.0,
    "doc_quality": 1.0,
    "auth_simplicity": 10.0,
    "latency": 4.0,
    "consistency": 0.0
  },
  "pricing_normalized": {
    "maker_fee_bps": null,
    "taker_fee_bps": null,
    "withdrawal_fee_usd": null,
    "free_tier_requests": null
  },
  "issues": ["missing endpoints", "no security headers", "endpoint returns 404", "stale or non-functional pricing data"],
  "recommendations": [
    "Implement correct endpoints for market and ticker data",
    "Add comprehensive security headers",
    "Improve documentation for correct endpoint URLs",
    "Ensure error messages provide more clarity on the issue",
    "Ensure consistent and correct response format in JSON"
  ]
}
```

Agent Readiness

x402 Payments

Not supported

Streaming

No

Sandbox

None

Agent Auth

Unknown

SDKs

None listed

MCP Support

No

Want the full interactive view?

See operational metrics, LLM evaluations, agent readiness, and more.

Open in Dashboard