82
/100
prowl
Benchmarked Apr 06, 2026

Courier

Notification infrastructure API

messaging platform_profile
Benchmark Your API

Score Breakdown

Latency 10/10
Token Efficiency 9/10
Parseability 9/10
Consistency 8/10
Auth Simplicity 8/10
First-Try Success 8/10
Documentation 7/10
Error Clarity 7/10

Benchmark Analysis Log

Full LLM thinking from the 4-phase benchmark pipeline.

Analyze
```json
{
  "service_type": "api",
  "base_url": "https://courier.com",
  "auth_method": "api_key",
  "auth_config": {
    "header_name": "Authorization",
    "header_format": "Bearer {api_key}",
    "location": "header"
  },
  "endpoints": [
    "/send",
    "/messages",
    "/profiles",
    "/templates",
    "/events",
    "/automations",
    "/brands",
    "/audiences"
  ],
  "pricing_model": {
    "type": "freemium",
    "details": {
      "free_tier": "10,000 notifications/month",
      "paid_tiers": "usage-based pricing",
      "enterprise": "custom pricing available"
    }
  },
  "rate_limits": {
    "default": "1000 requests/minute",
    "burst": "higher limits for enterprise"
  },
  "capabilities": [
    "multi_channel_notifications",
    "email_delivery",
    "sms_messaging", 
    "push_notifications",
    "in_app_messaging",
    "webhook_notifications",
    "template_management",
    "dynamic_content",
    "audience_segmentation",
    "delivery_tracking",
    "analytics_reporting",
    "a_b_testing",
    "automation_workflows",
    "brand_customization",
    "provider_failover",
    "delivery_optimization",
    "real_time_events",
    "bulk_operations"
  ],
  "raw_analysis": "Courier is a comprehensive notification infrastructure API designed for developers and businesses who need reliable, multi-channel message delivery. The platform provides a unified API to send notifications across email, SMS, push notifications, in-app messages, and webhooks. Key strengths include its template management system with dynamic content support, robust delivery tracking and analytics, audience segmentation capabilities, and automation workflows. Courier stands out for its provider failover and delivery optimization features, ensuring high deliverability rates. The service offers both REST API and SDK support across multiple programming languages. It's particularly well-suited for SaaS applications, e-commerce platforms, and any application requiring transactional or marketing communications. The freemium model with 10,000 free notifications monthly makes it accessible for startups, while enterprise features like custom branding, advanced analytics, and dedicated support cater to larger organizations. The platform emphasizes developer experience with comprehensive documentation, testing tools, and integration guides."
}
```
Execute

2/3 tests passed

TestEndpointStatusLatency
website_uptimeGET /200259ms
robots_txtGET /robots.txt20097ms
llms_txtGET /llms.txt40469ms
Interpret
{"multi_model": true, "models_used": ["openai", "claude_cli"], "model_scores": {"GPT-4o": {"overall": 83, "dimensions": {"token_efficiency": 9.0, "first_try_success": 8.0, "response_parseability": 9.5, "error_clarity": 7.5, "doc_quality": 7.5, "auth_simplicity": 8.0, "latency": 10.0, "consistency": 8.5}}, "Claude CLI": {"overall": 82, "dimensions": {"token_efficiency": 8.5, "first_try_success": 7.5, "response_parseability": 9.0, "error_clarity": 7.0, "doc_quality": 7.0, "auth_simplicity": 8.0, "latency": 10.0, "consistency": 8.0}}}, "averaged": true}

Agent Readiness

x402 Payments
Not supported
Streaming
No
Sandbox
None
Agent Auth
Unknown
SDKs
None listed
MCP Support
No

Want the full interactive view?

See operational metrics, LLM evaluations, agent readiness, and more.

Open in Dashboard