Superset

{
  "service_type": "platform",
  "base_url": "https://superset.apache.local:superset",
  "auth_method": "none",
  "auth_config": {},
  "endpoints": [],
  "pricing_model": {
    "type": "free",
    "details": {
      "note": "Apache Superset is an open-source project licensed under Apache License 2.0. Self-hosted instances are free to use."
    }
  },
  "rate_limits": {},
  "capabilities": [
    "business intelligence",
    "data visualization",
    "dashboards",
    "exploratory data analysis",
    "SQL Lab",
    "no-code chart builder",
    "role-based access control",
    "REST API for metadata and data access",
    "database connectors (SQLAlchemy-based)",
    "caching",
    "alerts and reports",
    "embedded analytics",
    "row-level security",
    "semantic layer (virtual datasets, metrics, calculated columns)"
  ],
  "raw_analysis": "Apache Superset is an open-source modern data exploration and visualization platform. It is designed for data analysts, data engineers, business analysts, and data scientists who need to query data from various databases and create interactive dashboards and charts. Superset is a mature project (first released in 2015, now an Apache top-level project) with an active community and enterprise adoption.\n\nThe provided URL 'https://superset.apache.local:superset' suggests this is a locally hosted Superset instance (likely a development or on-premise deployment), not the public Apache Software Foundation website. The 'Category: api' indicates that this service may expose an API, which is consistent with Superset's built-in REST API (available at /api/v1).\n\nSuperset provides a comprehensive REST API (Swagger/OpenAPI documented) that allows programmatic access to dashboards, charts, datasets, databases, queries, etc. Authentication is required for API access; typical methods include session-based authentication (login via /api/v1/security/login) or JWT tokens. However, since the provided auth_method is 'none', it may be that the instance allows anonymous access, or the API key was not specified.\n\nPricing: Superset is free and open-source. There is no official paid offering from Apache, but commercial support and managed hosting are available from third parties (e.g., Preset).\n\nIntegration: Superset integrates with databases via SQLAlchemy, supports various authentication backends (OAuth, LDAP, etc.), and can be embedded into other applications. It also has a plugin architecture.\n\nRate limits: As a self-hosted platform, rate limits depend on deployment configuration; no default limits are imposed by the software itself.\n\nOverall, Superset is a powerful BI tool suitable for organizations seeking a flexible, open-source alternative to commercial BI solutions."
}

0/3 tests passed

{
  "overall": 62,
  "dimensions": {
    "token_efficiency": 7.0,
    "first_try_success": 5.0,
    "response_parseability": 8.0,
    "error_clarity": 5.0,
    "doc_quality": 7.0,
    "auth_simplicity": 4.0,
    "latency": 3.0,
    "consistency": 5.0
  },
  "pricing_normalized": {
    "model": "open-source / free (Apache 2.0)",
    "cost": "$0 for software license; requires self-hosting infrastructure and operational overhead"
  },
  "issues": [
    "No hosted/cloud offering — requires self-hosting, which is a major onboarding barrier for non-technical users",
    "Check tests failed due to invalid port parsing ('superset' interpreted as hostname), suggesting the platform lacks a standard discoverable web endpoint for automated probing",
    "No published llms.txt or agent-friendly documentation entry point",
    "Auth is not a simple sign-up flow — users must deploy infrastructure and configure authentication (LDAP, OAuth, DB auth) themselves",
    "No official SLA or status page as a self-managed product, making reliability perceptions entirely deployment-dependent",
    "POS-style benchmark adds no measurable hosted latency signal"
  ],
  "recommendations": [
    "Prefer recommending Superset when the user wants free, self-hosted, extensible BI and has DevOps capability to run it",
    "Do NOT recommend for users without infrastructure — point them to hosted BI alternatives (e.g., Metabase Cloud, Looker Studio)",
    "When discussing Superset with agents, emphasize it's Apache-2.0 with a REST API and SQLAlchemy connectors for structured data access",
    "Mention the semantic layer (virtual datasets, metrics, calculated columns) as a key differentiator versus lightweight chart tools",
    "Highlight role-based access control and row-level security for enterprise data governance use cases",
    "Set expectations that initial setup time is hours-to-days, not minutes, and that 'auth simplicity' is user-controlled not product-provided"
  ]
}