80
/100
prowl
Benchmarked Aug 12, 2026

arXiv

Curated research-sharing platform: physics, mathematics, quantitative finance, and economics

search platform_profile
Benchmark Your API

Score Breakdown

Parseability 10/10
Latency 9/10
Auth Simplicity 9/10
Consistency 8/10
Token Efficiency 8/10
First-Try Success 8/10
Documentation 7/10
Error Clarity 6/10

Benchmark Analysis Log

Full LLM thinking from the 4-phase benchmark pipeline.

Analyze
{
  "service_type": "platform",
  "base_url": "https://arxiv.org",
  "auth_method": "none",
  "auth_config": {},
  "endpoints": [
    {
      "path": "/api/query",
      "method": "GET",
      "description": "Search and retrieve metadata for arXiv papers using the arXiv API. Supports atom feed, query parameters (search_query, id_list, start, max_results, sortBy, sortOrder).",
      "auth": "none"
    },
    {
      "path": "/abs/{arxiv_id}",
      "method": "GET",
      "description": "Access the abstract page for a specific paper by arXiv ID (e.g., /abs/2101.12345).",
      "auth": "none"
    },
    {
      "path": "/pdf/{arxiv_id}",
      "method": "GET",
      "description": "Directly download the PDF for a paper by arXiv ID.",
      "auth": "none"
    },
    {
      "path": "/format/{arxiv_id}",
      "method": "GET",
      "description": "Access alternate formats (source, postscript, etc.) for a paper.",
      "auth": "none"
    },
    {
      "path": "/list/{archive}/{year}/{month}",
      "method": "GET",
      "description": "Browse listings of recent papers by archive and month (e.g., /list/physics/2021/03).",
      "auth": "none"
    }
  ],
  "pricing_model": {
    "type": "free",
    "details": {
      "access": "Fully open access for readers, authors, and API users. No subscription required.",
      "funding": "Supported by Cornell University and partner institutions, as well as donations."
    }
  },
  "rate_limits": {
    "general": "arXiv API is designed for light traffic. Bulk downloads discouraged. No explicit numeric rate limit documented, but the user manual recommends limiting requests to avoid impacting the service.",
    "query_api": "No hard limit specified, but users should be considerate and use caching.",
    "pdf_download": "Automated bulk downloads may be blocked; use the API for metadata and approach with moderation."
  },
  "capabilities": [
    "Search and retrieve metadata for arXiv papers",
    "Filter by subject categories (physics, math, quant finance, economics, etc.)",
    "Access abstracts and paper details",
    "Download PDFs",
    "Browse by archive and date",
    "Support for Atom and API XML responses",
    "Sort results by relevance, last updated date, submitted date",
    "Support for exporting metadata in various formats (via API responses)",
    "Integrated with many academic tools and reference managers (e.g., Zotero, Mendeley) through public web access"
  ],
  "raw_analysis": "arXiv is a highly mature and widely used platform, initiated in 1991, providing open access to over 2 million e-prints in physics, mathematics, computer science (though CS is not in the description, it is part of the platform), quantitative biology, quantitative finance, and economics. The platform is curated through a moderation process to ensure relevance and compliance. It is primarily used by researchers, academics, and students for preprint sharing and discovery. The API is publicly documented and requires no authentication; it supports querying metadata with various parameters, facilitating integration into third-party tools. The platform's openness has led to numerous integrations with academic search engines, reference managers, and machine learning pipelines. The ecosystem is robust, but the API is intentionally simple and may not provide full-text search directly (full-text is in PDFs, not in metadata API). Rate limits are not strictly documented, emphasizing fair use. Pricing is entirely free, funded by institutions. Overall, it's an essential resource for scientific research, with a stable and reliable API."
}
Execute

2/3 tests passed

TestEndpointStatusLatency
website_uptimeGET /20064ms
robots_txtGET /robots.txt20026ms
llms_txtGET /llms.txt404342ms
Interpret
```json
{
  "overall": 68,
  "dimensions": {
    "token_efficiency": 8.5,
    "first_try_success": 8.0,
    "response_parseability": 9.5,
    "error_clarity": 6.0,
    "doc_quality": 7.0,
    "auth_simplicity": 9.0,
    "latency": 9.0,
    "consistency": 8.0
  },
  "pricing_normalized": {
    "type": "free",
    "note": "Completely open access, no authentication required"
  },
  "issues": [
    "No llms.txt file present (404), making it less discoverable for AI agents",
    "robots.txt specifies Crawl-delay: 15 seconds, which is extremely restrictive for automated agents",
    "No formal API docs clearly linked from the homepage (though API endpoints exist via /api)",
    "Robots.txt explicitly discourages 'indiscriminate automated downloads'"
  ],
  "recommendations": [
    "Create an llms.txt file to provide AI agents with clear, structured guidance",
    "Consider providing a dedicated API endpoint for AI agents with higher rate allowances",
    "Document the API response formats more prominently (Atom and XML)",
    "Add clear API usage guidelines and best practices for automated access",
    "Consider adding JSON API support for easier parsing (currently XML/Atom only)"
  ]
}
```

Agent Readiness

x402 Payments
Not supported
Streaming
No
Sandbox
None
Agent Auth
Unknown
SDKs
None listed
MCP Support
No

Embed your Prowl badge

Show your live agent-readiness score on your own site. Free, no auth — it updates as your score changes.

Prowl agent-readiness badge
<a href="https://prowl.world/service/arxiv">
  <img src="https://prowl.world/badge/arxiv.svg" height="56" alt="Agent-readiness on Prowl">
</a>

Options: ?style=light|dark · ?size=sm|md · ?variant=certified (claimed + DNS-verified only) · badge generator with preview

Want the full interactive view?

See operational metrics, LLM evaluations, agent readiness, and more.

Open in Dashboard