Search Services

{
  "service_type": "platform",
  "base_url": "https://archive.org",
  "auth_method": "none",
  "auth_config": {},
  "endpoints": [
    {
      "path": "/search.php",
      "method": "GET",
      "description": "Performs full-text search across the Internet Archive's text collections. Accepts parameters like q, sin, and output='json'.",
      "params": ["q", "sin", "output"],
      "auth_required": false
    },
    {
      "path": "/advancedsearch.php",
      "method": "GET",
      "description": "Advanced search using complex queries and faceting. Supports output='json', 'jsonp', 'csv', 'html', and pagination via rows and start.",
      "params": ["q", "fl[]", "rows", "start", "output", "fq[]", "sort[]"],
      "auth_required": false
    },
    {
      "path": "/services/search/v1/scrape",
      "method": "POST",
      "description": "Scrape metadata from the Internet Archive's collections. Supports query, fields, count, and continuation tokens.",
      "params": ["q", "scrapeUrl", "fields", "count", "continuation_tokens"],
      "auth_required": true,
      "auth_note": "Requires API key or internal use; public rate limited."
    },
    {
      "path": "/services/search/v1/execute",
      "method": "POST",
      "description": "Execute a search query directly against the catalog index. Supports query, fields, sort, limit, offset.",
      "params": ["query", "fields", "sort", "limit", "offset"],
      "auth_required": true,
      "auth_note": "Publicly accessible but not documented for external use."
    }
  ],
  "pricing_model": {
    "type": "freemium",
    "details": {
      "free_tier": "Public access to /search.php and /advancedsearch.php with anonymous requests, subject to rate limits.",
      "premium_or_internal": "The /scrape and /execute endpoints are available but may require API keys or are intended for internal use by select partners.",
      "note": "No public pricing information; all services appear free for general users, but heavy usage may see throttling."
    }
  },
  "rate_limits": {
    "anonymous": "Typically limited to about 1-3 requests per second per IP, based on community reports.",
    "general": "Internet Archive requests are rate-limited; see https://archive.org/help/abuse.php for acceptable use.",
    "documented_limit": "Not formally documented; scrape API recommends polling with continuation tokens to avoid overload."
  },
  "capabilities": [
    "Full-text search of digitized books, magazines, and texts",
    "Metadata search across all Internet Archive items (advancedsearch)",
    "Scrape metadata programmatically with continuation tokens",
    "Faceted search (by collection, media type, subject, etc.)",
    "Sort by relevance, title, date, etc.",
    "Return results in JSON, JSONP, CSV, or HTML formats",
    "Supports complex queries with boolean operators and field-specific searches",
    "Accessibility to public domain and archived media items",
    "Integration with Internet Archive's vast digital library (millions of items)"
  ],
  "raw_analysis": "The Internet Archive's Search Services are not a single REST API but a set of HTTP endpoints and libraries for querying the digital library's metadata and full-text corpora. The primary endpoints are /search.php (for full-text search within texts), /advancedsearch.php (for metadata-driven queries with faceting), and the more recent /services/search/v1/scrape and /execute (for scalable bulk crawling). The platform is mature and widely used by researchers, developers, and archivists, offering free public access without API keys for basic searches. However, the automated scraping endpoints (scrape/execute) are often used for large-scale harvesting and might be restricted to protect the archive's infrastructure. The core value is its open access to a vast repository of digitized texts, audio, video, and web collections. It supports JSON output for easy programmatic consumption and is a foundational resource in digital libraries. Rate limits are informally enforced, and heavy usage should follow the Internet Archive's usage policies. The platform integrates with the broader Internet Archive services, such as the metadata API, but the search endpoints are distinct and self-contained."
}

2/3 tests passed

```json
{
  "overall": 78,
  "dimensions": {
    "token_efficiency": 8.5,
    "first_try_success": 8.0,
    "response_parseability": 9.0,
    "error_clarity": 7.0,
    "doc_quality": 8.0,
    "auth_simplicity": 9.0,
    "latency": 9.0,
    "consistency": 8.5
  },
  "pricing_normalized": {
    "model": "freemium",
    "free_public_api": true,
    "expects_paid_tier": false,
    "notes": "Primarily free public access with rate limiting; no clear paid tier visible."
  },
  "issues": [
    "No dedicated LLMs.txt endpoint found (404) — requires agent to parse general documentation pages",
    "Advanced search rate limits unclear — could cause unpredictable throttling for batch operations",
    "Scrape endpoint appears restricted/internal use; documentation availability unclear"
  ],
  "recommendations": [
    "Add an /llms.txt or structured API reference file for machine-readable documentation",
    "Publish explicit rate limit documentation for anonymous /advancedsearch.php usage",
    "Clearly document which endpoints are public vs. partner-only to avoid 403/401 surprises"
  ]
}
```