joshu

List every URL of a site without crawling it

From Crawl4AI, through Joshu Data Bodega.

Part of Open web & SEO data map.

Price
$0.000165 per call$0.17 per 1,000 calls

No calls measured in the last 30 days.

Prices include the router's 10% markup and are paid from the usage wallet. Checked on November 11, 2026.

Inputs

  • modestring: fast, full, optional

    full adds the Wayback Machine, up to 20 s more

  • domainstring, required

    the site's host; a leading https:// is dropped, www and the bare host are one site

  • includestring, optional

    keep only matching URLs: a path prefix (/docs) or a glob with * over the path

  • max_urlsinteger, optional

  • include_subdomainsboolean, optional

Call it

Router call with a router API key
curl https://hello.joshu.me/api/router/call \
  -H "Authorization: Bearer $JOSHU_ROUTER_KEY" \
  -H "Content-Type: application/json" \
  -d '{
    "endpoint": "crawl4ai.web.map",
    "params": {
      "domain": "docs.crawl4ai.com",
      "max_urls": 5
    }
  }'