01
Reads the sitemaps
Kaiju reads the sitemaps the site publishes, if it has any.
Map
Map lists the page addresses of a site from its sitemaps and its links, and does not read the pages.
Free. No sign-up. No card.
/Sitemap/blog/Sitemap/blog/launch-weekLink/docs/Sitemap/docs/installLink/pricingSitemapHow it works
How Map finds the pages of a site.
01
Kaiju reads the sitemaps the site publishes, if it has any.
02
It also reads the links on the pages it opens, inside the scope you set.
03
Each address once, up to your limit. Map does not read the pages behind them.
What you get back
Each step lights the part of the example that answers it. Pick one, or let it play.
{ "operationId": "5e2d9b14…", "state": "completed", "highWater": 3, "items": [ { "id": "63eb5535…", "sequence": 1, "kind": "map", "url": "https://example.com/", "status": "ok", "bytes": 118, "bodyLink": "/v1/operations/5e2d9b14…/results/63eb5535…" }, { "id": "efbdb029…", "sequence": 2, "kind": "map", "url": "https://example.com/docs/", "status": "ok", "bytes": 126, "bodyLink": "/v1/operations/5e2d9b14…/results/efbdb029…" }, { "id": "e7a09620…", "sequence": 3, "kind": "map", "url": "https://example.com/pricing", "status": "ok", "bytes": 121, "bodyLink": "/v1/operations/5e2d9b14…/results/e7a09620…" } ], "complete": true}Build a request
Change an option and the request changes with it. Run it here, free, then keep going in the playground.
The example site is made up. Any public address works in the playground.
Every option has a default Change one and the request updates. Focus an option to read what it does.
POST /v1/map
{
"url": "https://northwind.example/"
}Free. No sign-up. Run it here, then keep going in the playground.
Which endpoint
Start from what you have. Each endpoint does one job.
You know the page you need.
POST /v1/scrape
{
"url": "https://northwind.example/blog/launch-week"
}You need the list of pages before you read them.
POST /v1/map
{
"url": "https://northwind.example",
"maxUrls": 100
}You need the text of many pages in one section.
POST /v1/crawl
{
"url": "https://northwind.example/docs/",
"maxPages": 5,
"maxDepth": 1
}You need named values, such as prices, not whole pages.
POST /v1/collect
// 503 capability_unavailable: not available yetCost and limits
Draft rates. We confirm them before release.
1 credit per 100 pages listed
The draft rate for each page Kaiju reads. We confirm it before release.
Limits set by the service
Read GET /v1/capabilities for the current limits. The time limit covers the whole job, not each page.
0 credits
Pages outside your scope: not fetched, so not charged. Pages past your limit: not read, not charged, and listed for you.
Work out a whole job in the pricing estimator.
Analytics preferences
Analytics helps Kaiju understand which pages and actions are useful. Marketing tracking can identify business visitors for follow-up. Essential storage remains available either way.
Read the Cookie Policy and Privacy notice.