Website Data Scraper / saved task 17

Website Data routes requested URLs source

Collect the records behind a list of web pages. This task ties source routes, requested URLs, final URL, and source headers for research handoffs. Use source URLs; the source view keeps the routes requested urls source result together.

Input

{
  "startUrls": [
    "https://www.iana.org/help/example-domains"
  ],
  "maxItems": 100,
  "maxSeconds": 120
}

Dataset view

provenance

route
requestedUrl
finalUrl
sourceHeaders

Run

POST /v2/acts/XPS2cILOF68CbPrj8/runs$1 per 1,000 jobs on the Free plan. Other Apify plans use the rates shown in the Pricing tab.API reference