Crawl any website extracting pages, source URLs, and links (internal and external).
This automation shows the response code for each URL and consumes an automation credit per URL.
Can be used as a starting point for other automations including the SEO meta tag, email scraper, screenshot, image or file downloader, keyword finder or audit automations.