Skip to content
One platform. From customer conversation to completed work.Take a closer look
All connections
Developer · CONNECTION

Web Scraper + NodeHub

Run Web Scraper Cloud: manage sitemaps and schedules, start and watch scraping jobs, and download the scraped data.

Explore 22 workflow actions for Web Scraper, including account permissions and operation limits.

10 read actions12 write actions
WORKFLOW ACTIONS

What you can configure.

Choose an action in the workflow builder, connect an account, and map its inputs. These actions are available in the catalog; your account access and a successful test determine whether they work for your setup.

Add sitemap tag

Write

Tag a sitemap.

Permissions and limits

Account permissions

  • A Web Scraper Cloud API token

A repeated request may repeat the external action. Review the previous result before retrying a write.

Continue scraping job

Write

Continue a stopped or failed job, optionally with new intervals, proxy or rendering.

Permissions and limits

Account permissions

  • A Web Scraper Cloud API token

A repeated request may repeat the external action. Review the previous result before retrying a write.

Delete scraping job

Write

Delete a scraping job and its data.

Permissions and limits

Account permissions

  • A Web Scraper Cloud API token

A repeated request may repeat the external action. Review the previous result before retrying a write.

Delete sitemap

Write

Delete a sitemap.

Permissions and limits

Account permissions

  • A Web Scraper Cloud API token

A repeated request may repeat the external action. Review the previous result before retrying a write.

Disable scheduler

Write

Turn off a sitemap's schedule.

Permissions and limits

Account permissions

  • A Web Scraper Cloud API token

A repeated request may repeat the external action. Review the previous result before retrying a write.

Download scraped data

Read

Download a job's data as JSON Lines or CSV text.

Permissions and limits

Account permissions

  • A Web Scraper Cloud API token

Enable scheduler

Write

Schedule a sitemap's scraping with cron fields, timezone, intervals and proxy.

Permissions and limits

Account permissions

  • A Web Scraper Cloud API token

A repeated request may repeat the external action. Review the previous result before retrying a write.

Get account

Read

Read the account's email, name and remaining page credits.

Permissions and limits

Account permissions

  • A Web Scraper Cloud API token

Get data quality

Read

Check a job's record count, failed pages and empty fields against its quality rules.

Permissions and limits

Account permissions

  • A Web Scraper Cloud API token

Get scheduler

Read

Read a sitemap's schedule and whether it is on.

Permissions and limits

Account permissions

  • A Web Scraper Cloud API token

Get scraping job

Read

Read a scraping job's status and page counts.

Permissions and limits

Account permissions

  • A Web Scraper Cloud API token

Get sitemap

Read

Read a sitemap and its JSON.

Permissions and limits

Account permissions

  • A Web Scraper Cloud API token

Import sitemap

Write

Create a sitemap from its JSON (as exported from the Web Scraper extension).

Permissions and limits

Account permissions

  • A Web Scraper Cloud API token

A repeated request may repeat the external action. Review the previous result before retrying a write.

List problematic URLs

Read

List a job's empty, failed or no-value URLs, paged.

Permissions and limits

Account permissions

  • A Web Scraper Cloud API token

List scraping jobs

Read

List scraping jobs by sitemap, tag or status, paged.

Permissions and limits

Account permissions

  • A Web Scraper Cloud API token

List sitemap tags

Read

List a sitemap's tags.

Permissions and limits

Account permissions

  • A Web Scraper Cloud API token

List sitemaps

Read

List sitemaps, by tag, paged.

Permissions and limits

Account permissions

  • A Web Scraper Cloud API token

Remove sitemap tag

Write

Remove a tag from a sitemap.

Permissions and limits

Account permissions

  • A Web Scraper Cloud API token

A repeated request may repeat the external action. Review the previous result before retrying a write.

Rename sitemap

Write

Rename a sitemap.

Permissions and limits

Account permissions

  • A Web Scraper Cloud API token

A repeated request may repeat the external action. Review the previous result before retrying a write.

Start scraping job

Write

Start scraping a sitemap with intervals, proxy, JavaScript rendering, priority, start URLs and your own ID.

Permissions and limits

Account permissions

  • A Web Scraper Cloud API token

A repeated request may repeat the external action. Review the previous result before retrying a write.

Stop scraping job

Write

Stop a running job.

Permissions and limits

Account permissions

  • A Web Scraper Cloud API token

A repeated request may repeat the external action. Review the previous result before retrying a write.

Update sitemap

Write

Replace a sitemap's JSON.

Permissions and limits

Account permissions

  • A Web Scraper Cloud API token

A repeated request may repeat the external action. Review the previous result before retrying a write.

SETUP

Start with a controlled test.

01Connect the intended account

Use the account and permissions required for your process. Review the connection check before configuring a workflow action.

02Review inputs and access

Select a listed operation and map its required inputs. Use test records and add a human approval before writes that need review.

03Confirm the result

Inspect step outputs and confirm the result in Web Scraper. A saved workflow is not a completed provider action.

Follow the workflow quickstart
EXPLORE YOUR STACK

More in Developer.

1Shot APIAcrewityAlchemyAllscreenshots
Web Scraper integration | NodeHub