Skip to content
One platform. From customer conversation to completed work.Take a closer look
All connections
Data & Docs ยท CONNECTION

lobstr.io + NodeHub

Run lobstr.io cloud scrapers: crawlers, squids and chains, tasks, runs and results.

Explore 33 workflow actions for lobstr.io, including account permissions and operation limits.

20 read actions13 write actions
WORKFLOW ACTIONS

What you can configure.

Choose an action in the workflow builder, connect an account, and map its inputs. These actions are available in the catalog; your account access and a successful test determine whether they work for your setup.

Abort run

Write

Stop an active run.

Permissions and limits

Account permissions

  • A lobstr.io API key (dashboard, API)

A repeated request may repeat the external action. Review the previous result before retrying a write.

Add tasks

Write

Add tasks (URLs or crawler parameters) to a squid; duplicates are skipped and counted.

Permissions and limits

Account permissions

  • A lobstr.io API key (dashboard, API)

A repeated request may repeat the external action. Review the previous result before retrying a write.

Chain squid

Write

Feed a squid's results into another crawler through a field map; the target squid is created for you.

Permissions and limits

Account permissions

  • A lobstr.io API key (dashboard, API)

A repeated request may repeat the external action. Review the previous result before retrying a write.

Create squid

Write

Create a squid (a container of tasks, settings and runs) for a crawler.

Permissions and limits

Account permissions

  • A lobstr.io API key (dashboard, API)

A repeated request may repeat the external action. Review the previous result before retrying a write.

Delete squid

Write

Delete a squid and all its data.

Permissions and limits

Account permissions

  • A lobstr.io API key (dashboard, API)

A repeated request may repeat the external action. Review the previous result before retrying a write.

Delete squid chain

Write

Remove a squid's chain.

Permissions and limits

Account permissions

  • A lobstr.io API key (dashboard, API)

A repeated request may repeat the external action. Review the previous result before retrying a write.

Delete task

Write

Delete a task from its squid.

Permissions and limits

Account permissions

  • A lobstr.io API key (dashboard, API)

A repeated request may repeat the external action. Review the previous result before retrying a write.

Empty squid

Write

Remove a squid's URL tasks or parameter tasks and their results, keeping its settings.

Permissions and limits

Account permissions

  • A lobstr.io API key (dashboard, API)

A repeated request may repeat the external action. Review the previous result before retrying a write.

Get account

Read

One connected platform account.

Permissions and limits

Account permissions

  • A lobstr.io API key (dashboard, API)

Get balance

Read

Credits left on the account.

Permissions and limits

Account permissions

  • A lobstr.io API key (dashboard, API)

Get crawler

Read

One crawler's details.

Permissions and limits

Account permissions

  • A lobstr.io API key (dashboard, API)

Get crawler attributes

Read

The result fields a crawler returns.

Permissions and limits

Account permissions

  • A lobstr.io API key (dashboard, API)

Get crawler parameters

Read

The task inputs and squid settings a crawler takes, with types, defaults and optional functions.

Permissions and limits

Account permissions

  • A lobstr.io API key (dashboard, API)

Get results

Read

Scraped rows for a squid (all runs) or one run, optionally one task, a page at a time.

Permissions and limits

Account permissions

  • A lobstr.io API key (dashboard, API)

Get run

Read

One run's details.

Permissions and limits

Account permissions

  • A lobstr.io API key (dashboard, API)

Get run credits

Read

A completed run's credits by function.

Permissions and limits

Account permissions

  • A lobstr.io API key (dashboard, API)

Get run stats

Read

A run's progress: tasks done and left, results and ETA.

Permissions and limits

Account permissions

  • A lobstr.io API key (dashboard, API)

Get squid

Read

A squid's settings, crawler, accounts and parameters.

Permissions and limits

Account permissions

  • A lobstr.io API key (dashboard, API)

Get squid chain

Read

A squid's chain settings (empty when there is none).

Permissions and limits

Account permissions

  • A lobstr.io API key (dashboard, API)

Get task

Read

One task with its parameters and status.

Permissions and limits

Account permissions

  • A lobstr.io API key (dashboard, API)

Get user profile

Read

The account's profile, status and subscription.

Permissions and limits

Account permissions

  • A lobstr.io API key (dashboard, API)

List account types

Read

Platforms that accounts can be connected for, with their requirements.

Permissions and limits

Account permissions

  • A lobstr.io API key (dashboard, API)

List accounts

Read

Connected platform accounts (for crawlers that need a login).

Permissions and limits

Account permissions

  • A lobstr.io API key (dashboard, API)

List crawlers

Read

The ready-made crawlers with their credits per row, concurrency and availability.

Permissions and limits

Account permissions

  • A lobstr.io API key (dashboard, API)

List run tasks

Read

The tasks a run executed, with their status and results.

Permissions and limits

Account permissions

  • A lobstr.io API key (dashboard, API)

List runs

Read

A squid's runs with their status, results, duration and credits.

Permissions and limits

Account permissions

  • A lobstr.io API key (dashboard, API)

List squids

Read

Your squids, filtered by name, a page at a time.

Permissions and limits

Account permissions

  • A lobstr.io API key (dashboard, API)

List tasks

Read

A squid's tasks, all or only URL or parameter tasks.

Permissions and limits

Account permissions

  • A lobstr.io API key (dashboard, API)

Resurrect run

Write

Reopen an aborted run and resume where it stopped.

Permissions and limits

Account permissions

  • A lobstr.io API key (dashboard, API)

A repeated request may repeat the external action. Review the previous result before retrying a write.

Retry run task

Write

Retry one failed or skipped task of a completed run.

Permissions and limits

Account permissions

  • A lobstr.io API key (dashboard, API)

A repeated request may repeat the external action. Review the previous result before retrying a write.

Start run

Write

Start running a squid's tasks; this spends credits.

Permissions and limits

Account permissions

  • A lobstr.io API key (dashboard, API)

A repeated request may repeat the external action. Review the previous result before retrying a write.

Update squid

Write

Change a squid's name, activity, concurrency, schedule, notifications, export options or crawler parameters.

Permissions and limits

Account permissions

  • A lobstr.io API key (dashboard, API)

A repeated request may repeat the external action. Review the previous result before retrying a write.

Update squid chain

Write

Change a chain's autostart, target squid name or concurrency.

Permissions and limits

Account permissions

  • A lobstr.io API key (dashboard, API)

A repeated request may repeat the external action. Review the previous result before retrying a write.

SETUP

Start with a controlled test.

01Connect the intended account

Use the account and permissions required for your process. Review the connection check before configuring a workflow action.

02Review inputs and access

Select a listed operation and map its required inputs. Use test records and add a human approval before writes that need review.

03Confirm the result

Inspect step outputs and confirm the result in lobstr.io. A saved workflow is not a completed provider action.

Follow the workflow quickstart
EXPLORE YOUR STACK

More in Data & Docs.

AgentBrainsAgifyAinoflow ConvertAirparser
lobstr.io integration | NodeHub