Skip to content

Automate ScrapingBee

Watch product prices on retailer pages, pull specific values out of web pages, and keep an eye on your ScrapingBee credit balance. ScrapingBee fetches the page for you, with JavaScript rendering and premium proxies when a site needs them. Describe what you want to your AI assistant, check what it will do, and it keeps running.

Try asking

Create a ClickRuntime automation: every 6 hours, fetch these 3 product pages through ScrapingBee, read the price, and email me if any of them drops below $249.

Paste it into your assistant. It tells you what it will send or change before it runs live.

Build your own

Build any ScrapingBee automation you can describe

The ideas above are ready-made starting points, not a fixed list. Describe what ScrapingBee should do in your own words, with your conditions, other apps or an AI step, and your assistant writes it, tests it and runs it on ClickRuntime.
  • Your own rules

    Conditions, thresholds, filters and exceptions, written the way you'd explain them to a colleague.

  • Any number of apps

    One automation can read from one app and update several others. Over 248 apps are ready, and anything with an API works too.

  • AI where it helps

    Summaries, classification, extraction and drafts use ClickRuntime's built-in AI, with no extra key.

  • On a schedule or on each event

    Runs as often as every 5 minutes, or the moment an app sends an event, and keeps track of what it already handled.

For example, ask your assistant

Every 6 hours, use ScrapingBee to read the price on each product page in my list and alert me when any price drops below the target I set for it.

Every morning, scrape the stock status of my competitor's top products with ScrapingBee and post any that went out of stock to our Slack channel.

Every day, scrape new listings from the property sites I give you with ScrapingBee, have AI pick ones that match my criteria, add them to Google Sheets and email me the best five through Gmail.

Beyond chat

Have ScrapingBee work when you're not in the chat

Connecting ScrapingBee to ChatGPT or Claude lets you ask about it while you chat. ClickRuntime handles the part that should happen on its own: checks on a schedule and actions on each new event, set up from the same chat and running after you close it.

Setup

Connect ScrapingBee

ScrapingBee connects with the API key from your own ScrapingBee account. Every page fetched uses credits from your plan.

ScrapingBee

Data / Web scraping

  1. Sign in at app.scrapingbee.com.
  2. Open the API key page under your account settings (account/manage/api_key) and copy the key.
  3. In the ClickRuntime dashboard, open Connections & secrets and save the key as a ScrapingBee secret. It is sent as a Bearer token.

Good to know

ScrapingBee limits that affect automations

  • Each request uses credits, and JavaScript rendering and premium proxies use more per page, so only turn them on for sites that need them.
  • How many pages can be fetched at the same time depends on your ScrapingBee plan.
  • A plain price check on a handful of pages costs far less than one that renders JavaScript on every request.

FAQ

Questions about automating ScrapingBee

What does ClickRuntime fetch through ScrapingBee?
The pages your automation names. It can pull out specific values with extraction rules, such as a price or stock status, and it can read your account's credit usage.
How do I keep credit use down?
Check pages only as often as you need, and leave JavaScript rendering and premium proxies off unless a site doesn't load without them. The credit warning automation tells you before you run out.
Do I need AI for ScrapingBee automations?
Not for these. Price alerts and credit warnings compare numbers. If you later want a page summarised, that uses the AI that comes with every ClickRuntime plan, so you don't need your own AI key.
Does it alert me on every check?
No. It remembers the last value it saw and only emails you when the price crosses your threshold or changes.
Is this a ScrapingBee connector for ChatGPT or Claude?
Not for chatting with ScrapingBee data. A chat connector lets your assistant read and change ScrapingBee while you're in the conversation. ClickRuntime is for the work that should happen without you: you set up an automation from the chat once, and it keeps running on a schedule or on each ScrapingBee event.

Tell your assistant what ScrapingBee should do

Free plan. No credit card.