← Tools Reference

ScrapingBee

ScrapingBee integration (Developer Tools, Data). Imported from open-connector.

API key3 toolshttps://app.scrapingbee.com/api/v1
GET
scrapingbee_fetch_html
Fetch HTML content from one public URL with optional rendering and proxy controls.

/

12 parameters
ParamTypeRequiredDescription
urlstringrequiredThe public URL to fetch with ScrapingBee.
renderJsbooleanoptionalWhether ScrapingBee should render JavaScript before returning the page.
waitMsintegeroptionalHow many milliseconds ScrapingBee should wait before returning the page.
waitForstringoptionalThe CSS selector ScrapingBee should wait for before returning the page.
devicestringoptionalThe device preset used for the request.
blockAdsbooleanoptionalWhether ScrapingBee should block ads on the page.
blockResourcesbooleanoptionalWhether ScrapingBee should block images and CSS resources.
countryCodestringoptionalThe two-letter country code used for request geolocation.
premiumProxybooleanoptionalWhether ScrapingBee should use premium proxy routing.
stealthProxybooleanoptionalWhether ScrapingBee should use stealth proxy routing.
transparentStatusCodebooleanoptionalWhether ScrapingBee should return the target page status code transparently.
retryintegeroptionalHow many times ScrapingBee should retry the request on failure.
GET
scrapingbee_extract_data
Extract structured JSON data from one public URL with ScrapingBee extract_rules.

/

13 parameters
ParamTypeRequiredDescription
urlstringrequiredThe public URL to extract data from with ScrapingBee.
extractRulesobjectrequiredThe extraction rules object serialized into the extract_rules query parameter.
renderJsbooleanoptionalWhether ScrapingBee should render JavaScript before returning the page.
waitMsintegeroptionalHow many milliseconds ScrapingBee should wait before returning the page.
waitForstringoptionalThe CSS selector ScrapingBee should wait for before returning the page.
devicestringoptionalThe device preset used for the request.
blockAdsbooleanoptionalWhether ScrapingBee should block ads on the page.
blockResourcesbooleanoptionalWhether ScrapingBee should block images and CSS resources.
countryCodestringoptionalThe two-letter country code used for request geolocation.
premiumProxybooleanoptionalWhether ScrapingBee should use premium proxy routing.
stealthProxybooleanoptionalWhether ScrapingBee should use stealth proxy routing.
transparentStatusCodebooleanoptionalWhether ScrapingBee should return the target page status code transparently.
retryintegeroptionalHow many times ScrapingBee should retry the request on failure.
GET
scrapingbee_get_usage_stats
Retrieve the current ScrapingBee API usage and concurrency statistics.

/usage