ScrapingBee integration (Developer Tools, Data). Imported from open-connector.
https://app.scrapingbee.com/api/v1/
| Param | Type | Required | Description |
|---|---|---|---|
| url | string | required | The public URL to fetch with ScrapingBee. |
| renderJs | boolean | optional | Whether ScrapingBee should render JavaScript before returning the page. |
| waitMs | integer | optional | How many milliseconds ScrapingBee should wait before returning the page. |
| waitFor | string | optional | The CSS selector ScrapingBee should wait for before returning the page. |
| device | string | optional | The device preset used for the request. |
| blockAds | boolean | optional | Whether ScrapingBee should block ads on the page. |
| blockResources | boolean | optional | Whether ScrapingBee should block images and CSS resources. |
| countryCode | string | optional | The two-letter country code used for request geolocation. |
| premiumProxy | boolean | optional | Whether ScrapingBee should use premium proxy routing. |
| stealthProxy | boolean | optional | Whether ScrapingBee should use stealth proxy routing. |
| transparentStatusCode | boolean | optional | Whether ScrapingBee should return the target page status code transparently. |
| retry | integer | optional | How many times ScrapingBee should retry the request on failure. |
/
| Param | Type | Required | Description |
|---|---|---|---|
| url | string | required | The public URL to extract data from with ScrapingBee. |
| extractRules | object | required | The extraction rules object serialized into the extract_rules query parameter. |
| renderJs | boolean | optional | Whether ScrapingBee should render JavaScript before returning the page. |
| waitMs | integer | optional | How many milliseconds ScrapingBee should wait before returning the page. |
| waitFor | string | optional | The CSS selector ScrapingBee should wait for before returning the page. |
| device | string | optional | The device preset used for the request. |
| blockAds | boolean | optional | Whether ScrapingBee should block ads on the page. |
| blockResources | boolean | optional | Whether ScrapingBee should block images and CSS resources. |
| countryCode | string | optional | The two-letter country code used for request geolocation. |
| premiumProxy | boolean | optional | Whether ScrapingBee should use premium proxy routing. |
| stealthProxy | boolean | optional | Whether ScrapingBee should use stealth proxy routing. |
| transparentStatusCode | boolean | optional | Whether ScrapingBee should return the target page status code transparently. |
| retry | integer | optional | How many times ScrapingBee should retry the request on failure. |
/usage