WebScraping.AI

WebScraping.AI integration (Developer Tools, Data). Imported from open-connector.

API key5 toolshttps://api.webscraping.ai

GET

webscraping_ai_get_account_info

Retrieve WebScraping.AI account email, quota, reset, and concurrency details.

/account

GET

webscraping_ai_fetch_html

Fetch the rendered HTML content of one target page with WebScraping.AI.

/html

13 parameters

Param	Type	Required	Description
url	string	required	The target page URL WebScraping.AI should retrieve.
headers	object	optional	HTTP headers WebScraping.AI should send to the target page.
timeout	integer	optional	Maximum target page retrieval time in milliseconds.
js	boolean	optional	Whether WebScraping.AI should execute on-page JavaScript.
jsTimeout	integer	optional	Maximum JavaScript rendering time in milliseconds.
waitFor	string	optional	A CSS selector WebScraping.AI should wait for before returning.
proxy	string	optional	The WebScraping.AI proxy pool to use for the target page.
country	string	optional	The proxy country code to use for the target page.
device	string	optional	The browser device profile WebScraping.AI should emulate.
errorOn404	boolean	optional	Whether target page HTTP 404 responses should be returned as errors.
errorOnRedirect	boolean	optional	Whether target page redirects should be returned as errors.
jsScript	string	optional	Custom JavaScript code to execute on the target page.
returnScriptResult	boolean	optional	Whether to return the custom JavaScript result instead of the page HTML.

GET

webscraping_ai_extract_text

Extract visible text from one target page with WebScraping.AI.

/text

14 parameters

Param	Type	Required	Description
url	string	required	The target page URL WebScraping.AI should retrieve.
headers	object	optional	HTTP headers WebScraping.AI should send to the target page.
timeout	integer	optional	Maximum target page retrieval time in milliseconds.
js	boolean	optional	Whether WebScraping.AI should execute on-page JavaScript.
jsTimeout	integer	optional	Maximum JavaScript rendering time in milliseconds.
waitFor	string	optional	A CSS selector WebScraping.AI should wait for before returning.
proxy	string	optional	The WebScraping.AI proxy pool to use for the target page.
country	string	optional	The proxy country code to use for the target page.
device	string	optional	The browser device profile WebScraping.AI should emulate.
errorOn404	boolean	optional	Whether target page HTTP 404 responses should be returned as errors.
errorOnRedirect	boolean	optional	Whether target page redirects should be returned as errors.
jsScript	string	optional	Custom JavaScript code to execute on the target page.
textFormat	string	optional	The WebScraping.AI text response format.
returnLinks	boolean	optional	Whether WebScraping.AI should include links when textFormat is json.

GET

webscraping_ai_select_html

Fetch HTML for one selected target page area with WebScraping.AI.

/selected

13 parameters

Param	Type	Required	Description
url	string	required	The target page URL WebScraping.AI should retrieve.
headers	object	optional	HTTP headers WebScraping.AI should send to the target page.
timeout	integer	optional	Maximum target page retrieval time in milliseconds.
js	boolean	optional	Whether WebScraping.AI should execute on-page JavaScript.
jsTimeout	integer	optional	Maximum JavaScript rendering time in milliseconds.
waitFor	string	optional	A CSS selector WebScraping.AI should wait for before returning.
proxy	string	optional	The WebScraping.AI proxy pool to use for the target page.
country	string	optional	The proxy country code to use for the target page.
device	string	optional	The browser device profile WebScraping.AI should emulate.
errorOn404	boolean	optional	Whether target page HTTP 404 responses should be returned as errors.
errorOnRedirect	boolean	optional	Whether target page redirects should be returned as errors.
jsScript	string	optional	Custom JavaScript code to execute on the target page.
selector	string	required	The CSS selector for the page area to return.

GET

webscraping_ai_select_multiple_html

Fetch HTML for multiple selected target page areas with WebScraping.AI.

/selected-multiple

13 parameters

Param	Type	Required	Description
url	string	required	The target page URL WebScraping.AI should retrieve.
headers	object	optional	HTTP headers WebScraping.AI should send to the target page.
timeout	integer	optional	Maximum target page retrieval time in milliseconds.
js	boolean	optional	Whether WebScraping.AI should execute on-page JavaScript.
jsTimeout	integer	optional	Maximum JavaScript rendering time in milliseconds.
waitFor	string	optional	A CSS selector WebScraping.AI should wait for before returning.
proxy	string	optional	The WebScraping.AI proxy pool to use for the target page.
country	string	optional	The proxy country code to use for the target page.
device	string	optional	The browser device profile WebScraping.AI should emulate.
errorOn404	boolean	optional	Whether target page HTTP 404 responses should be returned as errors.
errorOnRedirect	boolean	optional	Whether target page redirects should be returned as errors.
jsScript	string	optional	Custom JavaScript code to execute on the target page.
selectors	array	required	CSS selectors for the page areas to return.