Scrapfly

Scrapfly integration (Developer Tools, Data). Imported from open-connector.

API key2 toolshttps://api.scrapfly.io

GET

scrapfly_scrape

Scrape one public URL through Scrapfly and return the documented JSON response envelope.

/scrape

21 parameters

Param	Type	Required	Description
url	string	required	The public URL Scrapfly should scrape.
method	string	optional	The HTTP method Scrapfly should use against the target URL.
body	string	optional	The raw request body Scrapfly should send to the target URL.
content_type	string	optional	The Content-Type header for the target request body.
format	string	optional	The content format Scrapfly should return.
country	string	optional	The proxy country selection accepted by Scrapfly, such as us, us,ca,mx, or -gb.
proxy_pool	string	optional	The Scrapfly proxy pool to use for the scrape.
render_js	boolean	optional	Whether Scrapfly should render JavaScript before returning.
asp	boolean	optional	Whether Scrapfly should enable Anti Scraping Protection.
retry	boolean	optional	Whether Scrapfly should retry the scrape request.
timeout	integer	optional	The scrape timeout in milliseconds.
wait_for_selector	string	optional	The CSS selector Scrapfly should wait for before returning content.
cache	boolean	optional	Whether Scrapfly should use cached scrape results when available.
cache_ttl	integer	optional	The cache time-to-live in seconds.
cache_clear	boolean	optional	Whether Scrapfly should clear any matching cached result.
session	string	optional	The Scrapfly session name used to keep browsing state.
session_sticky_proxy	boolean	optional	Whether Scrapfly should keep the session proxy sticky.
headers	object	optional	Target request headers Scrapfly should send to the scraped website.
tags	array	optional	Tags for grouping the scrape in Scrapfly monitoring.
correlation_id	string	optional	A caller-provided correlation identifier for monitoring.
debug	boolean	optional	Whether Scrapfly should expose debug data for the scrape.

GET

scrapfly_get_monitoring_metrics

Retrieve Scrapfly monitoring metrics for the connected API key.

/scrape/monitoring/metrics

5 parameters

Param	Type	Required	Description
aggregation	string	optional	The metrics aggregation list accepted by Scrapfly, such as account, project, or…
period	string	optional	The monitoring period to retrieve.
start	string	optional	The UTC start date accepted by Scrapfly when period is omitted.
end	string	optional	The UTC end date accepted by Scrapfly when period is omitted.
group_subdomain	boolean	optional	Whether target aggregation should group subdomains.