← Tools Reference

Scrapingdog

Scrapingdog integration (Developer Tools, Data). Imported from open-connector.

API key6 toolshttps://api.scrapingdog.com
GET
scrapingdog_fetch_html
Fetch the HTML response for one target URL through the Scrapingdog Web Scraping API.

/{scrapingdogBaseUrl}/

3 parameters
ParamTypeRequiredDescription
urlstringrequiredThe decoded target URL to scrape.
dynamicbooleanoptionalWhether Scrapingdog should render JavaScript for the target page.
scrapingdogBaseUrlstringrequiredPath parameter: scrapingdogBaseUrl
GET
scrapingdog_google_search
Run a Google Search request through Scrapingdog and return parsed results.

/google

23 parameters
ParamTypeRequiredDescription
querystringrequiredThe Google search query.
domainstringoptionalThe Google domain to use, such as google.com or google.co.uk.
countrystringoptionalThe two-letter country code used for localized results.
crstringoptionalThe Google country restriction filter, such as countryUS.
uulestringoptionalThe encoded Google location parameter.
locationstringoptionalThe origin location for the Google search.
languagestringoptionalThe Google language code for result localization.
lrstringoptionalThe Google language restriction value, such as lang_en.
ludocidstringoptionalThe Google Business listing ID to extract.
lsigstringoptionalThe Google lsig parameter used for some knowledge graph views.
kgmidstringoptionalThe Google Knowledge Graph ID to scrape.
sistringoptionalThe cached Google search parameter string.
ibpstringoptionalThe Google layout expansion parameter.
udsstringoptionalThe Google filtering string.
tbsstringoptionalThe advanced Google search filter string.
safestringoptionalThe Google safe search setting.
nfprbooleanoptionalWhether to exclude results for an auto-corrected query.
filterbooleanoptionalWhether to enable Google's similar and omitted result filters.
pageintegeroptionalThe Google Search page number, starting at 0.
resultsintegeroptionalThe number of Google Search results to request.
advanceSearchbooleanoptionalWhether to request Scrapingdog advanced Google Search parsing.
mobSearchbooleanoptionalWhether to request mobile Google Search results.
htmlbooleanoptionalWhether Scrapingdog should return full Google result page HTML.
GET
scrapingdog_google_maps_search
Run a Google Maps Search request through Scrapingdog.

/google_maps

6 parameters
ParamTypeRequiredDescription
querystringrequiredThe Google Maps search query.
llstringoptionalThe GPS coordinate origin used by Google Maps, such as @40.745,-74,15z.
domainstringoptionalThe Google domain to use for Google Maps results.
languagestringoptionalThe language code for localized Google Maps results.
countrystringoptionalThe two-letter country code used for localized results.
pageintegeroptionalThe Google Maps Search page number, starting at 0.
GET
scrapingdog_google_maps_place
Retrieve details for one Google Maps place through Scrapingdog.

/google_maps/places

4 parameters
ParamTypeRequiredDescription
dataIdstringoptionalThe Google Maps data ID for a place.
placeIdstringoptionalThe Google Maps place ID.
countrystringoptionalThe two-letter country code used for localized results.
typestringoptionalThe Google Maps place request type.
GET
scrapingdog_google_scholar_search
Run a Google Scholar search request through Scrapingdog.

/google_scholar

16 parameters
ParamTypeRequiredDescription
querystringrequiredThe Google Scholar search query.
htmlbooleanoptionalWhether Scrapingdog should return raw Google Scholar HTML.
countrystringoptionalThe two-letter country code used for localized results.
languagestringoptionalThe language code for localized Google Scholar results.
lrstringoptionalThe Google Scholar language restriction value, such as lang_en.
citesstringoptionalThe Google Scholar cited-by article ID.
clusterstringoptionalThe Google Scholar article cluster ID.
asYlostringoptionalThe starting publication year filter.
asYhistringoptionalThe ending publication year filter.
asSdtstringoptionalThe Google Scholar search type or patent/case law filter.
safestringoptionalThe Google Scholar safe search setting.
filterbooleanoptionalWhether to enable Google's similar and omitted result filters.
asVisbooleanoptionalWhether citations should be excluded from Scholar results.
asRrbooleanoptionalWhether only review articles should be returned.
pageintegeroptionalThe Google Scholar page number, starting at 0.
resultsintegeroptionalThe number of Google Scholar results to request.
GET
scrapingdog_get_account_usage
Retrieve Scrapingdog account usage and credit information for the API key.

/account