WebScraper.io integration (Data, Developer Tools). Imported from open-connector.
https://api.webscraper.io/api/v1/account
/sitemap
| Param | Type | Required | Description |
|---|---|---|---|
| _id | string | required | The sitemap identifier inside the sitemap JSON. |
| startUrl | array | required | The sitemap start URLs used by Web Scraper Cloud. |
| selectors | array | required | The selector definitions included in the sitemap JSON. |
/sitemap/{sitemap_id}
| Param | Type | Required | Description |
|---|---|---|---|
| sitemap_id | integer | required | The numeric sitemap ID to fetch. |
/sitemaps
| Param | Type | Required | Description |
|---|---|---|---|
| page | integer | optional | The one-based page number to request. |
| tag | string | optional | The sitemap or scraping job tag used to filter results. |
/sitemap/{sitemap_id}
| Param | Type | Required | Description |
|---|---|---|---|
| sitemap_id | integer | required | The numeric sitemap ID to update. |
| _id | string | required | The sitemap identifier inside the sitemap JSON. |
| startUrl | array | required | The sitemap start URLs used by Web Scraper Cloud. |
| selectors | array | required | The selector definitions included in the sitemap JSON. |
/sitemap/{sitemap_id}
| Param | Type | Required | Description |
|---|---|---|---|
| sitemap_id | integer | required | The numeric sitemap ID to delete. |
/scraping-job/{scraping_job_id}
| Param | Type | Required | Description |
|---|---|---|---|
| scraping_job_id | integer | required | The numeric scraping job ID to fetch. |
/scraping-jobs
| Param | Type | Required | Description |
|---|---|---|---|
| page | integer | optional | The one-based page number to request. |
| sitemap_id | integer | optional | The optional numeric sitemap ID used to filter jobs. |
| tag | string | optional | The optional scraping job tag used to filter results. |
/scraping-job/{scraping_job_id}
| Param | Type | Required | Description |
|---|---|---|---|
| scraping_job_id | integer | required | The numeric scraping job ID to delete. |
/scraping-job/{scraping_job_id}/json
| Param | Type | Required | Description |
|---|---|---|---|
| scraping_job_id | integer | required | The numeric scraping job ID to download. |