Shoora
1/22/2019 - 8:56 PM

web scrapers

web scrapers

Ones where I could find T&C:
https://www.octoparse.com/terms-and-conditions
https://dexi.io/terms
https://www.screamingfrog.co.uk/seo-spider/terms-conditions/
https://www.import.io/terms-conditions/ (<-- They also have a GDPR section, might be interesting)
https://www.incapsula.com/terms-of-use.html

Others: You can try searching google with `site:<website> Terms` to only search a specific site for pages that have "Terms" somewhere on the site.
http://webscraper.io/
https://scrapy.org/

Here's a list of more scrapers: http://scraping.pro/software-for-web-scraping/