Popular repositories Loading

1. scrapy-splash scrapy-splash Public

   Forked from scrapy-plugins/scrapy-splash

   Scrapy+Splash for JavaScript integration

   Python

2. scrapy-dotpersistence scrapy-dotpersistence Public

   Forked from scrapy-plugins/scrapy-dotpersistence

   A scrapy extension to sync `.scrapy` folder to an S3 bucket

   Python

3. scrapy-crawlera scrapy-crawlera Public

   Forked from scrapy-plugins/scrapy-zyte-smartproxy

   Crawlera middleware for Scrapy

   Python

4. scrapy-statsd scrapy-statsd Public

   Forked from scrapy-plugins/scrapy-statsd

   Python

5. scrapy-deltafetch scrapy-deltafetch Public

   Forked from scrapy-plugins/scrapy-deltafetch

   Scrapy spider middleware to ignore requests to pages containing items seen in previous crawls

   Python

6. scrapy-hcf scrapy-hcf Public

   Forked from scrapy-plugins/scrapy-hcf

   Scrapy spider middleware to use Scrapinghub's Hub Crawl Frontier as a backend for URLs

   Python