Just wanted to drop a quick note if any one lands here and is struggling with the problem of using Scrapy’s build-in S3 feed storage and wants to upload the feed/file created by scrapy to S3 as gzipped file.

Continue reading