Summary

Usage of HttpCompressionMiddleware needs to be relfected in Scrapy stats.

Motivation

In order to estimate scrapy memory usage efficiency and prevent.. memory leaks like this.
I will need to know:

1. number of request/response objects that can be active (can be achieved by using [trackref](https://docs.scrapy.org/en/latest/topi

Add .nextElementSibling and .previousElementSibling properties to DOM Element that point to sibling elements.

• nextElementSibling
• previousElementSibling

Main examples at Apify SDK webpage, Github repo and CLI templates should demonstrate how to manipulate with DOM and retrieve data from it.

Also add one example of scraping with Apify SDK + jQuery to https://sdk.apify.com/docs/examples/basiccrawler

Feedback from: https://medium.com/better-programming/do-i-need-python-scrapy-to-build-a-web-scraper-7cc7cac2081d

I lost an hour trying to make

branched from #29 , added failing test.

This assumes the behaviour of nested values are flattened to json.

For consideration.

We have different mixins in spidermon/contrib/monitors/mixins directory, but no documentation.