HTTPCACHE not working when deploying scrapy project to scrapyd

When I try to use HTTPCACHE with scrapyd I get the following error:

[scr开发者_如何转开发apy] WARNING: Disabled Httpcache Middlware: unable to find scrapy.cfg file to infer project data dir

The problem is that http caching defaults to using the relative path httpcache.

This works when you run the spider normally from the command line, but not when running it as a service.

The solution is to set the HTTPCACHE_DIR^[docs] setting to an absolute path.