By default Scrapy uses scrapy.cfg in the projects root. Is there a way to t开发者_如何学Pythonell it to use a different .cfg file? No this is the default behavior.See this source. As v01d said there\
I have started to use scrapy on Ubuntu 11, and facing issue. Specifically the parse function in the following code does not execute, although the terminal shows开发者_如何学运维 the spider executed an
It looks like Scrapy is using HTTP 1.0 by default. Is there a setting to make it us开发者_运维问答e HTTP 1.1 to send request?
on my root server http://my.root.ip I have a scrapy server running at http://my.root.ip:6800. I want to make http://my.root.ip:6800 accessable from a subdomain like http://scrapy.mydomain.com.
I am using Scrapy with the following url: http://www.marzetti.com/products/marzetti/detail.php?bc=35&cid=2&pid=1101&i=pl
Is it possible to select which version of Python is used by Scrapy?I am running Scrapy on Ubuntu 10.04 which ships with Python 2.6.I have Python 2.7 installed on my machine and would like to take adva
Is it possible to开发者_JS百科 simulate login on site like www.eoddata.com with scrapy? The website use a post request to submit login information.http://readthedocs.org/docs/scrapy/en/latest/topics/r
Overview of my project: I\'m trying to create a simple script in python 2.6 that will get traffic time data from Bing Maps.The Scrapy library module package (scrapy.org/) is what I\'m using to crawl
(I have asked this question on the Scrapy google-group without luck.) I am trying to log into Facebook using Scrapy. I tried the following in the interactive shell:
I am trying to scrape a website but I can\'t get scrapy to follow links and I don\'t get any Python errors and I see nothing going on with Wireshark. I thought it could be the regex but I tried \".*\"
加载中,请稍侯......