Scrapy Newbie Question - can't get tutorial file working

I am a complete newbie to Python and Scrapy so I started by trying to replicate the tutorial. I am trying to scrape the www.dmoz.org website as per the tutorial.

I compose the dmoz_spider.py as indicated below

from scrapy.spider import BaseSpider
from scrapy.selector import HtmlXPathSelector

from dmoz.items import DmozItem

class DmozSpider(BaseSpider):
   name = "dmoz.org"
   allowed_domains = ["dmoz.org"]
   start_urls = [
       "http://www.dmoz.org/Computers/Programming/Languages/Python/Books/",
       "http://www.dmoz.org/Computers/Programming/Languages/Python/Resources/"
   ]

   def parse(self, response):
       hxs = HtmlXPathSelector(response)
       sites = hxs.select('//ul/li')
       items = []
       for site in sites:
           item = DmozItem()
           item['title'] = site.select('a/text()').extract()
           item['link'] = site.select('a/@href').extract(开发者_JS百科)
           item['desc'] = site.select('text()').extract()
           items.append(item)
       return items

and what I am supposed to get via website is something different.

any idea what I am screwing up?

I had this problem. Make sure you made the below change as it says to do in the tutorial.

Open items.py and see if you changed class

class TutorialItem(Item):
    title=Field()
    link=Field()
    desc=Field()

into:

class DmozItem(Item):
    title=Field()
    link=Field()
    desc=Field()

There is nothing wrong with the code you pasted. The problem must be elsewhere, can you paste the whole output you get? (your comment stops where the interesting part starts...)

You need to go the the directory containing the settings.py file and run

scrapy crawl dmoz from there.

FOllow the structure of your project against https://github.com/scrapy/dirbot for clarity