Is it possible to do HTML scraping , data mining through Python?

Can I gather intelligent data , HTML scraping using python? I have no knowledge of it , so I woul开发者_运维问答d like to get some idea.

Look at the module scrapy:

http://scrapy.org/

You certainly can - I developed this library in Python for my web scraping work.

A good parsing library is lxml.

If you are new to Python you may want to work through this ebook first.

Try using urllib2 and Beautiful Soup.

urllib2 is useful for requesting URLs programmatically. It's part of the standard library: http://docs.python.org/library/urllib2

Beautiful Soup is good for mining HTML/XML and can be found here: http://pypi.python.org/pypi/BeautifulSoup

You may also use htql library at: http://htql.net.