开发者

Scraping *.aspx content using Python

I'm having difficulties scraping dynamically generated table in ASPX. Trying to scrape the gas prices from a site like this GasPrices. I can extract all the information in the gas price table (address, time submitted etc.), except for the actual gas price.

Is there a way I 开发者_开发技巧could scrape the gas prices? i.e. somehow get a text representation of it. I'm not very familiar with ASP/ASPX - but what's being generated now is not showing up in the final HTML. I'm using Python to do the scraping, but that's irrelevant unless there's a specific library...

Thanks in advance.


The origin of the page (aspx) is not an issue here.

It looks like they're actively trying to thwart scraping attempts. The numbers are not fonts, rather they several div elements next to one another with background images that are numbers. They really don't want to be scraped.

(of course, if you were really determined you could probably map the class name of the div to... They're not very well 'encrypted')

Take note of the copyright notice at the bottom of the linked page

0

上一篇:

下一篇:

精彩评论

暂无评论...
验证码 换一张
取 消

最新问答

问答排行榜