开发者

List of websites

Is there a way to get th开发者_JAVA百科e url's of google results on big scale? So instead of 10 results 100 or 1000?

(example: http://goohackle.com/tools/google-parser/)


From a technical perspective you can do it, but it is against Google's TOS to actually do it.

Update: To my knowledge, there is not any service that would allow you to do this because, ultimately, Google controls who has access to their services and data. As a result, they also control who (and how) individuals can use their data. Using a tool like the one you described would allow someone to circumvent parts of Google (AKA - advertisements) that Google definitely does not want bypassed as that is their revenue stream and their customers (AKA - advertisers) would move onto some other service if they knew their ads were being bypassed.


On http://www.google.com/advanced_search?hl=en you can set "results per page" option.

Edit:

I think this code snippet should be self-explanatory

<?php
$url = "http://www.google.com/search?q=test&num=100";
$html = file_get_contents($url);
$dom = @DOMDocument::loadHTML($html);
$xpath = new DOMXpath($dom);
$anchors = $xpath->query('//a[@class="l"]');
foreach($anchors as $anchor)
    echo $anchor->getAttribute('href').'<br/>';

Edit #2:

As @JasCav already said, you should use this at your own responsibility. It's against Google's ToS and they would probably detect it eventually.

0

上一篇:

下一篇:

精彩评论

暂无评论...
验证码 换一张
取 消

最新问答

问答排行榜