开发者

Open Graph: Facebook crawler name and ip’s to white list

I开发者_Go百科 am prepping up for the open graph release.

One of the features from open graph is to crawl the site’s meta data and pull relevant info for the timeline.

My sitemap.xml runs into gigs and is protected by rate limiting and ip whitlisting for popular crawlers like Googlebot & Slurp.

Can someone pass me the robot names and ips that will be crawling for facebook? This is not just for sitemap.xml, but for general rate limit(whole site) white listing too.


The current user agent is: facebookexternalhit/1.1 (+http://www.facebook.com/externalhit_uatext.php)

Facebook publishes their IP range here.

0

上一篇:

下一篇:

精彩评论

暂无评论...
验证码 换一张
取 消

最新问答

问答排行榜