CURLOPT_USERAGENT: Mozilla/5.0 vs Googlebot 2.1 - Is one faster?
Is there any difference in performance when using Googlebot vs Mozilla as the CURLOPT_USERAGENT
? I'm hypothesizing that some pages might output simpler HTML when Googlebot is the useragent, but I don't really开发者_如何学编程 know.
Setting a user agent won't make your cURL call faster. In fact, in some servers, they intend to block suspicious User Agent. Therefore, just use the default user agent is fine.
精彩评论