How to block search engines from finding sub.domains? [closed]
This question does not appear to be about programming within the scope defined in the help center.
Closed 9 开发者_如何转开发years ago.
Improve this questionI want to block search engines like Google and Yahoo from crawling user sub.domains like user.example.com, how can i do it?
Use robots.txt file in your web server.
So, in your subdomain put a robots.txt file that looks like this:
User-agent: *
Disallow: /
All sites have something specifically specified because that's what they don't want crawled by search engines...
精彩评论