where I to put file robots.txt?
I have the domain www.mydomain.com and I set a开发者_如何学运维pache mod-rewrite so as to have www.mydomain.com/myappl. Where should I place the file robots.txt? thanks!
The robots.txt must be accessible to clients as http://www.mydomain.com/robots.txt . How to accomplish that depends on your mod-rewrite configuration. Please post the config if you need more help.
Also see http://en.wikipedia.org/wiki/Robots_exclusion_standard for details.
I don't know ;-) But you can use the robots checker to find if your file is accessible. So if you don't know guess where it will be accessible and test it.
精彩评论