Get 25% off any hosting plan at Hostgator. Use coupon code wphosting9 at Hostgator checkout
How do I add to WordPress robots.txt?
If you need to add information to robots.txt then the simplest is to create a static/physical robots.txt and place it in the root of your URL (it must be the root which is not necessarily the folder in which WordPress is installed). Once robots.txt has been created then merely add whatever instructions you require (a static robots.txt takes preference over a virtual WordPress robots.txt).
Related posts: