Note that these are requests only
- the behaviour and policies of a robot are controlled by its masters. Not all
robots will recognise - or obey - these tags.
Both metatags and robots.txt file in your document root both assume the bot will be well mannered, and respect the settings therein. The bots that are important for SEO such as Google, Yahoo, AOL, Bing all respect both meta tags and the robots.txt requests.