WHAT IS A META ROBOT?
Date Posted: Thu 20th September 2012
A Meta Robot is a specific type of meta tag used to tell web spiders whether they should index a page or not.
The following value apply:
Allows search engines robots to index the page, this is the default and does not need to be added to the page.
Disallows search engines from showing this page.
This is a shortcut for noindex, nofollow, or basically saying to search engines: donâ€™t do anything with this page at all.
Tells the search engines robots to follow the links on the page, whether it can index it or not.
Tells the search engines robots to not follow any links on the page at all.
Prevents the search engines from showing a cached copy of this page.
Same as noarchive, but only used by MSN/Live.
Prevents the search engines from showing a snippet of this page in the search results and prevents them from caching the page.
Blocks search engines from using the description for this page in DMOZ (aka ODP) as the snippet for your page in the search results.
Blocks Yahoo! from using the description for this page in the Yahoo! directory as the snippet for your page in the search results. No other search engines use the Yahoo! directory for this purpose, so they donâ€™t support the tag.