The Robots META Tag is meant to provide users who cannot upload or control the /robots.txt file at their websites, with a last chance to keep their content out of search engine indexes and services.
Examples of the Robots META Tag
The
content="robots-terms" is a comma separated list used in the Robots META Tag that may contain one or more of the following keywords without regard to case: noindex, nofollow, all, index and follow.noindexPage may not be indexed by a search service.
nofollowRobots are not to follow links from this page.
Admin Note: The robots directives of
index, follow or all are not required as it is the default behavior of indexing spiders.
indexRobots are welcome to include this page in search services.
followRobots are welcome to follow links from this page to find other pages.
If this meta tag is missing, or if there is no content, or the robot terms are not specified, then the robot terms will be assumed to be
"index, follow" (e.g. "all"). If the keyword all is found in the robots terms list it overrides all other values. That is, a robots terms that is "nofollow, all, noindex, nofollow", would effectively be "all".If the robots terms contains contradictory information (e.g.
"follow, nofollow, follow") then the robot is free to do whatever it wishes with regard to the behavior being addressed (in this case the follow behavior).Common Usage for the Robots META Tag
The Robots META Tag is used for excluding content. We've included three (03) examples below of using the robots meta tag correctly to exclude information from search engine indexes and services.
- A robots term of
noindexallows the links on that page to be followed, even though the page is not to be indexed.
- A robots term of
nofollowallows the page to be indexed, but no links from the page are followed.
- A robots terms of
noindex, nofollowneither the page or the links on that page will be followed or indexed.
Tidak ada komentar:
Posting Komentar