Many search engines are making getting your website listed easier with their spidering and indexing abilities through their automated scripts. However, some site owners may not want to index all their pages or would like to restrict how far a search engine spiders a site. META Tag robots can help interact your website with search engine indicating which pages to index and which to stay clear of.
Indexing This Webpage META Tag Robots work on a "per page" basis. Each webpage that a search engine visits must define whether you would like to index this webpage or not. Allow search engine to index your webpage:
Following Links Many search engines will follow all links on your main page and index all your linked pages (if enabled). To disable link following (spidering), select disable below. Allow Following (Spidering):
META Tag Robot Code
Code completed. Find enclosed below the META Tag code required by search engines that support META Tag robots. The code below should be inserted between the (Head) and (/Head) tags on your webpages to ensure search engines read them in the beginning
Note: The code should be pasted under (head) tag between the angle bracket (<>).
Yes, Index My Webpage
Enable Following Links
Code: meta name="robots" content="INDEX,FOLLOW"
Yes, Index My Webpage
Disable Following Links
Code: meta name="robots" content="INDEX,NOFOLLOW"
No, Do not Index
Disable Following Links
Code: meta name="robots" content="NOINDEX,NOFOLLOW"
No, Do not Index
Enable Following Links
Code: meta name="robots" content="NOINDEX,FOLLOW"
